-- Logs begin at Mon 2022-01-10 12:09:32 UTC, end at Mon 2022-01-10 13:05:05 UTC. -- Jan 10 12:34:08.552019 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jan 10 12:34:08.562001 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jan 10 12:34:08.564741 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jan 10 12:34:08 2022] *** Jan 10 12:34:08.565280 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 10 12:34:08.565458 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 10 12:34:08.565592 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: nodename: dv-cinder-master-3-iscsi Jan 10 12:34:08.565727 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: machine: x86_64 Jan 10 12:34:08.565869 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: clock source: unix Jan 10 12:34:08.566018 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: pcre jit disabled Jan 10 12:34:08.566155 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: detected number of CPU cores: 4 Jan 10 12:34:08.566286 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: current working directory: / Jan 10 12:34:08.566424 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: detected binary path: /usr/bin/uwsgi-core Jan 10 12:34:08.566551 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: your processes number limit is 47680 Jan 10 12:34:08.566551 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: your memory page size is 4096 bytes Jan 10 12:34:08.566551 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: detected max file descriptor number: 2048 Jan 10 12:34:08.566551 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: lock engine: pthread robust mutexes Jan 10 12:34:08.566824 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: thunder lock: enabled Jan 10 12:34:08.566887 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jan 10 12:34:08.567047 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 10 12:34:08.617253 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: Python main interpreter initialized at 0x55557faa49c0 Jan 10 12:34:08.617253 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: python threads support enabled Jan 10 12:34:08.617253 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: your server socket listen backlog is limited to 100 connections Jan 10 12:34:08.617253 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: your mercy for graceful operations on workers is 90 seconds Jan 10 12:34:08.617599 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: mapped 403077 bytes (393 KB) for 2 cores Jan 10 12:34:08.617661 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: *** Operational MODE: preforking *** Jan 10 12:34:08.617937 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: *** uWSGI is running in multiple interpreter mode *** Jan 10 12:34:08.617937 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: spawned uWSGI master process (pid: 86072) Jan 10 12:34:08.618147 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jan 10 12:34:08.623539 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: spawned uWSGI worker 1 (pid: 86080, cores: 1) Jan 10 12:34:08.623539 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: spawned uWSGI worker 2 (pid: 86081, cores: 1) Jan 10 12:34:08.623539 dv-cinder-master-3-iscsi devstack@keystone.service[86072]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 10 12:34:13.982838 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 12:34:13.982838 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: from cryptography.utils import int_from_bytes Jan 10 12:34:13.984715 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 12:34:13.984715 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: from cryptography.utils import int_from_bytes Jan 10 12:34:13.985193 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 12:34:13.985193 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: from cryptography.utils import int_from_bytes Jan 10 12:34:13.985353 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 10 12:34:13.985353 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: from cryptography.utils import int_from_bytes Jan 10 12:34:14.028737 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 10 12:34:14.028921 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 10 12:34:14.029009 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 10 12:34:14.029089 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 10 12:34:14.029161 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] command line args: [] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 10 12:34:14.029225 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] command line args: [] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 10 12:34:14.029356 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 10 12:34:14.029502 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 10 12:34:14.029589 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ================================================================================ {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 10 12:34:14.029681 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ================================================================================ {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 10 12:34:14.029760 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] admin_token = **** {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.029826 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] admin_token = **** {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.030034 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] config_dir = [] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.030124 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] config_dir = [] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.030185 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.030262 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.030330 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] config_source = [] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.030395 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] config_source = [] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.030460 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] debug = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.030525 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] debug = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.030679 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.030916 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.031004 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.031070 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.031203 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.031288 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.031401 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.031483 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.031679 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.031768 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.031902 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] list_limit = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.031995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] list_limit = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.032062 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] log_config_append = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.032125 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] log_config_append = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.032245 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.032320 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.032412 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] log_dir = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.032495 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] log_dir = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.032561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] log_file = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.032624 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] log_file = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.032821 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.032936 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.033022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.033094 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.033274 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.033360 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.033539 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.033677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.033677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.033828 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.033895 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.033960 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.034088 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.034233 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.034333 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.034412 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.034532 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.034641 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.034779 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.034880 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.035083 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.035214 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.035298 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.035360 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.035444 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.035575 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.035709 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.035808 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.035991 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.036080 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.036477 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.036572 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.13/identity {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.036637 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] publish_errors = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.036700 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] publish_errors = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.036857 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.036946 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.037082 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.037166 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.037336 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.037404 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.037536 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.037617 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.037683 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.037748 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.037928 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] standard_threads = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.038017 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] standard_threads = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.038133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.038209 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.038374 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.038457 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.038583 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.038666 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.038739 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] use_journal = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.038859 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] use_journal = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.038941 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] use_json = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.039019 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] use_json = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.039105 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] use_stderr = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.039185 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] use_stderr = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.039263 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] use_syslog = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.039336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] use_syslog = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.039408 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.039556 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 10 12:34:14.039671 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.039797 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.039882 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.040042 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.040121 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.040304 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.040467 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.040545 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.040624 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.040780 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.040874 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.041015 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.041103 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.041264 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.041349 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.041500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.041584 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.041767 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.041901 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.042034 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.042100 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.042248 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.042346 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.042486 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.042612 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.042721 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.042801 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.042948 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.043034 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.043192 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.043286 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.043424 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.043542 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.043689 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.043783 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.043948 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.044041 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.044202 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.044294 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.044444 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.044524 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.044680 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.044758 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.044931 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.045009 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.045189 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.045275 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.045438 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.045516 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.045667 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.045744 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.045898 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.045975 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.046137 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.046211 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.046339 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.046423 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.046572 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.046650 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.046817 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.046894 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.047047 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.047124 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.047274 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.047356 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.047503 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.047614 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.047770 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.047848 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.048006 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.048083 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.048238 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.048315 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.048473 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.048551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.048707 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.048783 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.048939 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.049022 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.049169 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.049252 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.049394 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.049470 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.049622 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.049732 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.049837 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.049933 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.050061 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.050170 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.050279 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.050375 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.050521 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.050643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.050729 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.050842 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.050964 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.051142 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.051229 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.051311 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.051412 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.051503 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.051678 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.051756 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.051908 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.051987 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.052142 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.052235 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.052373 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.052450 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.052605 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.052691 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.052837 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.052922 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.053070 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.053149 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.053299 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.053379 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.053528 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.053610 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.053769 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.053896 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.054033 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.054162 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.054298 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.054435 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.054435 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.054675 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.054675 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.054871 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.054947 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.055061 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.055173 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.055256 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.055336 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.055409 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.055591 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.055685 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.055846 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.055932 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.056080 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.056157 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.056312 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.056388 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.056547 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.056632 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.056779 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.056857 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.057013 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.057091 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.057244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.057402 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.057477 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.057549 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.057859 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.057942 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.058023 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.058141 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.058255 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.058333 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.058452 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.058533 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.058691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.058780 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.058928 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.059005 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.059158 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.059243 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.059385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.059471 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.059637 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.059716 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.059864 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.059942 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.060091 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.060185 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.060323 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.060408 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.060553 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.060632 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.060790 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.060873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.061019 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.061098 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.061273 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.061352 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.061513 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.061590 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.061743 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] auth.external = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.061822 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.061971 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] auth.external = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.062055 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.062202 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.062281 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.062490 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.062636 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.062716 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] auth.password = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.062793 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.062926 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] auth.token = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.063007 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] auth.password = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.063163 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] auth.token = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.063248 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.063395 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.063473 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.063656 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.063735 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.063884 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.063970 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.064124 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.064203 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.064365 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.064438 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.064596 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.064675 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.064824 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.065277 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] credential.caching = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.065424 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] credential.caching = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.065504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.065669 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.065747 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.065915 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.065994 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.066146 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.066224 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.066383 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.066460 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.066614 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.066693 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.066845 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.066929 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.067092 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.067173 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.067325 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.067404 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.067588 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.067683 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.067841 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.067929 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.068101 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.068180 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.068354 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.068433 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.068604 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.068691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.068848 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.068935 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.069082 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] federation.caching = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.069160 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.069325 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] federation.caching = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.069411 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.069568 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.069648 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.069811 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.069889 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.070038 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.070124 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.070271 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.070348 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.070503 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.070587 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.070739 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.070828 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.070986 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.071066 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.071217 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.071301 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.071468 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.071646 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.071725 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.071797 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.071960 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] identity.caching = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.072040 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.072191 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] identity.caching = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.072278 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.072436 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.072516 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.072669 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.072748 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.072905 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.072992 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.073136 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.073359 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.073496 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.073579 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.073653 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.073734 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.073871 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.073951 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.074117 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.074197 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.074365 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.074454 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.074594 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.074674 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.074829 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.074914 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.075053 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.075143 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.075295 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.075376 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.075566 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.075662 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.075808 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.075897 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.076056 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.076144 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.076298 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.076377 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.076550 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.076637 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.076786 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.076866 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.077015 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.077096 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.077249 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.077330 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.077477 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.077556 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.077703 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.077780 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.077937 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.078018 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.078173 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.078250 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.078412 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.078491 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.078638 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.078717 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.078874 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.078959 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.079117 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.079195 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.079350 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.079430 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.079605 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.079689 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.079856 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.079936 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.080094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.080175 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.080321 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.080407 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.080547 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.080625 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.080774 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.080854 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.081005 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.081083 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.081234 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.081313 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.081468 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.081548 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.081698 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.081776 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.081932 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.082012 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.082179 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.082258 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.082410 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.082489 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.082639 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.082718 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.082870 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.082951 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.083118 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.083197 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.083349 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.083427 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.083605 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.083691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.083842 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.083968 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.084077 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.084169 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.user = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.084307 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.user = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.084388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.084545 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.084624 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.084781 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.084859 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.085018 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.085097 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.085263 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.085343 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.085507 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.085591 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.085742 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.085828 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.085972 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.086050 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.086200 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.086279 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.086432 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.086513 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.086664 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.086748 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.086894 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.086972 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.087123 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.087203 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.087366 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.087445 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.087632 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.087713 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.087876 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.087957 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.088125 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.088204 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.088355 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.088433 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.088592 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.088671 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.088850 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.088935 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.089088 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.089168 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.089325 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.089406 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.089560 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.089639 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.089801 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.089880 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.090044 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.090131 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.090279 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.090357 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.090514 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.090591 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.090749 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.090828 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.090983 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.091061 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.091214 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.091291 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.091445 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.091542 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.091702 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.091782 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.091936 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.092015 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.092174 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.092255 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.092405 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.092484 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.092632 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.092719 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.092869 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] resource.caching = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.092946 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.093106 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] resource.caching = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.093184 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.093353 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.093439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.093590 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.093669 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.093821 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.093899 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.094067 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.094226 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.094303 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.094376 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.094532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.094612 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.094768 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.094905 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.094985 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.095058 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.095223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.095302 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] role.caching = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.095457 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] role.caching = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.095569 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] role.driver = sql {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.095709 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.095788 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] role.driver = sql {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.095949 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.096027 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.096194 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.096282 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.096438 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.096516 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.096685 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.096765 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.096927 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.097017 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.097171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.097249 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.097416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.097494 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.097658 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.097745 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.097886 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.097964 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.098123 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.098201 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.098367 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.098454 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.098610 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.098688 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.098853 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.098931 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.099094 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.099244 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.099479 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.099611 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.099748 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.099828 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.099990 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.100071 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.100236 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.100314 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.100481 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.100559 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.100714 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.100795 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.100945 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.101023 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.101197 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.101276 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.101428 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.101508 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.101658 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.101738 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.101886 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.101965 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.102115 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.102195 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.102343 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.102421 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.102593 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.102672 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.102837 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.102916 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.103073 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.103152 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.103309 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.103388 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.103558 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.103643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.103794 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.103872 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] token.caching = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.104027 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.104104 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] token.caching = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.104260 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.104340 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.104551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.104639 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.104788 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.104867 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.105044 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.105125 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.105284 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.105361 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.105517 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.105594 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.105757 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.105837 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.105996 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.106074 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.106227 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.106305 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.106463 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.106542 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.106694 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.106772 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.106923 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.107000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.107168 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.107249 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.107394 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.107472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.107652 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.107732 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.107896 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.107978 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.108160 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.108239 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] database.connection = **** {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.108415 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.108530 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] database.connection = **** {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.108666 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.108775 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.108900 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.109024 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.109141 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.109262 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.109375 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.109507 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.109609 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.109743 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.109842 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.109980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.110067 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.110215 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.110334 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.110448 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.110569 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.110724 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.110812 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.110959 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.111049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.111203 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.111284 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.111443 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.111585 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.111726 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.111807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.111960 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.112041 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.112199 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.112280 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.112426 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.112504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.112595 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 10 12:34:14.112671 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.112886 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 10 12:34:14.113054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 10 12:34:14.142651 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.142910 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.143085 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.143825 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.144059 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.144286 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.151768 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.152993 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.180307 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.180550 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.181004 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.181206 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.233496 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.234840 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.282408 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.282706 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.283878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.284114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.349348 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.349573 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.349796 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.349995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.350113 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.350215 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.350298 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.350469 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.350608 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.350706 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.350872 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.351087 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.374436 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.374614 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.374875 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.375063 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.375162 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.375304 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.375428 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.375534 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.375635 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.375714 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.375792 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.375967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.376160 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.376368 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.387147 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.387656 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.399706 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.399966 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.400150 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.400392 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.400517 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.400587 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.400650 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.400770 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.400873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.400976 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.401065 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.401223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.401503 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.401694 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 10 12:34:14.418465 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.418597 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.418668 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 10 12:34:14.418805 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 10 12:34:14.418954 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.419132 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.419259 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 10 12:34:14.419330 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 10 12:34:14.419411 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.419618 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.419764 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.419838 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.419914 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.420090 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.420185 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.420367 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.430817 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.431054 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.431180 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.431332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.431457 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.431569 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.431652 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.431872 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.439544 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.440646 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.443098 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.443376 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.443788 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.443915 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.444069 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.444217 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.444293 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.444370 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.444582 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.444710 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.444863 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.444974 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.445102 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.445198 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.445373 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.445504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.445587 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.445742 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.445868 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.445987 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.446268 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.446533 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.471875 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.472533 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.473431 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.473707 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.474092 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.474366 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.478792 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.479066 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.479340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.479465 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.480004 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.480004 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.486496 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.486737 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.487078 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.487358 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.491188 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.491472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.491772 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.491900 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.492054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.492200 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.492275 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.492353 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.492578 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.492706 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.492791 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.492872 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.493094 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.493223 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.493393 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.493642 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.511372 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.511669 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.511870 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.512145 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.516127 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.516612 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.519719 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.519989 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.520111 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.520413 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.524876 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.525344 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.528689 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.528944 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.532235 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.532526 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.532652 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.532805 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.532933 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.533088 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.533230 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.533348 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.533443 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.533656 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.533785 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.533976 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.552460 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.552659 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.552784 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.552967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.553189 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.553277 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.553342 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.553481 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.561012 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.561234 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.562630 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.562862 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.562961 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.563161 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.566259 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.566505 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.566630 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.566784 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.566909 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.567061 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.567234 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.567331 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.567396 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.567618 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.580656 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.580936 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.581211 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.581484 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.581766 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.581894 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.581998 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.582104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.582308 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.582436 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.582636 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.582913 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.583184 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.583454 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.601027 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.601176 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.604193 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.604322 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.607553 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.607682 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.609109 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.609237 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.610711 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.610840 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.610992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.611120 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.611235 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.611343 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.618429 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.618555 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.620017 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.620142 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.623407 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.623718 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.623997 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.624266 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.624391 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.624556 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.624845 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.625114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.633214 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.633497 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.633770 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.634091 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.634373 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.634648 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.641671 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.641953 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.642221 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.642366 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 10 12:34:14.642462 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.642540 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.642738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.642870 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.642955 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.643068 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.643264 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.643395 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.643500 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.643621 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.643820 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.643946 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.644094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.644221 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.644362 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.644500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.644608 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.644696 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.644884 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.645008 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.645104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.645185 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.645524 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.645779 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 10 12:34:14.681919 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55557faa49c0 pid: 86081 (default app) Jan 10 12:34:14.682467 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55557faa49c0 pid: 86080 (default app) Jan 10 12:34:14.685383 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198816f-9c53-43ac-80ae-964ab089f889 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:14.685671 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198816f-9c53-43ac-80ae-964ab089f889 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:14.685948 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198816f-9c53-43ac-80ae-964ab089f889 None None] PATH_INFO: `/v3` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:14.690572 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 791 bytes} [Mon Jan 10 12:34:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:22.727394 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47e5b9-d730-4895-9a87-dba2c1e096d4 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:22.728257 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47e5b9-d730-4895-9a87-dba2c1e096d4 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:22.728257 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47e5b9-d730-4895-9a87-dba2c1e096d4 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:22.736775 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:22 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:22.743866 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca285c-db9a-4ada-b7d9-6b350e08360e None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:22.744350 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca285c-db9a-4ada-b7d9-6b350e08360e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:22.744437 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca285c-db9a-4ada-b7d9-6b350e08360e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:22.775355 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG oslo_db.sqlalchemy.engines [None req-ecca285c-db9a-4ada-b7d9-6b350e08360e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86081) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 12:34:23.073017 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG passlib.handlers.bcrypt [None req-ecca285c-db9a-4ada-b7d9-6b350e08360e None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86081) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 10 12:34:23.073383 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG passlib.handlers.bcrypt [None req-ecca285c-db9a-4ada-b7d9-6b350e08360e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86081) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 10 12:34:23.129637 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-ecca285c-db9a-4ada-b7d9-6b350e08360e None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:23.131253 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ecca285c-db9a-4ada-b7d9-6b350e08360e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:23.280104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 537 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:34:23.445267 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47e5b9-d730-4895-9a87-dba2c1e096d4 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:23.490487 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG oslo_db.sqlalchemy.engines [None req-cf47e5b9-d730-4895-9a87-dba2c1e096d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 10 12:34:23.742772 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47e5b9-d730-4895-9a87-dba2c1e096d4 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:23.748083 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34278fb2-39d2-4207-b085-66f696820ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:23.748747 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34278fb2-39d2-4207-b085-66f696820ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:23.749025 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34278fb2-39d2-4207-b085-66f696820ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:23.749294 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34278fb2-39d2-4207-b085-66f696820ce0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:23.757879 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34278fb2-39d2-4207-b085-66f696820ce0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:23.806635 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.common.rbac_enforcer.enforcer [None req-34278fb2-39d2-4207-b085-66f696820ce0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 10 12:34:23.806973 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34278fb2-39d2-4207-b085-66f696820ce0 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:23.817370 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:34:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:34:23.827115 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca285c-db9a-4ada-b7d9-6b350e08360e None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:23.850354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca285c-db9a-4ada-b7d9-6b350e08360e None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:23.857885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdfc7e-b0ee-4f64-b7a4-8f817246ea06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:23.859011 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdfc7e-b0ee-4f64-b7a4-8f817246ea06 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:23.859295 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdfc7e-b0ee-4f64-b7a4-8f817246ea06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:23.859613 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdfc7e-b0ee-4f64-b7a4-8f817246ea06 admin admin] PATH_INFO: `/v3/projects/230e0a61baae4ee798a1e664588228fe` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:23.861382 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdfc7e-b0ee-4f64-b7a4-8f817246ea06 admin admin] RBAC: Authorizing `identity:get_project(project_id=230e0a61baae4ee798a1e664588228fe)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:23.912516 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d5fdfc7e-b0ee-4f64-b7a4-8f817246ea06 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 10 12:34:23.912858 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdfc7e-b0ee-4f64-b7a4-8f817246ea06 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:23.917874 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 3/5] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:23 2022] GET /identity/v3/projects/230e0a61baae4ee798a1e664588228fe => generated 344 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:26.279880 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f7690-b8ac-4e0b-83a9-3be64d0bae89 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:26.280760 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f7690-b8ac-4e0b-83a9-3be64d0bae89 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:26.281138 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f7690-b8ac-4e0b-83a9-3be64d0bae89 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:26.288786 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 3/6] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:26 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:26.297550 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550253f-da15-41d7-bfea-81333c8bcee5 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:26.297967 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550253f-da15-41d7-bfea-81333c8bcee5 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:26.298050 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550253f-da15-41d7-bfea-81333c8bcee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:26.318527 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-e550253f-da15-41d7-bfea-81333c8bcee5 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:26.320094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-e550253f-da15-41d7-bfea-81333c8bcee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:26.329928 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:26.352144 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f7690-b8ac-4e0b-83a9-3be64d0bae89 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:26.367739 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f7690-b8ac-4e0b-83a9-3be64d0bae89 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:26.373633 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da64f6e-23e7-47b3-abd2-3307e20b79cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:26.374264 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da64f6e-23e7-47b3-abd2-3307e20b79cd admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:26.374545 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da64f6e-23e7-47b3-abd2-3307e20b79cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:26.374798 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da64f6e-23e7-47b3-abd2-3307e20b79cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:26.383157 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da64f6e-23e7-47b3-abd2-3307e20b79cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:26.384950 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da64f6e-23e7-47b3-abd2-3307e20b79cd admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:26.393798 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:34:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:34:26.399576 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550253f-da15-41d7-bfea-81333c8bcee5 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:26.414584 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550253f-da15-41d7-bfea-81333c8bcee5 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:26.421578 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7656eb7-6a3b-4fe5-a5ab-9abe4f8bc4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:26.422441 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7656eb7-6a3b-4fe5-a5ab-9abe4f8bc4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:26.422719 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7656eb7-6a3b-4fe5-a5ab-9abe4f8bc4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:26.422986 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7656eb7-6a3b-4fe5-a5ab-9abe4f8bc4b3 admin admin] PATH_INFO: `/v3/users/ab9027ff8dfb4123b38f937a7e7a8597` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:26.424521 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7656eb7-6a3b-4fe5-a5ab-9abe4f8bc4b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=ab9027ff8dfb4123b38f937a7e7a8597)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:26.426363 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7656eb7-6a3b-4fe5-a5ab-9abe4f8bc4b3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:26.427976 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 5/9] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:26 2022] GET /identity/v3/users/ab9027ff8dfb4123b38f937a7e7a8597 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:28.849191 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ffc36-6efb-4e8a-80fd-cf162b037420 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:28.849762 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ffc36-6efb-4e8a-80fd-cf162b037420 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:28.849762 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ffc36-6efb-4e8a-80fd-cf162b037420 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:28.851490 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:28.857304 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1980c6-9e90-478f-8e3e-2a6ab1d0b65c None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:28.857729 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1980c6-9e90-478f-8e3e-2a6ab1d0b65c None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:28.857976 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1980c6-9e90-478f-8e3e-2a6ab1d0b65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:28.876678 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-dc1980c6-9e90-478f-8e3e-2a6ab1d0b65c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:28.877880 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-dc1980c6-9e90-478f-8e3e-2a6ab1d0b65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:28.886380 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 6/11] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:28.912423 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ffc36-6efb-4e8a-80fd-cf162b037420 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:28.922549 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a38fe-2293-4a91-ba2a-167564e6d58a None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:28.922892 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a38fe-2293-4a91-ba2a-167564e6d58a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:28.923173 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a38fe-2293-4a91-ba2a-167564e6d58a None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:28.925436 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 7/12] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:28.926244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ffc36-6efb-4e8a-80fd-cf162b037420 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:28.931670 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c5f0d-ca4d-4c52-bb2d-17ec41afe38a None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:28.931959 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c5f0d-ca4d-4c52-bb2d-17ec41afe38a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:28.932054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea246ce4-646f-4cff-befc-e06c36685f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:28.932233 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c5f0d-ca4d-4c52-bb2d-17ec41afe38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:28.932820 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea246ce4-646f-4cff-befc-e06c36685f5e admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:28.933104 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea246ce4-646f-4cff-befc-e06c36685f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:28.933374 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea246ce4-646f-4cff-befc-e06c36685f5e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:28.950633 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-770c5f0d-ca4d-4c52-bb2d-17ec41afe38a None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:28.950803 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea246ce4-646f-4cff-befc-e06c36685f5e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:28.951891 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-770c5f0d-ca4d-4c52-bb2d-17ec41afe38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:28.957741 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-ea246ce4-646f-4cff-befc-e06c36685f5e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:34:28.958957 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 6/13] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:34:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:28.959593 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 8/14] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:34:28.964771 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea246ce4-646f-4cff-befc-e06c36685f5e admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:28.974366 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea246ce4-646f-4cff-befc-e06c36685f5e admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:28.979232 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408e3b9-7cdc-4c3d-8c0d-7e9abb7c2eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:28.979863 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408e3b9-7cdc-4c3d-8c0d-7e9abb7c2eaf admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:28.980163 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408e3b9-7cdc-4c3d-8c0d-7e9abb7c2eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:28.980407 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408e3b9-7cdc-4c3d-8c0d-7e9abb7c2eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:28.981164 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408e3b9-7cdc-4c3d-8c0d-7e9abb7c2eaf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:28.981467 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408e3b9-7cdc-4c3d-8c0d-7e9abb7c2eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:28.981752 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c5f0d-ca4d-4c52-bb2d-17ec41afe38a None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:28.983319 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-1408e3b9-7cdc-4c3d-8c0d-7e9abb7c2eaf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:34:28.983319 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:34:28.983319 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:34:28.984206 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408e3b9-7cdc-4c3d-8c0d-7e9abb7c2eaf admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:28.991098 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c5f0d-ca4d-4c52-bb2d-17ec41afe38a None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:28.996799 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13987e-6f0e-4c68-bbf2-75c1ccb4146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:28.997489 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13987e-6f0e-4c68-bbf2-75c1ccb4146e admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:28.997770 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13987e-6f0e-4c68-bbf2-75c1ccb4146e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:28.998039 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13987e-6f0e-4c68-bbf2-75c1ccb4146e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:28.999439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 7/15] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:34:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:29.005093 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408e3b9-7cdc-4c3d-8c0d-7e9abb7c2eaf admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:29.007011 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13987e-6f0e-4c68-bbf2-75c1ccb4146e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:29.008883 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13987e-6f0e-4c68-bbf2-75c1ccb4146e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:29.014524 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408e3b9-7cdc-4c3d-8c0d-7e9abb7c2eaf admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:29.018063 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 9/16] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:34:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:34:29.019030 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f171b-60bb-40be-9e8a-0d7fd5d969bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:29.019932 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f171b-60bb-40be-9e8a-0d7fd5d969bb admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:29.020209 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f171b-60bb-40be-9e8a-0d7fd5d969bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:29.020472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f171b-60bb-40be-9e8a-0d7fd5d969bb admin admin] PATH_INFO: `/v3/users/ab9027ff8dfb4123b38f937a7e7a8597` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:29.022860 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f171b-60bb-40be-9e8a-0d7fd5d969bb admin admin] RBAC: Authorizing `identity:get_user(user_id=ab9027ff8dfb4123b38f937a7e7a8597)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:29.023560 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13987e-6f0e-4c68-bbf2-75c1ccb4146e admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:29.024688 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f171b-60bb-40be-9e8a-0d7fd5d969bb admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:29.026353 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 8/17] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:29 2022] GET /identity/v3/users/ab9027ff8dfb4123b38f937a7e7a8597 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:34:29.031558 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f171b-60bb-40be-9e8a-0d7fd5d969bb admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:29.032207 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13987e-6f0e-4c68-bbf2-75c1ccb4146e admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:29.037082 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd2468-fcc9-4657-82e6-c716d7531318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:29.037849 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd2468-fcc9-4657-82e6-c716d7531318 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:29.038132 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd2468-fcc9-4657-82e6-c716d7531318 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:29.038478 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd2468-fcc9-4657-82e6-c716d7531318 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:29.039765 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd2468-fcc9-4657-82e6-c716d7531318 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:29.040898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f171b-60bb-40be-9e8a-0d7fd5d969bb admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:29.041459 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd2468-fcc9-4657-82e6-c716d7531318 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:29.043228 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 10/18] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:34:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:34:29.045600 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6d2b3-69bb-41b2-97d4-3697d89712e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:29.046356 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6d2b3-69bb-41b2-97d4-3697d89712e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:29.046630 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6d2b3-69bb-41b2-97d4-3697d89712e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:29.046881 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6d2b3-69bb-41b2-97d4-3697d89712e2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:29.048233 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6d2b3-69bb-41b2-97d4-3697d89712e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:29.049951 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6d2b3-69bb-41b2-97d4-3697d89712e2 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:29.051636 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 9/19] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:34:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:34:29.058006 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd2468-fcc9-4657-82e6-c716d7531318 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:29.069214 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd2468-fcc9-4657-82e6-c716d7531318 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:29.075354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632cb34-9006-4577-8873-fdd7c01e993c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:29.076089 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632cb34-9006-4577-8873-fdd7c01e993c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:29.076369 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632cb34-9006-4577-8873-fdd7c01e993c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:29.076640 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632cb34-9006-4577-8873-fdd7c01e993c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:29.077512 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632cb34-9006-4577-8873-fdd7c01e993c admin admin] RBAC: Adding query filter params (role.id=9d097c033f454263a874fbafe92c9aea, scope.domain.id=default, user.id=ab9027ff8dfb4123b38f937a7e7a8597) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:29.077822 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632cb34-9006-4577-8873-fdd7c01e993c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:29.079717 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING py.warnings [None req-2632cb34-9006-4577-8873-fdd7c01e993c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:34:29.079717 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: warnings.warn(msg) Jan 10 12:34:29.079717 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: Jan 10 12:34:29.080893 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632cb34-9006-4577-8873-fdd7c01e993c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:29.088767 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 11/20] 10.222.0.13 () {56 vars in 1343 bytes} [Mon Jan 10 12:34:29 2022] GET /identity/v3/role_assignments?user.id=ab9027ff8dfb4123b38f937a7e7a8597&scope.domain.id=default&role.id=9d097c033f454263a874fbafe92c9aea => generated 233 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:32.087645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37415159-0f7e-4ee6-ac72-88725e49e5e0 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:32.087645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37415159-0f7e-4ee6-ac72-88725e49e5e0 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:32.087645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37415159-0f7e-4ee6-ac72-88725e49e5e0 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:32.089127 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:32.094624 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fea5c-34b9-4326-bf8f-be90e9e0b7e9 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:32.095436 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fea5c-34b9-4326-bf8f-be90e9e0b7e9 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:32.095926 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fea5c-34b9-4326-bf8f-be90e9e0b7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:32.117351 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-f50fea5c-34b9-4326-bf8f-be90e9e0b7e9 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:32.118857 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f50fea5c-34b9-4326-bf8f-be90e9e0b7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:32.130138 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 12/22] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:32.177573 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37415159-0f7e-4ee6-ac72-88725e49e5e0 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:32.191063 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37415159-0f7e-4ee6-ac72-88725e49e5e0 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:32.199646 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d4473-528d-490e-b621-038dc7ffcc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:32.200801 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d4473-528d-490e-b621-038dc7ffcc8b admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:32.201291 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d4473-528d-490e-b621-038dc7ffcc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:32.201758 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d4473-528d-490e-b621-038dc7ffcc8b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:32.217491 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d4473-528d-490e-b621-038dc7ffcc8b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:32.223546 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fc674-f6d4-4024-9da6-1f7bf55bdd8f None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:32.223546 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fc674-f6d4-4024-9da6-1f7bf55bdd8f None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:32.223546 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fc674-f6d4-4024-9da6-1f7bf55bdd8f None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:32.224668 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-b66d4473-528d-490e-b621-038dc7ffcc8b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:34:32.226833 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 11/24] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:34:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:32.227070 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:34:32.231531 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d4473-528d-490e-b621-038dc7ffcc8b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:32.235613 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde0f65-9f39-4b2f-83f7-68bc2ac2b4ef None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:32.236122 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde0f65-9f39-4b2f-83f7-68bc2ac2b4ef None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:32.236591 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde0f65-9f39-4b2f-83f7-68bc2ac2b4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:32.242197 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d4473-528d-490e-b621-038dc7ffcc8b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:32.247431 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88e38b-fc92-459b-8a89-650663648a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:32.251723 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88e38b-fc92-459b-8a89-650663648a9e admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:32.251723 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88e38b-fc92-459b-8a89-650663648a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:32.251723 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88e38b-fc92-459b-8a89-650663648a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:32.251723 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88e38b-fc92-459b-8a89-650663648a9e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:32.251723 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88e38b-fc92-459b-8a89-650663648a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:32.251723 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88e38b-fc92-459b-8a89-650663648a9e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:32.264492 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 12/25] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:34:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:32.264666 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-4dde0f65-9f39-4b2f-83f7-68bc2ac2b4ef None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:32.265456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-4dde0f65-9f39-4b2f-83f7-68bc2ac2b4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:32.267201 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88e38b-fc92-459b-8a89-650663648a9e admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:32.282423 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88e38b-fc92-459b-8a89-650663648a9e admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:32.286070 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 14/26] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:34:32.289235 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4037c56-abd7-4934-a6bd-915a7ad64ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:32.290110 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4037c56-abd7-4934-a6bd-915a7ad64ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:32.290387 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4037c56-abd7-4934-a6bd-915a7ad64ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:32.290654 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4037c56-abd7-4934-a6bd-915a7ad64ed9 admin admin] PATH_INFO: `/v3/users/ab9027ff8dfb4123b38f937a7e7a8597` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:32.291973 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4037c56-abd7-4934-a6bd-915a7ad64ed9 admin admin] RBAC: Authorizing `identity:get_user(user_id=ab9027ff8dfb4123b38f937a7e7a8597)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:32.293813 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4037c56-abd7-4934-a6bd-915a7ad64ed9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:32.295718 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 13/27] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:32 2022] GET /identity/v3/users/ab9027ff8dfb4123b38f937a7e7a8597 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:32.304546 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde0f65-9f39-4b2f-83f7-68bc2ac2b4ef None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:32.314428 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde0f65-9f39-4b2f-83f7-68bc2ac2b4ef None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:32.316401 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4037c56-abd7-4934-a6bd-915a7ad64ed9 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:32.335485 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4037c56-abd7-4934-a6bd-915a7ad64ed9 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:32.337470 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710182a-d171-4b1a-b547-f291c28382b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:32.338362 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710182a-d171-4b1a-b547-f291c28382b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:32.338655 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710182a-d171-4b1a-b547-f291c28382b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:32.338958 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710182a-d171-4b1a-b547-f291c28382b5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:32.340957 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710182a-d171-4b1a-b547-f291c28382b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:32.342703 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710182a-d171-4b1a-b547-f291c28382b5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:32.348607 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 15/28] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:34:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:32.356470 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710182a-d171-4b1a-b547-f291c28382b5 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:32.360742 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbb9d1-bead-408f-a51c-accd60914415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:32.361779 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbb9d1-bead-408f-a51c-accd60914415 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:32.362226 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbb9d1-bead-408f-a51c-accd60914415 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:32.362885 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbb9d1-bead-408f-a51c-accd60914415 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:32.373039 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710182a-d171-4b1a-b547-f291c28382b5 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:32.377511 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65142bb-c40a-4af7-8f51-2ff024c28027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:32.378456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65142bb-c40a-4af7-8f51-2ff024c28027 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:32.378792 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65142bb-c40a-4af7-8f51-2ff024c28027 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:32.379273 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65142bb-c40a-4af7-8f51-2ff024c28027 admin admin] PATH_INFO: `/v3/domains/default/users/ab9027ff8dfb4123b38f937a7e7a8597/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:32.381505 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65142bb-c40a-4af7-8f51-2ff024c28027 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ab9027ff8dfb4123b38f937a7e7a8597, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:32.387536 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING py.warnings [None req-b65142bb-c40a-4af7-8f51-2ff024c28027 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:34:32.387536 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: warnings.warn(msg) Jan 10 12:34:32.387536 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: Jan 10 12:34:32.390027 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65142bb-c40a-4af7-8f51-2ff024c28027 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:32.390962 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbb9d1-bead-408f-a51c-accd60914415 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:32.392942 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbb9d1-bead-408f-a51c-accd60914415 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:32.429379 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-22fbb9d1-bead-408f-a51c-accd60914415 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:34:32.430969 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 14/29] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:32.436809 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbb9d1-bead-408f-a51c-accd60914415 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:32.449767 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbb9d1-bead-408f-a51c-accd60914415 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:32.538875 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 16/30] 10.222.0.13 () {58 vars in 1382 bytes} [Mon Jan 10 12:34:32 2022] PUT /identity/v3/domains/default/users/ab9027ff8dfb4123b38f937a7e7a8597/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:34:32.541229 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60790b08-1f9c-41e4-9806-df45b343946d None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:32.541795 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60790b08-1f9c-41e4-9806-df45b343946d None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:32.542927 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60790b08-1f9c-41e4-9806-df45b343946d None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:32.548548 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 17/31] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:32.556234 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc53a38-a2b7-4e3c-9407-172d10c3cc52 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:32.556828 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc53a38-a2b7-4e3c-9407-172d10c3cc52 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:32.557287 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc53a38-a2b7-4e3c-9407-172d10c3cc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:32.595833 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-0fc53a38-a2b7-4e3c-9407-172d10c3cc52 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:32.596940 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6725e-eaaf-48c2-9f6d-41c09dbf0aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:32.597827 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6725e-eaaf-48c2-9f6d-41c09dbf0aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:32.598102 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-0fc53a38-a2b7-4e3c-9407-172d10c3cc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:32.598400 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6725e-eaaf-48c2-9f6d-41c09dbf0aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:32.598801 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6725e-eaaf-48c2-9f6d-41c09dbf0aa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:32.599766 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6725e-eaaf-48c2-9f6d-41c09dbf0aa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:32.600206 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6725e-eaaf-48c2-9f6d-41c09dbf0aa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:32.601386 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-5cd6725e-eaaf-48c2-9f6d-41c09dbf0aa8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:34:32.601386 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:34:32.601386 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:34:32.602646 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6725e-eaaf-48c2-9f6d-41c09dbf0aa8 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:32.613341 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 18/32] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:34:32.644285 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 15/33] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:34:32.649954 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc53a38-a2b7-4e3c-9407-172d10c3cc52 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:32.661141 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc53a38-a2b7-4e3c-9407-172d10c3cc52 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:32.666093 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d641be5-d108-40ac-abc2-d6844ee8e4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:32.667969 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d641be5-d108-40ac-abc2-d6844ee8e4fc admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:32.668476 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d641be5-d108-40ac-abc2-d6844ee8e4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:32.668942 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d641be5-d108-40ac-abc2-d6844ee8e4fc admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:32.669920 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d641be5-d108-40ac-abc2-d6844ee8e4fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:32.671457 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING py.warnings [None req-5d641be5-d108-40ac-abc2-d6844ee8e4fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:34:32.671457 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: warnings.warn(msg) Jan 10 12:34:32.671457 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: Jan 10 12:34:32.673072 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d641be5-d108-40ac-abc2-d6844ee8e4fc admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:32.674491 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6725e-eaaf-48c2-9f6d-41c09dbf0aa8 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:32.689183 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6725e-eaaf-48c2-9f6d-41c09dbf0aa8 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:32.701914 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91f732-cb98-4f30-894f-abfb1ff6c47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:32.703159 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f732-cb98-4f30-894f-abfb1ff6c47c admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:32.703683 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f732-cb98-4f30-894f-abfb1ff6c47c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:32.704141 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91f732-cb98-4f30-894f-abfb1ff6c47c admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:32.705159 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91f732-cb98-4f30-894f-abfb1ff6c47c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:32.708936 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-7a91f732-cb98-4f30-894f-abfb1ff6c47c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:34:32.708936 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:34:32.708936 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:34:32.710354 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91f732-cb98-4f30-894f-abfb1ff6c47c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:32.755507 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 19/34] 10.222.0.13 () {60 vars in 1162 bytes} [Mon Jan 10 12:34:32 2022] POST /identity/v3/projects => generated 301 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:34:32.761616 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e383bed-5ffc-4407-9c96-cba35e9be1cf None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:32.762300 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e383bed-5ffc-4407-9c96-cba35e9be1cf None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:32.765725 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e383bed-5ffc-4407-9c96-cba35e9be1cf None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:32.766586 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 20/35] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:32.771926 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47733c-6290-4fb5-b97e-1d7c8eb210f1 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:32.772212 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47733c-6290-4fb5-b97e-1d7c8eb210f1 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:32.772490 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47733c-6290-4fb5-b97e-1d7c8eb210f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:32.808619 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-6a47733c-6290-4fb5-b97e-1d7c8eb210f1 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:32.809873 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-6a47733c-6290-4fb5-b97e-1d7c8eb210f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:32.880536 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 16/36] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:34:32 2022] POST /identity/v3/roles => generated 225 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:34:32.903980 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 21/37] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:34:32.950399 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91f732-cb98-4f30-894f-abfb1ff6c47c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:32.963362 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91f732-cb98-4f30-894f-abfb1ff6c47c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:32.969463 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc648c-290e-44bb-b9af-9b09a4fe3a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:32.970540 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc648c-290e-44bb-b9af-9b09a4fe3a90 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:32.971007 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc648c-290e-44bb-b9af-9b09a4fe3a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:32.971545 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc648c-290e-44bb-b9af-9b09a4fe3a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:32.972515 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc648c-290e-44bb-b9af-9b09a4fe3a90 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:32.974639 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc648c-290e-44bb-b9af-9b09a4fe3a90 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:33.001451 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 17/38] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:34:32 2022] POST /identity/v3/roles => generated 219 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:34:33.629178 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846694c-56e9-4637-90a7-2a8fef263c15 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:33.629754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846694c-56e9-4637-90a7-2a8fef263c15 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:33.629754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846694c-56e9-4637-90a7-2a8fef263c15 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:33.631718 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 22/39] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:33.637238 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0197a7e-33a3-4047-9911-24be46bc5c15 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:33.637677 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0197a7e-33a3-4047-9911-24be46bc5c15 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:33.637841 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0197a7e-33a3-4047-9911-24be46bc5c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:33.654149 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG passlib.handlers.bcrypt [None req-a0197a7e-33a3-4047-9911-24be46bc5c15 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86080) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 10 12:34:33.654573 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG passlib.handlers.bcrypt [None req-a0197a7e-33a3-4047-9911-24be46bc5c15 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86080) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 10 12:34:33.701401 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-a0197a7e-33a3-4047-9911-24be46bc5c15 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:33.703012 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-a0197a7e-33a3-4047-9911-24be46bc5c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:33.727586 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 18/40] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:33.750430 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846694c-56e9-4637-90a7-2a8fef263c15 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:33.764608 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846694c-56e9-4637-90a7-2a8fef263c15 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:33.765438 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d155a-aac9-45d7-9c90-a03259c7b372 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:33.765898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d155a-aac9-45d7-9c90-a03259c7b372 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:33.766367 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d155a-aac9-45d7-9c90-a03259c7b372 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:33.768345 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 19/41] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:34:33.768834 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f38d5-4070-4d81-92bc-9e1ced1cc339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:33.769634 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f38d5-4070-4d81-92bc-9e1ced1cc339 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:33.769915 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f38d5-4070-4d81-92bc-9e1ced1cc339 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:33.770188 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f38d5-4070-4d81-92bc-9e1ced1cc339 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:33.771390 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f38d5-4070-4d81-92bc-9e1ced1cc339 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:33.773170 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f38d5-4070-4d81-92bc-9e1ced1cc339 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:33.773950 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f7f89-44a8-40c8-b464-c6cb25b16ff6 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:33.774398 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f7f89-44a8-40c8-b464-c6cb25b16ff6 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:33.774783 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 23/42] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:34:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:33.775045 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f7f89-44a8-40c8-b464-c6cb25b16ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:33.780337 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f38d5-4070-4d81-92bc-9e1ced1cc339 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:33.789632 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f38d5-4070-4d81-92bc-9e1ced1cc339 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:33.794135 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17b339-eac0-413f-9eb1-cbb8cb43e417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:33.794793 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17b339-eac0-413f-9eb1-cbb8cb43e417 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:33.795075 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17b339-eac0-413f-9eb1-cbb8cb43e417 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:33.795346 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17b339-eac0-413f-9eb1-cbb8cb43e417 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:33.796109 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17b339-eac0-413f-9eb1-cbb8cb43e417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:33.798023 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17b339-eac0-413f-9eb1-cbb8cb43e417 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:33.798574 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-066f7f89-44a8-40c8-b464-c6cb25b16ff6 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:33.799896 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-066f7f89-44a8-40c8-b464-c6cb25b16ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:33.808607 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 20/43] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:33.829512 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 24/44] 10.222.0.13 () {60 vars in 1162 bytes} [Mon Jan 10 12:34:33 2022] POST /identity/v3/projects => generated 312 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:34:33.835792 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f7f89-44a8-40c8-b464-c6cb25b16ff6 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:33.844476 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f7f89-44a8-40c8-b464-c6cb25b16ff6 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:33.906885 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88a7f9-311e-4f6f-9961-bad272b9c7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:33.907612 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88a7f9-311e-4f6f-9961-bad272b9c7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:33.907891 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88a7f9-311e-4f6f-9961-bad272b9c7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:33.908157 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88a7f9-311e-4f6f-9961-bad272b9c7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:33.908943 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88a7f9-311e-4f6f-9961-bad272b9c7d6 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:33.910655 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88a7f9-311e-4f6f-9961-bad272b9c7d6 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:33.926672 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 21/45] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:34:33 2022] POST /identity/v3/roles => generated 223 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:34:35.328859 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fa594-3c6f-4e79-946c-646039bb8d65 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:35.329416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fa594-3c6f-4e79-946c-646039bb8d65 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:35.329416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fa594-3c6f-4e79-946c-646039bb8d65 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:35.331273 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 25/46] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:35.336598 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdea16b-6227-43c9-822d-4de486429e6f None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:35.337015 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdea16b-6227-43c9-822d-4de486429e6f None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:35.337120 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdea16b-6227-43c9-822d-4de486429e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:35.356364 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-4fdea16b-6227-43c9-822d-4de486429e6f None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:35.357584 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-4fdea16b-6227-43c9-822d-4de486429e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:35.366871 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 22/47] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:35.392171 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623fa594-3c6f-4e79-946c-646039bb8d65 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:35.406261 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623fa594-3c6f-4e79-946c-646039bb8d65 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:35.411178 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c4531-3fd9-41ff-b761-941ae8d283a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:35.412004 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c4531-3fd9-41ff-b761-941ae8d283a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:35.412294 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c4531-3fd9-41ff-b761-941ae8d283a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:35.412571 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c4531-3fd9-41ff-b761-941ae8d283a9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:35.426036 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c4531-3fd9-41ff-b761-941ae8d283a9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:35.432843 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-e22c4531-3fd9-41ff-b761-941ae8d283a9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:34:35.434000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 26/48] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:34:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:35.439590 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdea16b-6227-43c9-822d-4de486429e6f None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:35.449692 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdea16b-6227-43c9-822d-4de486429e6f None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:35.454886 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18156d6b-bdde-4789-b1f4-41751dc44973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:35.455587 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18156d6b-bdde-4789-b1f4-41751dc44973 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:35.455870 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18156d6b-bdde-4789-b1f4-41751dc44973 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:35.456138 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18156d6b-bdde-4789-b1f4-41751dc44973 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:35.456915 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18156d6b-bdde-4789-b1f4-41751dc44973 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:35.457221 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18156d6b-bdde-4789-b1f4-41751dc44973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:35.458836 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18156d6b-bdde-4789-b1f4-41751dc44973 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:35.467667 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 23/49] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:34:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:35.473203 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c4531-3fd9-41ff-b761-941ae8d283a9 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:35.483363 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c4531-3fd9-41ff-b761-941ae8d283a9 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:35.488568 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614da55a-b5f1-4185-a493-9629a69f5b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:35.489422 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614da55a-b5f1-4185-a493-9629a69f5b45 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:35.489705 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614da55a-b5f1-4185-a493-9629a69f5b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:35.489976 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614da55a-b5f1-4185-a493-9629a69f5b45 admin admin] PATH_INFO: `/v3/users/ab9027ff8dfb4123b38f937a7e7a8597` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:35.491312 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614da55a-b5f1-4185-a493-9629a69f5b45 admin admin] RBAC: Authorizing `identity:get_user(user_id=ab9027ff8dfb4123b38f937a7e7a8597)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:35.493186 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614da55a-b5f1-4185-a493-9629a69f5b45 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:35.494975 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 27/50] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:35 2022] GET /identity/v3/users/ab9027ff8dfb4123b38f937a7e7a8597 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:35.500044 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18156d6b-bdde-4789-b1f4-41751dc44973 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:35.509751 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18156d6b-bdde-4789-b1f4-41751dc44973 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:35.515555 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b7e28-895d-4855-8a1c-34b54356461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:35.516350 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b7e28-895d-4855-8a1c-34b54356461d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:35.516655 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b7e28-895d-4855-8a1c-34b54356461d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:35.516926 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b7e28-895d-4855-8a1c-34b54356461d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:35.518517 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b7e28-895d-4855-8a1c-34b54356461d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:35.520266 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b7e28-895d-4855-8a1c-34b54356461d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:35.521840 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 24/51] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:34:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:35.527791 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614da55a-b5f1-4185-a493-9629a69f5b45 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:35.537903 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614da55a-b5f1-4185-a493-9629a69f5b45 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:35.544069 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16f3e9-dc4f-4596-8d2d-c297b4e1eeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:35.544712 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16f3e9-dc4f-4596-8d2d-c297b4e1eeb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:35.544987 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16f3e9-dc4f-4596-8d2d-c297b4e1eeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:35.545253 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16f3e9-dc4f-4596-8d2d-c297b4e1eeb7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:35.546091 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16f3e9-dc4f-4596-8d2d-c297b4e1eeb7 admin admin] RBAC: Adding query filter params (role.id=9d097c033f454263a874fbafe92c9aea, scope.domain.id=default, user.id=ab9027ff8dfb4123b38f937a7e7a8597) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:35.546397 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16f3e9-dc4f-4596-8d2d-c297b4e1eeb7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:35.548307 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16f3e9-dc4f-4596-8d2d-c297b4e1eeb7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:35.554570 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 28/52] 10.222.0.13 () {56 vars in 1343 bytes} [Mon Jan 10 12:34:35 2022] GET /identity/v3/role_assignments?user.id=ab9027ff8dfb4123b38f937a7e7a8597&scope.domain.id=default&role.id=9d097c033f454263a874fbafe92c9aea => generated 530 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:36.259605 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0154b-6a5f-4a37-aa83-96240f3a69d6 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:36.260109 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0154b-6a5f-4a37-aa83-96240f3a69d6 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:36.260625 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0154b-6a5f-4a37-aa83-96240f3a69d6 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:36.263766 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 25/53] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:36.269905 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134cd0e-d437-466c-92a3-0b592140fdac None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:36.270297 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134cd0e-d437-466c-92a3-0b592140fdac None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:36.270700 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134cd0e-d437-466c-92a3-0b592140fdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:36.292525 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-3134cd0e-d437-466c-92a3-0b592140fdac None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:36.293723 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-3134cd0e-d437-466c-92a3-0b592140fdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:36.302762 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 29/54] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:36.328723 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0154b-6a5f-4a37-aa83-96240f3a69d6 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:36.347371 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0154b-6a5f-4a37-aa83-96240f3a69d6 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:36.353453 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b7d46-cacb-49e8-a93f-e868d93a7f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:36.354310 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b7d46-cacb-49e8-a93f-e868d93a7f1a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:36.354675 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b7d46-cacb-49e8-a93f-e868d93a7f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:36.354949 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b7d46-cacb-49e8-a93f-e868d93a7f1a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:36.356326 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b7d46-cacb-49e8-a93f-e868d93a7f1a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:36.358054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b7d46-cacb-49e8-a93f-e868d93a7f1a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:36.359647 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 26/55] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:34:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:36.368244 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134cd0e-d437-466c-92a3-0b592140fdac None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:36.379167 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134cd0e-d437-466c-92a3-0b592140fdac None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:36.386473 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a205e2-9f71-4ac8-ab08-73627ec42687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:36.387506 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a205e2-9f71-4ac8-ab08-73627ec42687 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:36.387933 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a205e2-9f71-4ac8-ab08-73627ec42687 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:36.388299 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a205e2-9f71-4ac8-ab08-73627ec42687 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:36.389357 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a205e2-9f71-4ac8-ab08-73627ec42687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:36.392604 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a205e2-9f71-4ac8-ab08-73627ec42687 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:36.425288 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 30/56] 10.222.0.13 () {60 vars in 1161 bytes} [Mon Jan 10 12:34:36 2022] POST /identity/v3/projects => generated 298 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:34:38.815788 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87f94-4951-44ad-bbf3-f15123834f2f None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:38.816319 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87f94-4951-44ad-bbf3-f15123834f2f None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:38.816319 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87f94-4951-44ad-bbf3-f15123834f2f None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:38.818106 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 27/57] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:38.825972 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a9f01-054f-405c-aa55-20c1dc0f9fcd None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:38.826384 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a9f01-054f-405c-aa55-20c1dc0f9fcd None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:38.826513 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a9f01-054f-405c-aa55-20c1dc0f9fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:38.847240 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-b63a9f01-054f-405c-aa55-20c1dc0f9fcd None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:38.848480 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b63a9f01-054f-405c-aa55-20c1dc0f9fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:38.911469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 31/58] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:38.942813 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e87f94-4951-44ad-bbf3-f15123834f2f None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:38.959104 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e87f94-4951-44ad-bbf3-f15123834f2f None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:38.964564 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6210e5-d03c-4189-93c0-5457b625eb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:38.965353 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6210e5-d03c-4189-93c0-5457b625eb86 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:38.965641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6210e5-d03c-4189-93c0-5457b625eb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:38.965918 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6210e5-d03c-4189-93c0-5457b625eb86 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:38.967194 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6210e5-d03c-4189-93c0-5457b625eb86 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:38.968946 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6210e5-d03c-4189-93c0-5457b625eb86 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:38.970525 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 28/59] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:34:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:38.976019 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a9f01-054f-405c-aa55-20c1dc0f9fcd None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:38.988232 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a9f01-054f-405c-aa55-20c1dc0f9fcd None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:38.997425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f07ff-ecd2-47b7-9d14-ae120106c4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:38.998487 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f07ff-ecd2-47b7-9d14-ae120106c4b2 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:38.998930 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f07ff-ecd2-47b7-9d14-ae120106c4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:38.999382 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f07ff-ecd2-47b7-9d14-ae120106c4b2 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:39.000591 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f07ff-ecd2-47b7-9d14-ae120106c4b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:39.002242 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING py.warnings [None req-640f07ff-ecd2-47b7-9d14-ae120106c4b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:34:39.002242 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: warnings.warn(msg) Jan 10 12:34:39.002242 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: Jan 10 12:34:39.004218 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f07ff-ecd2-47b7-9d14-ae120106c4b2 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:39.039080 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 32/60] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Jan 10 12:34:38 2022] POST /identity/v3/users => generated 275 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:34:42.575285 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe854a-b441-4763-aa60-899da037e9e0 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:42.576477 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe854a-b441-4763-aa60-899da037e9e0 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:42.577009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe854a-b441-4763-aa60-899da037e9e0 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:42.579296 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 29/61] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:42.584616 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1639f-0b20-46c3-8e16-4432df3e7e56 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:42.585469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1639f-0b20-46c3-8e16-4432df3e7e56 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:42.585949 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1639f-0b20-46c3-8e16-4432df3e7e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:42.612521 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-a0a1639f-0b20-46c3-8e16-4432df3e7e56 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:42.614115 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-a0a1639f-0b20-46c3-8e16-4432df3e7e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:42.622231 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 33/62] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:42.647176 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe854a-b441-4763-aa60-899da037e9e0 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:42.665415 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe854a-b441-4763-aa60-899da037e9e0 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:42.676116 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489cb09-8e9e-40c5-979b-583d1ae498e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:42.677204 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489cb09-8e9e-40c5-979b-583d1ae498e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:42.677693 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489cb09-8e9e-40c5-979b-583d1ae498e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:42.678190 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489cb09-8e9e-40c5-979b-583d1ae498e4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:42.692360 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489cb09-8e9e-40c5-979b-583d1ae498e4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:42.699807 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-d489cb09-8e9e-40c5-979b-583d1ae498e4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 12:34:42.701603 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 30/63] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:34:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:42.707050 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1639f-0b20-46c3-8e16-4432df3e7e56 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:42.716935 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1639f-0b20-46c3-8e16-4432df3e7e56 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:42.734000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b13d20-2b7b-443c-abd1-cd67e1094a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:42.734975 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b13d20-2b7b-443c-abd1-cd67e1094a68 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:42.735502 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b13d20-2b7b-443c-abd1-cd67e1094a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:42.736022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b13d20-2b7b-443c-abd1-cd67e1094a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:42.737033 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b13d20-2b7b-443c-abd1-cd67e1094a68 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:42.737552 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b13d20-2b7b-443c-abd1-cd67e1094a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:42.748334 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING py.warnings [None req-c4b13d20-2b7b-443c-abd1-cd67e1094a68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:34:42.748334 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: warnings.warn(msg) Jan 10 12:34:42.748334 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: Jan 10 12:34:42.749822 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b13d20-2b7b-443c-abd1-cd67e1094a68 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:42.768217 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 34/64] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:34:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:42.773799 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489cb09-8e9e-40c5-979b-583d1ae498e4 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:42.788651 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489cb09-8e9e-40c5-979b-583d1ae498e4 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:42.797065 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da55c78-1920-47f6-988a-8de3536b562a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:42.798276 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da55c78-1920-47f6-988a-8de3536b562a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:42.798760 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da55c78-1920-47f6-988a-8de3536b562a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:42.799231 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da55c78-1920-47f6-988a-8de3536b562a admin admin] PATH_INFO: `/v3/users/1c24ae2fcabe4449a7beebce995730e4` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:42.825481 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9d2e3-7793-4734-a05f-968a4a202a88 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:42.826089 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9d2e3-7793-4734-a05f-968a4a202a88 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:42.826576 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9d2e3-7793-4734-a05f-968a4a202a88 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:42.828702 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 35/65] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:34:42.829856 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da55c78-1920-47f6-988a-8de3536b562a admin admin] RBAC: Authorizing `identity:get_user(user_id=1c24ae2fcabe4449a7beebce995730e4)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:42.832352 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da55c78-1920-47f6-988a-8de3536b562a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:42.834300 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42974b2b-0b8f-4443-af6a-0f54b3d5eedc None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:42.834720 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 31/66] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:42 2022] GET /identity/v3/users/1c24ae2fcabe4449a7beebce995730e4 => generated 275 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:42.835089 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42974b2b-0b8f-4443-af6a-0f54b3d5eedc None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:42.835686 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42974b2b-0b8f-4443-af6a-0f54b3d5eedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:42.840243 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da55c78-1920-47f6-988a-8de3536b562a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:42.852899 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da55c78-1920-47f6-988a-8de3536b562a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:42.860448 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-42974b2b-0b8f-4443-af6a-0f54b3d5eedc None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:42.862042 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-42974b2b-0b8f-4443-af6a-0f54b3d5eedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:42.864427 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d51e05-d932-4a42-88a6-d5cb0f9058c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:42.865133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d51e05-d932-4a42-88a6-d5cb0f9058c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:42.865489 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d51e05-d932-4a42-88a6-d5cb0f9058c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:42.865777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d51e05-d932-4a42-88a6-d5cb0f9058c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:42.872162 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 36/67] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:42.873866 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bb7c0-b5e6-4a55-bdf0-a0d128dd3d59 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:42.874332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bb7c0-b5e6-4a55-bdf0-a0d128dd3d59 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:42.874788 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bb7c0-b5e6-4a55-bdf0-a0d128dd3d59 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:42.876007 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d51e05-d932-4a42-88a6-d5cb0f9058c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:42.877287 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 37/68] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:42.877802 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d51e05-d932-4a42-88a6-d5cb0f9058c5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:42.884954 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f5913-d6df-4930-9694-d31a4c0c79ee None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:42.885487 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f5913-d6df-4930-9694-d31a4c0c79ee None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:42.886055 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f5913-d6df-4930-9694-d31a4c0c79ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:42.886992 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 32/69] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:34:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:34:42.892429 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d51e05-d932-4a42-88a6-d5cb0f9058c5 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:42.901887 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d51e05-d932-4a42-88a6-d5cb0f9058c5 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:42.912990 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e4199-7abd-4318-8626-b7bc4f24d4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:42.914328 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e4199-7abd-4318-8626-b7bc4f24d4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:42.914854 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e4199-7abd-4318-8626-b7bc4f24d4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:42.915311 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e4199-7abd-4318-8626-b7bc4f24d4e4 admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:42.916826 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-aa0f5913-d6df-4930-9694-d31a4c0c79ee None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:42.917271 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e4199-7abd-4318-8626-b7bc4f24d4e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:42.918334 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-aa0f5913-d6df-4930-9694-d31a4c0c79ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:42.919945 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e4199-7abd-4318-8626-b7bc4f24d4e4 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:42.922469 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 33/70] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:42 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:42.927428 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e4199-7abd-4318-8626-b7bc4f24d4e4 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:42.929103 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 38/71] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:34:42.929818 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f5913-d6df-4930-9694-d31a4c0c79ee None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:42.937359 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e4199-7abd-4318-8626-b7bc4f24d4e4 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:42.944761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f5913-d6df-4930-9694-d31a4c0c79ee None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:42.949458 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898cfc2-56ce-481e-ba92-3cfa7f453f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:42.950113 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898cfc2-56ce-481e-ba92-3cfa7f453f86 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:42.950392 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898cfc2-56ce-481e-ba92-3cfa7f453f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:42.950661 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898cfc2-56ce-481e-ba92-3cfa7f453f86 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:42.951527 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898cfc2-56ce-481e-ba92-3cfa7f453f86 admin admin] RBAC: Adding query filter params (role.id=e4d526676145442ab5838d824be7bf59, scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e, user.id=1c24ae2fcabe4449a7beebce995730e4) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:42.951840 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898cfc2-56ce-481e-ba92-3cfa7f453f86 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:42.953723 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898cfc2-56ce-481e-ba92-3cfa7f453f86 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:42.956737 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cfe9c-ec01-4e44-9370-4edaf8fb7304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:42.957565 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cfe9c-ec01-4e44-9370-4edaf8fb7304 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:42.957844 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cfe9c-ec01-4e44-9370-4edaf8fb7304 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:42.958113 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cfe9c-ec01-4e44-9370-4edaf8fb7304 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:42.960070 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 39/72] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:34:42 2022] GET /identity/v3/role_assignments?user.id=1c24ae2fcabe4449a7beebce995730e4&scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e&role.id=e4d526676145442ab5838d824be7bf59 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:42.964968 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898cfc2-56ce-481e-ba92-3cfa7f453f86 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:42.975290 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898cfc2-56ce-481e-ba92-3cfa7f453f86 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:42.980446 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d09258-645c-46dd-9617-d9ee3bb414fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:42.981277 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d09258-645c-46dd-9617-d9ee3bb414fa admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:42.981553 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d09258-645c-46dd-9617-d9ee3bb414fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:42.981822 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d09258-645c-46dd-9617-d9ee3bb414fa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:42.985749 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cfe9c-ec01-4e44-9370-4edaf8fb7304 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:42.993992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d09258-645c-46dd-9617-d9ee3bb414fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:43.001250 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-b8d09258-645c-46dd-9617-d9ee3bb414fa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:34:43.002868 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 40/73] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:34:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:43.005441 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-3e5cfe9c-ec01-4e44-9370-4edaf8fb7304 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 12:34:43.007066 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 34/74] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:34:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:43.013187 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d09258-645c-46dd-9617-d9ee3bb414fa admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:43.013851 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cfe9c-ec01-4e44-9370-4edaf8fb7304 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:43.025149 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cfe9c-ec01-4e44-9370-4edaf8fb7304 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:43.026712 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d09258-645c-46dd-9617-d9ee3bb414fa admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:43.036557 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439386f-5aaf-4883-aa4d-474d8b235233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:43.038526 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439386f-5aaf-4883-aa4d-474d8b235233 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.039545 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439386f-5aaf-4883-aa4d-474d8b235233 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.040068 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2a304-e8a0-468f-b39a-f80b39a216b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:43.041158 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2a304-e8a0-468f-b39a-f80b39a216b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.041539 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439386f-5aaf-4883-aa4d-474d8b235233 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.042623 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439386f-5aaf-4883-aa4d-474d8b235233 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:43.043164 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2a304-e8a0-468f-b39a-f80b39a216b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.043689 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2a304-e8a0-468f-b39a-f80b39a216b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.044229 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439386f-5aaf-4883-aa4d-474d8b235233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:43.045248 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2a304-e8a0-468f-b39a-f80b39a216b1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:43.047176 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439386f-5aaf-4883-aa4d-474d8b235233 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:43.047733 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2a304-e8a0-468f-b39a-f80b39a216b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:43.049581 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2a304-e8a0-468f-b39a-f80b39a216b1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:43.065930 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 35/75] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:34:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:34:43.072144 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439386f-5aaf-4883-aa4d-474d8b235233 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:43.073786 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 41/76] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:34:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:43.079236 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2a304-e8a0-468f-b39a-f80b39a216b1 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:43.092576 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439386f-5aaf-4883-aa4d-474d8b235233 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:43.094482 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2a304-e8a0-468f-b39a-f80b39a216b1 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:43.102592 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690eff8-39de-4b39-abc6-d220d0066d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:43.104840 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690eff8-39de-4b39-abc6-d220d0066d5e admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.105679 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fe8f2-6145-4ff1-a706-9f3ade44fd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:43.106222 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690eff8-39de-4b39-abc6-d220d0066d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.107361 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fe8f2-6145-4ff1-a706-9f3ade44fd51 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.107880 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690eff8-39de-4b39-abc6-d220d0066d5e admin admin] PATH_INFO: `/v3/users/1c24ae2fcabe4449a7beebce995730e4` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.109084 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fe8f2-6145-4ff1-a706-9f3ade44fd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.110012 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690eff8-39de-4b39-abc6-d220d0066d5e admin admin] RBAC: Authorizing `identity:get_user(user_id=1c24ae2fcabe4449a7beebce995730e4)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:43.110522 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fe8f2-6145-4ff1-a706-9f3ade44fd51 admin admin] PATH_INFO: `/v3/users/ab9027ff8dfb4123b38f937a7e7a8597` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.113756 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690eff8-39de-4b39-abc6-d220d0066d5e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:43.114857 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fe8f2-6145-4ff1-a706-9f3ade44fd51 admin admin] RBAC: Authorizing `identity:get_user(user_id=ab9027ff8dfb4123b38f937a7e7a8597)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:43.116978 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fe8f2-6145-4ff1-a706-9f3ade44fd51 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:43.119141 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 36/77] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:43 2022] GET /identity/v3/users/1c24ae2fcabe4449a7beebce995730e4 => generated 275 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:43.121328 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 42/78] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:43 2022] GET /identity/v3/users/ab9027ff8dfb4123b38f937a7e7a8597 => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:34:43.125963 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690eff8-39de-4b39-abc6-d220d0066d5e admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:43.130852 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fe8f2-6145-4ff1-a706-9f3ade44fd51 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:43.145276 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690eff8-39de-4b39-abc6-d220d0066d5e admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:43.153873 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fe8f2-6145-4ff1-a706-9f3ade44fd51 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:43.156820 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb37e4-0a7c-4398-919c-9d8e12e2d33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:43.157696 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb37e4-0a7c-4398-919c-9d8e12e2d33c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.158116 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb37e4-0a7c-4398-919c-9d8e12e2d33c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.158523 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb37e4-0a7c-4398-919c-9d8e12e2d33c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.169324 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9fec8-ec47-42a0-9fb0-5a9d6038e5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:43.172146 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9fec8-ec47-42a0-9fb0-5a9d6038e5fe admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.172614 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9fec8-ec47-42a0-9fb0-5a9d6038e5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.174271 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9fec8-ec47-42a0-9fb0-5a9d6038e5fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.176179 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb37e4-0a7c-4398-919c-9d8e12e2d33c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:43.178544 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb37e4-0a7c-4398-919c-9d8e12e2d33c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:43.186802 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9fec8-ec47-42a0-9fb0-5a9d6038e5fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:43.188859 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9fec8-ec47-42a0-9fb0-5a9d6038e5fe admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:43.200693 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 43/79] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:34:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:34:43.207790 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 37/80] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:34:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:34:43.210320 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9fec8-ec47-42a0-9fb0-5a9d6038e5fe admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:43.223451 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9fec8-ec47-42a0-9fb0-5a9d6038e5fe admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:43.227624 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb37e4-0a7c-4398-919c-9d8e12e2d33c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:43.235187 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb37e4-0a7c-4398-919c-9d8e12e2d33c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:43.238126 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5d8e8-6f33-43d6-bae9-d3284eaaca95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:43.239210 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5d8e8-6f33-43d6-bae9-d3284eaaca95 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.239668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5d8e8-6f33-43d6-bae9-d3284eaaca95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.240077 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5d8e8-6f33-43d6-bae9-d3284eaaca95 admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.241439 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5d8e8-6f33-43d6-bae9-d3284eaaca95 admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:43.243688 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5d8e8-6f33-43d6-bae9-d3284eaaca95 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:43.248403 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 44/81] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:43 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:43.254303 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5d8e8-6f33-43d6-bae9-d3284eaaca95 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:43.254946 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d1862-f718-4471-95a0-4682d89a373c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:43.255854 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d1862-f718-4471-95a0-4682d89a373c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.256131 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d1862-f718-4471-95a0-4682d89a373c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.256400 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d1862-f718-4471-95a0-4682d89a373c admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.258667 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d1862-f718-4471-95a0-4682d89a373c admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:43.260887 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d1862-f718-4471-95a0-4682d89a373c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:43.263712 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 38/82] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:43 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:43.265752 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5d8e8-6f33-43d6-bae9-d3284eaaca95 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:43.270411 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd35274-367c-4704-981b-46a34103a64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:43.270548 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d1862-f718-4471-95a0-4682d89a373c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:43.271423 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd35274-367c-4704-981b-46a34103a64a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.271860 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd35274-367c-4704-981b-46a34103a64a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.272282 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd35274-367c-4704-981b-46a34103a64a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.273137 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd35274-367c-4704-981b-46a34103a64a admin admin] RBAC: Adding query filter params (role.id=9d097c033f454263a874fbafe92c9aea, scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e, user.id=ab9027ff8dfb4123b38f937a7e7a8597) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:43.273447 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd35274-367c-4704-981b-46a34103a64a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:43.275354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd35274-367c-4704-981b-46a34103a64a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:43.282397 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d1862-f718-4471-95a0-4682d89a373c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:43.283175 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 45/83] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:34:43 2022] GET /identity/v3/role_assignments?user.id=ab9027ff8dfb4123b38f937a7e7a8597&scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e&role.id=9d097c033f454263a874fbafe92c9aea => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:34:43.284831 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4a670-fa2e-4773-a9a9-4ca3062004ab None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.285121 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4a670-fa2e-4773-a9a9-4ca3062004ab None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.285483 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4a670-fa2e-4773-a9a9-4ca3062004ab None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.287006 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334174f-13c5-4402-a6b5-3fa78955e2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:43.287564 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 46/84] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:43.287683 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334174f-13c5-4402-a6b5-3fa78955e2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.287957 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334174f-13c5-4402-a6b5-3fa78955e2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.288225 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334174f-13c5-4402-a6b5-3fa78955e2f9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.289080 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334174f-13c5-4402-a6b5-3fa78955e2f9 admin admin] RBAC: Adding query filter params (role.id=6d59759e4d584ea688a6c0883ef5d9c6, scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e, user.id=1c24ae2fcabe4449a7beebce995730e4) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:43.289387 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334174f-13c5-4402-a6b5-3fa78955e2f9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:43.290426 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-f334174f-13c5-4402-a6b5-3fa78955e2f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:34:43.290426 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:34:43.290426 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:34:43.291945 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334174f-13c5-4402-a6b5-3fa78955e2f9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:43.293409 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1ce7d-9479-4bcb-8675-514ee28f3a6e None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.293827 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1ce7d-9479-4bcb-8675-514ee28f3a6e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.294224 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1ce7d-9479-4bcb-8675-514ee28f3a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.300968 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 39/85] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:34:43 2022] GET /identity/v3/role_assignments?user.id=1c24ae2fcabe4449a7beebce995730e4&scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e&role.id=6d59759e4d584ea688a6c0883ef5d9c6 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:43.312865 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93b8c4-e571-4657-9b67-bfcdce971c08 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.313176 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93b8c4-e571-4657-9b67-bfcdce971c08 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.313419 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93b8c4-e571-4657-9b67-bfcdce971c08 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.314700 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-f5c1ce7d-9479-4bcb-8675-514ee28f3a6e None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:43.315649 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 40/86] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:34:43.316344 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f5c1ce7d-9479-4bcb-8675-514ee28f3a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:43.321611 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4441f9-ec6d-44f9-af47-071c0454c69b None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.321935 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4441f9-ec6d-44f9-af47-071c0454c69b None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.322164 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4441f9-ec6d-44f9-af47-071c0454c69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.324976 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 47/87] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:34:43.358605 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-da4441f9-ec6d-44f9-af47-071c0454c69b None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:43.359876 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-da4441f9-ec6d-44f9-af47-071c0454c69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:43.369430 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 41/88] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:34:43.385447 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1ce7d-9479-4bcb-8675-514ee28f3a6e None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:43.395046 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4441f9-ec6d-44f9-af47-071c0454c69b None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:43.395615 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1ce7d-9479-4bcb-8675-514ee28f3a6e None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:43.400800 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c6238-886b-478d-8d68-e1675369874b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:43.401846 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c6238-886b-478d-8d68-e1675369874b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.402147 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c6238-886b-478d-8d68-e1675369874b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.402492 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c6238-886b-478d-8d68-e1675369874b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.403916 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c6238-886b-478d-8d68-e1675369874b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:43.405876 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c6238-886b-478d-8d68-e1675369874b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:43.407820 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 48/89] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:34:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:43.414630 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c6238-886b-478d-8d68-e1675369874b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:43.421984 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4441f9-ec6d-44f9-af47-071c0454c69b None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:43.426176 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c6238-886b-478d-8d68-e1675369874b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:43.431432 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075b159-6d57-4951-902d-2508977114e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:43.432300 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075b159-6d57-4951-902d-2508977114e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.432762 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075b159-6d57-4951-902d-2508977114e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.433042 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075b159-6d57-4951-902d-2508977114e5 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.433334 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbd23d-9ae0-43a6-8bb3-4a9f79bf3c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:43.433795 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075b159-6d57-4951-902d-2508977114e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:43.434161 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbd23d-9ae0-43a6-8bb3-4a9f79bf3c85 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.434443 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbd23d-9ae0-43a6-8bb3-4a9f79bf3c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.434715 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbd23d-9ae0-43a6-8bb3-4a9f79bf3c85 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.435953 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075b159-6d57-4951-902d-2508977114e5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:43.468323 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbd23d-9ae0-43a6-8bb3-4a9f79bf3c85 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:43.470064 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 49/90] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Jan 10 12:34:43 2022] POST /identity/v3/users => generated 289 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:34:43.476245 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-aafbd23d-9ae0-43a6-8bb3-4a9f79bf3c85 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 12:34:43.482049 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 42/91] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:34:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:43.485009 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075b159-6d57-4951-902d-2508977114e5 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:43.497504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075b159-6d57-4951-902d-2508977114e5 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:43.508207 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a93a6a-e8fe-478c-bdd9-f25f223335df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:43.508936 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a93a6a-e8fe-478c-bdd9-f25f223335df admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.509224 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a93a6a-e8fe-478c-bdd9-f25f223335df admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.509557 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a93a6a-e8fe-478c-bdd9-f25f223335df admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.510455 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a93a6a-e8fe-478c-bdd9-f25f223335df admin admin] RBAC: Adding query filter params (name=member) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:43.510878 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a93a6a-e8fe-478c-bdd9-f25f223335df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:43.512799 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a93a6a-e8fe-478c-bdd9-f25f223335df admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:43.532028 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 50/92] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:34:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:43.538195 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbd23d-9ae0-43a6-8bb3-4a9f79bf3c85 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:43.549615 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbd23d-9ae0-43a6-8bb3-4a9f79bf3c85 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:43.560600 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280e36a-928b-45a2-a6a9-09d70d087f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:43.561568 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280e36a-928b-45a2-a6a9-09d70d087f2c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.561859 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280e36a-928b-45a2-a6a9-09d70d087f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.562134 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280e36a-928b-45a2-a6a9-09d70d087f2c admin admin] PATH_INFO: `/v3/users/1c24ae2fcabe4449a7beebce995730e4` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.563667 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280e36a-928b-45a2-a6a9-09d70d087f2c admin admin] RBAC: Authorizing `identity:get_user(user_id=1c24ae2fcabe4449a7beebce995730e4)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:43.566463 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280e36a-928b-45a2-a6a9-09d70d087f2c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:43.568884 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 43/93] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:43 2022] GET /identity/v3/users/1c24ae2fcabe4449a7beebce995730e4 => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:43.574843 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a93a6a-e8fe-478c-bdd9-f25f223335df admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:43.586165 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a93a6a-e8fe-478c-bdd9-f25f223335df admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:43.591480 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb127b-78f6-4714-84bf-3e77e48eb0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:43.592239 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb127b-78f6-4714-84bf-3e77e48eb0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.592524 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb127b-78f6-4714-84bf-3e77e48eb0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.592855 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb127b-78f6-4714-84bf-3e77e48eb0c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.602595 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb127b-78f6-4714-84bf-3e77e48eb0c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:43.604725 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb127b-78f6-4714-84bf-3e77e48eb0c9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:43.615149 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 51/94] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:34:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:34:43.621377 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280e36a-928b-45a2-a6a9-09d70d087f2c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:43.635417 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280e36a-928b-45a2-a6a9-09d70d087f2c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:43.640503 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73093ef0-dda6-42c4-8acf-c53aecec7a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:43.641397 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73093ef0-dda6-42c4-8acf-c53aecec7a3f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.641678 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73093ef0-dda6-42c4-8acf-c53aecec7a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.641951 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73093ef0-dda6-42c4-8acf-c53aecec7a3f admin admin] PATH_INFO: `/v3/projects/733c9dea52dc4c2a950a33e232d4f516` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.643257 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73093ef0-dda6-42c4-8acf-c53aecec7a3f admin admin] RBAC: Authorizing `identity:get_project(project_id=733c9dea52dc4c2a950a33e232d4f516)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:43.645413 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73093ef0-dda6-42c4-8acf-c53aecec7a3f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:43.647202 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 44/95] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:43 2022] GET /identity/v3/projects/733c9dea52dc4c2a950a33e232d4f516 => generated 312 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:34:43.653652 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb127b-78f6-4714-84bf-3e77e48eb0c9 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:43.662992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb127b-78f6-4714-84bf-3e77e48eb0c9 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:43.667691 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50dd507-e1f9-4e2d-847b-10c4593d0589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:43.668492 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dd507-e1f9-4e2d-847b-10c4593d0589 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:43.668779 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dd507-e1f9-4e2d-847b-10c4593d0589 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:43.669058 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dd507-e1f9-4e2d-847b-10c4593d0589 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:43.669936 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50dd507-e1f9-4e2d-847b-10c4593d0589 admin admin] RBAC: Adding query filter params (role.id=e4d526676145442ab5838d824be7bf59, scope.project.id=733c9dea52dc4c2a950a33e232d4f516, user.id=1c24ae2fcabe4449a7beebce995730e4) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:43.670244 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50dd507-e1f9-4e2d-847b-10c4593d0589 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:43.672218 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50dd507-e1f9-4e2d-847b-10c4593d0589 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:43.678660 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 52/96] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:34:43 2022] GET /identity/v3/role_assignments?user.id=1c24ae2fcabe4449a7beebce995730e4&scope.project.id=733c9dea52dc4c2a950a33e232d4f516&role.id=e4d526676145442ab5838d824be7bf59 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:34:45.927529 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b8cd5-739a-4059-8d5a-606ac4b4d2e1 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:45.928253 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b8cd5-739a-4059-8d5a-606ac4b4d2e1 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:45.928253 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b8cd5-739a-4059-8d5a-606ac4b4d2e1 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:45.930205 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 45/97] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:34:45.937011 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225170ed-d885-4afe-b12c-09af6810cc41 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:45.937659 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225170ed-d885-4afe-b12c-09af6810cc41 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:45.937808 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225170ed-d885-4afe-b12c-09af6810cc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:45.964642 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-225170ed-d885-4afe-b12c-09af6810cc41 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:45.965864 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-225170ed-d885-4afe-b12c-09af6810cc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:45.973742 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 53/98] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:34:46.011153 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b8cd5-739a-4059-8d5a-606ac4b4d2e1 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:46.029244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b8cd5-739a-4059-8d5a-606ac4b4d2e1 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:46.033760 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fdbd6-bb26-4cda-a577-40ca6033b6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:46.034586 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fdbd6-bb26-4cda-a577-40ca6033b6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:46.034863 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fdbd6-bb26-4cda-a577-40ca6033b6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:46.035132 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fdbd6-bb26-4cda-a577-40ca6033b6a8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:46.056674 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518fdbd6-bb26-4cda-a577-40ca6033b6a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:46.063982 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-518fdbd6-bb26-4cda-a577-40ca6033b6a8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 12:34:46.065639 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 46/99] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:34:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:46.071787 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225170ed-d885-4afe-b12c-09af6810cc41 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:46.084619 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225170ed-d885-4afe-b12c-09af6810cc41 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:46.102279 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3ac54-b334-47c1-97b1-45c172e33615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:46.102279 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3ac54-b334-47c1-97b1-45c172e33615 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:46.102279 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3ac54-b334-47c1-97b1-45c172e33615 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:46.102279 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3ac54-b334-47c1-97b1-45c172e33615 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:46.103033 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3ac54-b334-47c1-97b1-45c172e33615 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:46.103033 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3ac54-b334-47c1-97b1-45c172e33615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:46.103033 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3ac54-b334-47c1-97b1-45c172e33615 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:46.113152 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 54/100] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:34:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:46.119118 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fdbd6-bb26-4cda-a577-40ca6033b6a8 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:46.132720 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fdbd6-bb26-4cda-a577-40ca6033b6a8 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:46.143624 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3212ef3-66e3-44c8-86c2-a789ee0ea181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:46.144546 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3212ef3-66e3-44c8-86c2-a789ee0ea181 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:46.144823 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3212ef3-66e3-44c8-86c2-a789ee0ea181 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:46.145094 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3212ef3-66e3-44c8-86c2-a789ee0ea181 admin admin] PATH_INFO: `/v3/users/1c24ae2fcabe4449a7beebce995730e4` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:46.152754 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3212ef3-66e3-44c8-86c2-a789ee0ea181 admin admin] RBAC: Authorizing `identity:get_user(user_id=1c24ae2fcabe4449a7beebce995730e4)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:46.154954 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3212ef3-66e3-44c8-86c2-a789ee0ea181 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:46.156711 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 47/101] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:46 2022] GET /identity/v3/users/1c24ae2fcabe4449a7beebce995730e4 => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:46.162299 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3ac54-b334-47c1-97b1-45c172e33615 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:46.170739 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ff63f-9380-4c8f-b7e0-369a3cec933d None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:46.171016 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ff63f-9380-4c8f-b7e0-369a3cec933d None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:46.171292 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ff63f-9380-4c8f-b7e0-369a3cec933d None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:46.173091 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 48/102] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:34:46.173691 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3ac54-b334-47c1-97b1-45c172e33615 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:46.179711 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bf19c-9225-4c45-ae5c-57f85e3e7ba7 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:46.180002 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bf19c-9225-4c45-ae5c-57f85e3e7ba7 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:46.180281 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997bf19c-9225-4c45-ae5c-57f85e3e7ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:46.185257 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25109d-24e9-4a0f-bf67-7a0cc4125e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:46.186122 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25109d-24e9-4a0f-bf67-7a0cc4125e4e admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:46.186398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25109d-24e9-4a0f-bf67-7a0cc4125e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:46.187989 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25109d-24e9-4a0f-bf67-7a0cc4125e4e admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:46.191024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25109d-24e9-4a0f-bf67-7a0cc4125e4e admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:46.193135 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25109d-24e9-4a0f-bf67-7a0cc4125e4e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:46.194837 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 55/103] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:46 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:46.200659 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25109d-24e9-4a0f-bf67-7a0cc4125e4e admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:46.211924 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25109d-24e9-4a0f-bf67-7a0cc4125e4e admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:46.213807 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-997bf19c-9225-4c45-ae5c-57f85e3e7ba7 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:46.216114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-997bf19c-9225-4c45-ae5c-57f85e3e7ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:46.222490 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefde9bf-a89a-4e2d-a387-6589ec770052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:46.223662 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefde9bf-a89a-4e2d-a387-6589ec770052 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:46.224164 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefde9bf-a89a-4e2d-a387-6589ec770052 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:46.224753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefde9bf-a89a-4e2d-a387-6589ec770052 admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e/users/1c24ae2fcabe4449a7beebce995730e4/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:46.228413 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefde9bf-a89a-4e2d-a387-6589ec770052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a2db78a87c4bd69fde46b3f80e8b5e, user_id=1c24ae2fcabe4449a7beebce995730e4, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:46.231607 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefde9bf-a89a-4e2d-a387-6589ec770052 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:46.236171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 49/104] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:34:46.257453 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 56/105] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:34:46 2022] PUT /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e/users/1c24ae2fcabe4449a7beebce995730e4/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:34:46.295119 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bf19c-9225-4c45-ae5c-57f85e3e7ba7 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:46.304817 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997bf19c-9225-4c45-ae5c-57f85e3e7ba7 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:46.381527 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b21f6-fe32-485a-b57f-4ab7c5fe515c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:46.382734 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b21f6-fe32-485a-b57f-4ab7c5fe515c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:46.383225 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b21f6-fe32-485a-b57f-4ab7c5fe515c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:46.383736 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b21f6-fe32-485a-b57f-4ab7c5fe515c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:46.398289 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b21f6-fe32-485a-b57f-4ab7c5fe515c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:46.405554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-d69b21f6-fe32-485a-b57f-4ab7c5fe515c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:34:46.407005 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 50/106] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:34:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:46.413180 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefde9bf-a89a-4e2d-a387-6589ec770052 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:46.423890 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefde9bf-a89a-4e2d-a387-6589ec770052 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:46.431770 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaf987-a9cf-44ae-b344-cf5454b4a478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:46.432813 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaf987-a9cf-44ae-b344-cf5454b4a478 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:46.433301 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaf987-a9cf-44ae-b344-cf5454b4a478 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:46.433772 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaf987-a9cf-44ae-b344-cf5454b4a478 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:46.434766 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbaf987-a9cf-44ae-b344-cf5454b4a478 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:46.435268 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbaf987-a9cf-44ae-b344-cf5454b4a478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:46.437154 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbaf987-a9cf-44ae-b344-cf5454b4a478 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:46.446939 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 57/107] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:34:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:46.453134 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b21f6-fe32-485a-b57f-4ab7c5fe515c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:46.463873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b21f6-fe32-485a-b57f-4ab7c5fe515c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:46.471793 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee7f3d-dcee-4691-9d30-c56382085e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:46.473025 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee7f3d-dcee-4691-9d30-c56382085e75 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:46.473503 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee7f3d-dcee-4691-9d30-c56382085e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:46.473969 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee7f3d-dcee-4691-9d30-c56382085e75 admin admin] PATH_INFO: `/v3/users/ab9027ff8dfb4123b38f937a7e7a8597` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:46.475420 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee7f3d-dcee-4691-9d30-c56382085e75 admin admin] RBAC: Authorizing `identity:get_user(user_id=ab9027ff8dfb4123b38f937a7e7a8597)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:46.477523 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee7f3d-dcee-4691-9d30-c56382085e75 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:46.479630 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 51/108] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:46 2022] GET /identity/v3/users/ab9027ff8dfb4123b38f937a7e7a8597 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:46.485839 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaf987-a9cf-44ae-b344-cf5454b4a478 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:46.496555 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaf987-a9cf-44ae-b344-cf5454b4a478 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:46.508160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe98b0-7059-4bac-9dff-c521a62a12e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:46.509405 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe98b0-7059-4bac-9dff-c521a62a12e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:46.509884 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe98b0-7059-4bac-9dff-c521a62a12e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:46.510350 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe98b0-7059-4bac-9dff-c521a62a12e8 admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:46.511995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe98b0-7059-4bac-9dff-c521a62a12e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:46.514318 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe98b0-7059-4bac-9dff-c521a62a12e8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:46.516289 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 58/109] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:46 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:46.522451 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee7f3d-dcee-4691-9d30-c56382085e75 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:46.532830 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee7f3d-dcee-4691-9d30-c56382085e75 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:46.544111 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f11b47-07a3-4b24-914e-dbefc782e3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:46.545466 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f11b47-07a3-4b24-914e-dbefc782e3ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:46.545949 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f11b47-07a3-4b24-914e-dbefc782e3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:46.546419 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f11b47-07a3-4b24-914e-dbefc782e3ce admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e/users/ab9027ff8dfb4123b38f937a7e7a8597/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:46.552445 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f11b47-07a3-4b24-914e-dbefc782e3ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a2db78a87c4bd69fde46b3f80e8b5e, user_id=ab9027ff8dfb4123b38f937a7e7a8597, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:46.553835 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-17f11b47-07a3-4b24-914e-dbefc782e3ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:34:46.553835 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:34:46.553835 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:34:46.556200 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f11b47-07a3-4b24-914e-dbefc782e3ce admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:46.582177 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 52/110] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:34:46 2022] PUT /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e/users/ab9027ff8dfb4123b38f937a7e7a8597/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:34:46.841925 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229dc8a-6596-42a3-86d2-b43cf0b32c60 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:46.842114 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229dc8a-6596-42a3-86d2-b43cf0b32c60 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:46.842377 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229dc8a-6596-42a3-86d2-b43cf0b32c60 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:46.844426 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 59/111] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:46.850192 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60eeef-fd2b-4f68-9f18-b52a42cad0eb None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:46.850482 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60eeef-fd2b-4f68-9f18-b52a42cad0eb None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:46.850753 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60eeef-fd2b-4f68-9f18-b52a42cad0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:46.880723 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-4d60eeef-fd2b-4f68-9f18-b52a42cad0eb None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:46.881967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-4d60eeef-fd2b-4f68-9f18-b52a42cad0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:46.963242 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 53/112] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:46.993580 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229dc8a-6596-42a3-86d2-b43cf0b32c60 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:47.007138 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229dc8a-6596-42a3-86d2-b43cf0b32c60 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:47.012131 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5866a3-4e37-47e7-9b8c-5810a15aeb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:47.012958 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5866a3-4e37-47e7-9b8c-5810a15aeb7f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:47.013244 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5866a3-4e37-47e7-9b8c-5810a15aeb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:47.013518 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5866a3-4e37-47e7-9b8c-5810a15aeb7f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:47.027203 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5866a3-4e37-47e7-9b8c-5810a15aeb7f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:47.034508 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-7a5866a3-4e37-47e7-9b8c-5810a15aeb7f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 12:34:47.035786 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 60/113] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:34:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:47.041787 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60eeef-fd2b-4f68-9f18-b52a42cad0eb None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:47.051048 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60eeef-fd2b-4f68-9f18-b52a42cad0eb None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:47.059646 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a21bd-792a-4fc0-9f5f-d8d357407b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:47.060340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a21bd-792a-4fc0-9f5f-d8d357407b91 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:47.060625 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a21bd-792a-4fc0-9f5f-d8d357407b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:47.060902 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a21bd-792a-4fc0-9f5f-d8d357407b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:47.061684 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a21bd-792a-4fc0-9f5f-d8d357407b91 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:47.061994 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a21bd-792a-4fc0-9f5f-d8d357407b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:47.063686 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a21bd-792a-4fc0-9f5f-d8d357407b91 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:47.073506 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 54/114] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:34:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:47.078938 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5866a3-4e37-47e7-9b8c-5810a15aeb7f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:47.089046 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5866a3-4e37-47e7-9b8c-5810a15aeb7f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:47.098733 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93860d8-d3bd-4faa-9741-6780f3c64d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:47.099601 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93860d8-d3bd-4faa-9741-6780f3c64d7e admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:47.099890 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93860d8-d3bd-4faa-9741-6780f3c64d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:47.100169 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93860d8-d3bd-4faa-9741-6780f3c64d7e admin admin] PATH_INFO: `/v3/users/1c24ae2fcabe4449a7beebce995730e4` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:47.101422 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93860d8-d3bd-4faa-9741-6780f3c64d7e admin admin] RBAC: Authorizing `identity:get_user(user_id=1c24ae2fcabe4449a7beebce995730e4)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:47.103706 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93860d8-d3bd-4faa-9741-6780f3c64d7e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:47.105713 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 61/115] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:47 2022] GET /identity/v3/users/1c24ae2fcabe4449a7beebce995730e4 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:47.110936 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a21bd-792a-4fc0-9f5f-d8d357407b91 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:47.120981 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a21bd-792a-4fc0-9f5f-d8d357407b91 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:47.132002 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a0b23-0ee1-4aac-b8ce-d82f9d7eb2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:47.132910 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a0b23-0ee1-4aac-b8ce-d82f9d7eb2ec admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:47.133192 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a0b23-0ee1-4aac-b8ce-d82f9d7eb2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:47.133466 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a0b23-0ee1-4aac-b8ce-d82f9d7eb2ec admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:47.134845 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a0b23-0ee1-4aac-b8ce-d82f9d7eb2ec admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:47.137274 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a0b23-0ee1-4aac-b8ce-d82f9d7eb2ec admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:47.139147 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 55/116] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:47 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:47.145032 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93860d8-d3bd-4faa-9741-6780f3c64d7e admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:47.155595 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93860d8-d3bd-4faa-9741-6780f3c64d7e admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:47.163633 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692935f-247c-409c-aa0a-bc223820cea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:47.164557 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692935f-247c-409c-aa0a-bc223820cea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:47.164840 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692935f-247c-409c-aa0a-bc223820cea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:47.165118 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692935f-247c-409c-aa0a-bc223820cea2 admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e/users/1c24ae2fcabe4449a7beebce995730e4/roles/6d59759e4d584ea688a6c0883ef5d9c6` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:47.167538 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692935f-247c-409c-aa0a-bc223820cea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a2db78a87c4bd69fde46b3f80e8b5e, user_id=1c24ae2fcabe4449a7beebce995730e4, role_id=6d59759e4d584ea688a6c0883ef5d9c6)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:47.170388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692935f-247c-409c-aa0a-bc223820cea2 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:47.197792 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 62/117] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:34:47 2022] PUT /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e/users/1c24ae2fcabe4449a7beebce995730e4/roles/6d59759e4d584ea688a6c0883ef5d9c6 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:34:47.301313 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c6983-62d2-49de-9c73-41fa074d9b44 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:47.301682 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c6983-62d2-49de-9c73-41fa074d9b44 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:47.301852 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c6983-62d2-49de-9c73-41fa074d9b44 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:47.303712 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 56/118] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:47.309526 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0314a4-bb02-4929-8c83-6b9a176cb693 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:47.309811 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0314a4-bb02-4929-8c83-6b9a176cb693 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:47.310077 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0314a4-bb02-4929-8c83-6b9a176cb693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:47.334531 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-1c0314a4-bb02-4929-8c83-6b9a176cb693 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:47.335809 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-1c0314a4-bb02-4929-8c83-6b9a176cb693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:47.410252 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 63/119] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:47.451722 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c6983-62d2-49de-9c73-41fa074d9b44 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:47.469395 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c6983-62d2-49de-9c73-41fa074d9b44 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:47.473858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da511c-e574-4089-a771-341a4c609972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:47.474667 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da511c-e574-4089-a771-341a4c609972 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:47.474953 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da511c-e574-4089-a771-341a4c609972 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:47.475229 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da511c-e574-4089-a771-341a4c609972 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:47.498035 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da511c-e574-4089-a771-341a4c609972 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:47.510849 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-e7da511c-e574-4089-a771-341a4c609972 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 12:34:47.512208 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 57/120] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:34:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:47.518272 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0314a4-bb02-4929-8c83-6b9a176cb693 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:47.527709 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0314a4-bb02-4929-8c83-6b9a176cb693 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:47.535564 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea6a2f-7def-45f0-bcb8-f40318a4bf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:47.536274 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea6a2f-7def-45f0-bcb8-f40318a4bf57 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:47.536559 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea6a2f-7def-45f0-bcb8-f40318a4bf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:47.536834 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea6a2f-7def-45f0-bcb8-f40318a4bf57 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:47.537621 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea6a2f-7def-45f0-bcb8-f40318a4bf57 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:47.537929 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea6a2f-7def-45f0-bcb8-f40318a4bf57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:47.539664 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea6a2f-7def-45f0-bcb8-f40318a4bf57 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:47.549439 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 64/121] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:34:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:47.555435 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da511c-e574-4089-a771-341a4c609972 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:47.566815 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da511c-e574-4089-a771-341a4c609972 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:47.575818 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183eba3-33a7-498c-9a5e-a5c078dffb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:47.576721 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183eba3-33a7-498c-9a5e-a5c078dffb5e admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:47.577005 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183eba3-33a7-498c-9a5e-a5c078dffb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:47.577280 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183eba3-33a7-498c-9a5e-a5c078dffb5e admin admin] PATH_INFO: `/v3/users/1c24ae2fcabe4449a7beebce995730e4` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:47.578531 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183eba3-33a7-498c-9a5e-a5c078dffb5e admin admin] RBAC: Authorizing `identity:get_user(user_id=1c24ae2fcabe4449a7beebce995730e4)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:47.580846 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183eba3-33a7-498c-9a5e-a5c078dffb5e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:47.582494 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 58/122] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:47 2022] GET /identity/v3/users/1c24ae2fcabe4449a7beebce995730e4 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:47.588373 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea6a2f-7def-45f0-bcb8-f40318a4bf57 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:47.598844 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea6a2f-7def-45f0-bcb8-f40318a4bf57 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:47.608438 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd5a4c-6fca-4ce0-87aa-b894f94d706f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:47.609339 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd5a4c-6fca-4ce0-87aa-b894f94d706f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:47.609624 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd5a4c-6fca-4ce0-87aa-b894f94d706f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:47.609900 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd5a4c-6fca-4ce0-87aa-b894f94d706f admin admin] PATH_INFO: `/v3/projects/733c9dea52dc4c2a950a33e232d4f516` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:47.611147 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd5a4c-6fca-4ce0-87aa-b894f94d706f admin admin] RBAC: Authorizing `identity:get_project(project_id=733c9dea52dc4c2a950a33e232d4f516)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:47.613343 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd5a4c-6fca-4ce0-87aa-b894f94d706f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:47.615095 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 65/123] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:47 2022] GET /identity/v3/projects/733c9dea52dc4c2a950a33e232d4f516 => generated 312 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:47.621780 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183eba3-33a7-498c-9a5e-a5c078dffb5e admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:47.631784 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183eba3-33a7-498c-9a5e-a5c078dffb5e admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:47.639868 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948cadcc-e93e-4c79-81de-5425a0430c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:47.640785 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cadcc-e93e-4c79-81de-5425a0430c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:47.641071 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cadcc-e93e-4c79-81de-5425a0430c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:47.641349 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cadcc-e93e-4c79-81de-5425a0430c25 admin admin] PATH_INFO: `/v3/projects/733c9dea52dc4c2a950a33e232d4f516/users/1c24ae2fcabe4449a7beebce995730e4/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:47.648353 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948cadcc-e93e-4c79-81de-5425a0430c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733c9dea52dc4c2a950a33e232d4f516, user_id=1c24ae2fcabe4449a7beebce995730e4, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:47.651097 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948cadcc-e93e-4c79-81de-5425a0430c25 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:47.654983 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ce6dc-5a02-4955-ac6d-293b672fef7f None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:47.655273 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ce6dc-5a02-4955-ac6d-293b672fef7f None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:47.655577 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ce6dc-5a02-4955-ac6d-293b672fef7f None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:47.657640 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 66/124] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:47.664829 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aebc84-9a28-45d5-9fe5-9f7f4323178e None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:47.665148 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aebc84-9a28-45d5-9fe5-9f7f4323178e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:47.665448 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aebc84-9a28-45d5-9fe5-9f7f4323178e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:47.686911 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 59/125] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:34:47 2022] PUT /identity/v3/projects/733c9dea52dc4c2a950a33e232d4f516/users/1c24ae2fcabe4449a7beebce995730e4/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:34:47.693636 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-f5aebc84-9a28-45d5-9fe5-9f7f4323178e None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:47.695002 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f5aebc84-9a28-45d5-9fe5-9f7f4323178e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:47.774418 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 67/126] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:34:47.819228 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948cadcc-e93e-4c79-81de-5425a0430c25 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:47.837068 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948cadcc-e93e-4c79-81de-5425a0430c25 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:47.843178 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d774c-7106-423f-8693-51aa60a746e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:47.844079 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d774c-7106-423f-8693-51aa60a746e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:47.844345 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d774c-7106-423f-8693-51aa60a746e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:47.844627 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d774c-7106-423f-8693-51aa60a746e8 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:47.860498 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d774c-7106-423f-8693-51aa60a746e8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:47.867387 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-320d774c-7106-423f-8693-51aa60a746e8 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 12:34:47.873064 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 60/127] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:34:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:47.879268 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aebc84-9a28-45d5-9fe5-9f7f4323178e None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:47.895411 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aebc84-9a28-45d5-9fe5-9f7f4323178e None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:47.903160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af030075-9117-475b-937b-e2dea6e274b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:47.903885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af030075-9117-475b-937b-e2dea6e274b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:47.904167 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af030075-9117-475b-937b-e2dea6e274b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:47.904442 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af030075-9117-475b-937b-e2dea6e274b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:47.905226 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af030075-9117-475b-937b-e2dea6e274b4 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:47.905532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af030075-9117-475b-937b-e2dea6e274b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:47.907213 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af030075-9117-475b-937b-e2dea6e274b4 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:47.920506 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 68/128] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:34:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:47.926304 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d774c-7106-423f-8693-51aa60a746e8 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:47.939216 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d774c-7106-423f-8693-51aa60a746e8 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:47.947676 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ccdf9-6c6a-4a8c-b3b6-379781577c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:47.948657 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ccdf9-6c6a-4a8c-b3b6-379781577c7c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:47.949003 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ccdf9-6c6a-4a8c-b3b6-379781577c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:47.949282 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ccdf9-6c6a-4a8c-b3b6-379781577c7c admin admin] PATH_INFO: `/v3/users/5f69aca2912c4925a32cd6cb45de0115` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:47.969666 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ccdf9-6c6a-4a8c-b3b6-379781577c7c admin admin] RBAC: Authorizing `identity:get_user(user_id=5f69aca2912c4925a32cd6cb45de0115)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:47.971883 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ccdf9-6c6a-4a8c-b3b6-379781577c7c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:47.973645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 61/129] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:47 2022] GET /identity/v3/users/5f69aca2912c4925a32cd6cb45de0115 => generated 289 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:47.979607 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af030075-9117-475b-937b-e2dea6e274b4 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:47.992577 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af030075-9117-475b-937b-e2dea6e274b4 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:48.003436 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4658ab-da82-4bb3-902a-4991223ca05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:48.004254 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4658ab-da82-4bb3-902a-4991223ca05d admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:48.004445 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4658ab-da82-4bb3-902a-4991223ca05d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:48.004718 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4658ab-da82-4bb3-902a-4991223ca05d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:48.013818 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4658ab-da82-4bb3-902a-4991223ca05d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:48.015630 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4658ab-da82-4bb3-902a-4991223ca05d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:48.030279 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 69/130] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:34:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:34:48.036011 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ccdf9-6c6a-4a8c-b3b6-379781577c7c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:48.048776 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ccdf9-6c6a-4a8c-b3b6-379781577c7c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:48.059756 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0179af-0ad1-4d85-b1f3-c553f3cf65bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:48.060645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0179af-0ad1-4d85-b1f3-c553f3cf65bb admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:48.060928 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0179af-0ad1-4d85-b1f3-c553f3cf65bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:48.061203 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0179af-0ad1-4d85-b1f3-c553f3cf65bb admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:48.068434 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0179af-0ad1-4d85-b1f3-c553f3cf65bb admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:48.070575 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0179af-0ad1-4d85-b1f3-c553f3cf65bb admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:48.072413 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 62/131] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:48 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:48.078648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4658ab-da82-4bb3-902a-4991223ca05d admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:48.093180 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4658ab-da82-4bb3-902a-4991223ca05d admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:48.103288 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49dd9a-1e0d-4d81-b798-bb80157ddbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:48.104024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49dd9a-1e0d-4d81-b798-bb80157ddbed admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:48.104299 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49dd9a-1e0d-4d81-b798-bb80157ddbed admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:48.104699 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49dd9a-1e0d-4d81-b798-bb80157ddbed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:48.105942 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49dd9a-1e0d-4d81-b798-bb80157ddbed admin admin] RBAC: Adding query filter params (role.id=86eb0f09cb0e49e1a58d4bfadbf1e9bf, scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e, user.id=5f69aca2912c4925a32cd6cb45de0115) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:48.106255 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49dd9a-1e0d-4d81-b798-bb80157ddbed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:48.108191 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49dd9a-1e0d-4d81-b798-bb80157ddbed admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:48.114966 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 70/132] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:34:48 2022] GET /identity/v3/role_assignments?user.id=5f69aca2912c4925a32cd6cb45de0115&scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e&role.id=86eb0f09cb0e49e1a58d4bfadbf1e9bf => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:48.190439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5b716-36c4-41ae-bddf-e79cd5aafbcb None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:48.190738 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5b716-36c4-41ae-bddf-e79cd5aafbcb None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:48.190913 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5b716-36c4-41ae-bddf-e79cd5aafbcb None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:48.192821 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 63/133] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:48.209772 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aff85-5e85-4ce5-bd8b-3dfef5ea0fd2 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:48.210106 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aff85-5e85-4ce5-bd8b-3dfef5ea0fd2 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:48.210318 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0aff85-5e85-4ce5-bd8b-3dfef5ea0fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:48.232113 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-4e0aff85-5e85-4ce5-bd8b-3dfef5ea0fd2 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:48.233308 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-4e0aff85-5e85-4ce5-bd8b-3dfef5ea0fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:48.246108 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 71/134] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:48.273043 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5b716-36c4-41ae-bddf-e79cd5aafbcb None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:48.293459 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5b716-36c4-41ae-bddf-e79cd5aafbcb None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:48.303882 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed6cc5-cba9-48dc-8edc-f987198a00be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:48.304714 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed6cc5-cba9-48dc-8edc-f987198a00be admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:48.305056 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed6cc5-cba9-48dc-8edc-f987198a00be admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:48.305276 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed6cc5-cba9-48dc-8edc-f987198a00be admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:48.306554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed6cc5-cba9-48dc-8edc-f987198a00be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:48.308402 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed6cc5-cba9-48dc-8edc-f987198a00be admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:48.317136 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 64/135] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:34:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:48.323312 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0aff85-5e85-4ce5-bd8b-3dfef5ea0fd2 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:48.340003 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0aff85-5e85-4ce5-bd8b-3dfef5ea0fd2 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:48.347433 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2db9ad-2680-4551-b47b-eb7cb4bc4654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:48.348163 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2db9ad-2680-4551-b47b-eb7cb4bc4654 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:48.348444 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2db9ad-2680-4551-b47b-eb7cb4bc4654 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:48.348725 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2db9ad-2680-4551-b47b-eb7cb4bc4654 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:48.349486 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2db9ad-2680-4551-b47b-eb7cb4bc4654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:48.351508 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2db9ad-2680-4551-b47b-eb7cb4bc4654 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:48.406360 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 72/136] 10.222.0.13 () {60 vars in 1162 bytes} [Mon Jan 10 12:34:48 2022] POST /identity/v3/projects => generated 302 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:34:49.909666 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f59826-ec2b-4ac7-8401-30dd79fbce36 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:49.910187 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f59826-ec2b-4ac7-8401-30dd79fbce36 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:49.910261 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f59826-ec2b-4ac7-8401-30dd79fbce36 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:49.912267 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 65/137] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:49.918341 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6f4b7-c4b6-4fc8-996c-5b5edb70d6c7 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:49.918803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6f4b7-c4b6-4fc8-996c-5b5edb70d6c7 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:49.918875 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6f4b7-c4b6-4fc8-996c-5b5edb70d6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:49.948846 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-4aa6f4b7-c4b6-4fc8-996c-5b5edb70d6c7 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:49.950069 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-4aa6f4b7-c4b6-4fc8-996c-5b5edb70d6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:50.029290 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 73/138] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:50.085042 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f59826-ec2b-4ac7-8401-30dd79fbce36 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:50.100174 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f59826-ec2b-4ac7-8401-30dd79fbce36 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:50.110087 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfd51c-eeab-4357-ba86-ed01a89e28f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:50.110903 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfd51c-eeab-4357-ba86-ed01a89e28f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:50.111191 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfd51c-eeab-4357-ba86-ed01a89e28f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:50.111468 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfd51c-eeab-4357-ba86-ed01a89e28f1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:50.125689 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdfd51c-eeab-4357-ba86-ed01a89e28f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:50.139224 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-cfdfd51c-eeab-4357-ba86-ed01a89e28f1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 12:34:50.140504 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 66/139] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:34:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:50.146477 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6f4b7-c4b6-4fc8-996c-5b5edb70d6c7 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:50.160475 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6f4b7-c4b6-4fc8-996c-5b5edb70d6c7 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:50.170417 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90a9d4-f155-4da3-86b6-200bfdcff7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:50.171102 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90a9d4-f155-4da3-86b6-200bfdcff7bd admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:50.171379 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90a9d4-f155-4da3-86b6-200bfdcff7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:50.171673 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90a9d4-f155-4da3-86b6-200bfdcff7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:50.172452 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90a9d4-f155-4da3-86b6-200bfdcff7bd admin admin] RBAC: Adding query filter params (name=member) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:50.172753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90a9d4-f155-4da3-86b6-200bfdcff7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:50.174384 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90a9d4-f155-4da3-86b6-200bfdcff7bd admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:50.187166 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 74/140] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:34:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:50.193255 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfd51c-eeab-4357-ba86-ed01a89e28f1 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:50.205526 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfd51c-eeab-4357-ba86-ed01a89e28f1 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:50.215725 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79628da9-e5c3-4ed5-86b4-e0e4c84802eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:50.216615 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79628da9-e5c3-4ed5-86b4-e0e4c84802eb admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:50.216898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79628da9-e5c3-4ed5-86b4-e0e4c84802eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:50.217174 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79628da9-e5c3-4ed5-86b4-e0e4c84802eb admin admin] PATH_INFO: `/v3/users/1c24ae2fcabe4449a7beebce995730e4` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:50.221749 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79628da9-e5c3-4ed5-86b4-e0e4c84802eb admin admin] RBAC: Authorizing `identity:get_user(user_id=1c24ae2fcabe4449a7beebce995730e4)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:50.223991 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79628da9-e5c3-4ed5-86b4-e0e4c84802eb admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:50.225662 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 67/141] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:50 2022] GET /identity/v3/users/1c24ae2fcabe4449a7beebce995730e4 => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:50.231606 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90a9d4-f155-4da3-86b6-200bfdcff7bd admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:50.244429 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90a9d4-f155-4da3-86b6-200bfdcff7bd admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:50.255113 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f785e-f370-44fe-b2b1-9bcb8336d556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:50.255802 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f785e-f370-44fe-b2b1-9bcb8336d556 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:50.256080 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f785e-f370-44fe-b2b1-9bcb8336d556 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:50.256350 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f785e-f370-44fe-b2b1-9bcb8336d556 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:50.267193 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f785e-f370-44fe-b2b1-9bcb8336d556 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:50.269011 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f785e-f370-44fe-b2b1-9bcb8336d556 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:50.281183 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 75/142] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:34:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 12:34:50.286970 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79628da9-e5c3-4ed5-86b4-e0e4c84802eb admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:50.300746 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79628da9-e5c3-4ed5-86b4-e0e4c84802eb admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:50.311985 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a01b2d-cbd2-4e53-b0c5-27849eb8cb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:50.312872 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a01b2d-cbd2-4e53-b0c5-27849eb8cb1a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:50.313155 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a01b2d-cbd2-4e53-b0c5-27849eb8cb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:50.313435 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a01b2d-cbd2-4e53-b0c5-27849eb8cb1a admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:50.318639 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a01b2d-cbd2-4e53-b0c5-27849eb8cb1a admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:50.322726 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a01b2d-cbd2-4e53-b0c5-27849eb8cb1a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:50.322726 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 68/143] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:50 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:50.328786 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f785e-f370-44fe-b2b1-9bcb8336d556 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:50.341054 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f785e-f370-44fe-b2b1-9bcb8336d556 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:50.342475 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aa92a-55b8-4053-8f70-34d636fc40c6 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:50.342769 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aa92a-55b8-4053-8f70-34d636fc40c6 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:50.343044 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aa92a-55b8-4053-8f70-34d636fc40c6 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:50.344929 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 69/144] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:34:50.345960 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca36929-fcd1-4913-96ab-80a376a43b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:50.346736 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca36929-fcd1-4913-96ab-80a376a43b88 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:50.347107 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca36929-fcd1-4913-96ab-80a376a43b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:50.347474 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca36929-fcd1-4913-96ab-80a376a43b88 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:50.348447 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca36929-fcd1-4913-96ab-80a376a43b88 admin admin] RBAC: Adding query filter params (role.id=e4d526676145442ab5838d824be7bf59, scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e, user.id=1c24ae2fcabe4449a7beebce995730e4) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:50.348853 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca36929-fcd1-4913-96ab-80a376a43b88 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:50.350797 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca36929-fcd1-4913-96ab-80a376a43b88 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:50.351876 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c51da9-cb78-4185-9599-390668f9c873 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:50.352169 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c51da9-cb78-4185-9599-390668f9c873 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:50.352458 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c51da9-cb78-4185-9599-390668f9c873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:50.358285 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 76/145] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:34:50 2022] GET /identity/v3/role_assignments?user.id=1c24ae2fcabe4449a7beebce995730e4&scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e&role.id=e4d526676145442ab5838d824be7bf59 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:50.388677 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-f3c51da9-cb78-4185-9599-390668f9c873 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:50.389935 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-f3c51da9-cb78-4185-9599-390668f9c873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:50.401678 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 70/146] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:34:50.449970 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca36929-fcd1-4913-96ab-80a376a43b88 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:50.460907 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca36929-fcd1-4913-96ab-80a376a43b88 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:50.472136 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2778a-ec82-4fab-a245-988b62a14491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:50.472999 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2778a-ec82-4fab-a245-988b62a14491 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:50.473288 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2778a-ec82-4fab-a245-988b62a14491 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:50.473563 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2778a-ec82-4fab-a245-988b62a14491 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:50.490614 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2778a-ec82-4fab-a245-988b62a14491 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:50.497758 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-a3a2778a-ec82-4fab-a245-988b62a14491 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:34:50.499032 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 77/147] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:34:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:50.505174 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c51da9-cb78-4185-9599-390668f9c873 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:50.514929 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c51da9-cb78-4185-9599-390668f9c873 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:50.519795 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909634d4-a7c5-4db1-bd1b-dd2702a4b13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:50.520559 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909634d4-a7c5-4db1-bd1b-dd2702a4b13a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:50.520843 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909634d4-a7c5-4db1-bd1b-dd2702a4b13a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:50.521121 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909634d4-a7c5-4db1-bd1b-dd2702a4b13a admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:50.522007 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909634d4-a7c5-4db1-bd1b-dd2702a4b13a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:50.522320 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909634d4-a7c5-4db1-bd1b-dd2702a4b13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:50.524159 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909634d4-a7c5-4db1-bd1b-dd2702a4b13a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:50.535171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 71/148] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:34:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:50.544797 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2778a-ec82-4fab-a245-988b62a14491 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:50.556309 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2778a-ec82-4fab-a245-988b62a14491 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:50.563452 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb8bda-7f83-457d-b203-1fb2b4d76687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:50.564446 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb8bda-7f83-457d-b203-1fb2b4d76687 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:50.564774 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb8bda-7f83-457d-b203-1fb2b4d76687 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:50.565466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb8bda-7f83-457d-b203-1fb2b4d76687 admin admin] PATH_INFO: `/v3/users/ab9027ff8dfb4123b38f937a7e7a8597` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:50.567738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb8bda-7f83-457d-b203-1fb2b4d76687 admin admin] RBAC: Authorizing `identity:get_user(user_id=ab9027ff8dfb4123b38f937a7e7a8597)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:50.569737 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb8bda-7f83-457d-b203-1fb2b4d76687 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:50.571580 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 78/149] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:50 2022] GET /identity/v3/users/ab9027ff8dfb4123b38f937a7e7a8597 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:50.577717 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909634d4-a7c5-4db1-bd1b-dd2702a4b13a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:50.589125 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909634d4-a7c5-4db1-bd1b-dd2702a4b13a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:50.594198 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790dc89-92d0-491e-92a4-a5e54e1fae86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:50.594910 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790dc89-92d0-491e-92a4-a5e54e1fae86 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:50.595243 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790dc89-92d0-491e-92a4-a5e54e1fae86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:50.595542 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790dc89-92d0-491e-92a4-a5e54e1fae86 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:50.608203 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790dc89-92d0-491e-92a4-a5e54e1fae86 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:50.610048 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790dc89-92d0-491e-92a4-a5e54e1fae86 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:50.620481 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 72/150] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:34:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:34:50.626174 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb8bda-7f83-457d-b203-1fb2b4d76687 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:50.642288 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb8bda-7f83-457d-b203-1fb2b4d76687 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:50.653204 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026db0f-66b4-49fc-b653-605b61a5258b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:50.653204 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026db0f-66b4-49fc-b653-605b61a5258b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:50.653204 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026db0f-66b4-49fc-b653-605b61a5258b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:50.653204 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026db0f-66b4-49fc-b653-605b61a5258b admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:50.654696 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026db0f-66b4-49fc-b653-605b61a5258b admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:50.657042 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026db0f-66b4-49fc-b653-605b61a5258b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:50.659077 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 79/151] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:50 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:50.665298 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790dc89-92d0-491e-92a4-a5e54e1fae86 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:50.677625 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790dc89-92d0-491e-92a4-a5e54e1fae86 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:50.686219 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec135e2-2cc0-482e-99d9-b5ccf0ec3401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:50.686995 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec135e2-2cc0-482e-99d9-b5ccf0ec3401 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:50.687287 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec135e2-2cc0-482e-99d9-b5ccf0ec3401 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:50.687583 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec135e2-2cc0-482e-99d9-b5ccf0ec3401 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:50.688513 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec135e2-2cc0-482e-99d9-b5ccf0ec3401 admin admin] RBAC: Adding query filter params (role.id=9d097c033f454263a874fbafe92c9aea, scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e, user.id=ab9027ff8dfb4123b38f937a7e7a8597) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:50.688829 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec135e2-2cc0-482e-99d9-b5ccf0ec3401 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:50.691237 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec135e2-2cc0-482e-99d9-b5ccf0ec3401 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:50.701285 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 73/152] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:34:50 2022] GET /identity/v3/role_assignments?user.id=ab9027ff8dfb4123b38f937a7e7a8597&scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e&role.id=9d097c033f454263a874fbafe92c9aea => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:51.102597 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79098791-e571-41ae-af7f-effc941e4190 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.103671 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79098791-e571-41ae-af7f-effc941e4190 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.104147 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79098791-e571-41ae-af7f-effc941e4190 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.106357 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 80/153] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:51.112734 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6d1dc-1c3a-4496-99e1-7c36c916551f None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.113192 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6d1dc-1c3a-4496-99e1-7c36c916551f None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.113369 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6d1dc-1c3a-4496-99e1-7c36c916551f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.133494 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-a5e6d1dc-1c3a-4496-99e1-7c36c916551f None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:51.134689 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-a5e6d1dc-1c3a-4496-99e1-7c36c916551f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:51.148301 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 74/154] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:51.174580 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79098791-e571-41ae-af7f-effc941e4190 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:51.191077 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79098791-e571-41ae-af7f-effc941e4190 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:51.199933 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b18a00-727f-44bf-accf-747193a85d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:51.201168 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b18a00-727f-44bf-accf-747193a85d2c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.201641 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b18a00-727f-44bf-accf-747193a85d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.202102 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b18a00-727f-44bf-accf-747193a85d2c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.217556 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b18a00-727f-44bf-accf-747193a85d2c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:51.225383 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-d8b18a00-727f-44bf-accf-747193a85d2c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 12:34:51.227068 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 81/155] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:34:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:51.233542 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6d1dc-1c3a-4496-99e1-7c36c916551f None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:51.244540 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6d1dc-1c3a-4496-99e1-7c36c916551f None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:51.251643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf3857-ba23-4d9e-ae2d-f8b0ac066384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:51.252344 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf3857-ba23-4d9e-ae2d-f8b0ac066384 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.252612 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf3857-ba23-4d9e-ae2d-f8b0ac066384 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.252872 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf3857-ba23-4d9e-ae2d-f8b0ac066384 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.253702 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf3857-ba23-4d9e-ae2d-f8b0ac066384 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:51.254012 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf3857-ba23-4d9e-ae2d-f8b0ac066384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:51.255680 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf3857-ba23-4d9e-ae2d-f8b0ac066384 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:51.265990 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 75/156] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:34:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:51.271660 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b18a00-727f-44bf-accf-747193a85d2c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:51.281776 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b18a00-727f-44bf-accf-747193a85d2c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:51.288406 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754fd3b-d0b5-4ecb-8bf6-2d8ac63e8286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:51.289455 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754fd3b-d0b5-4ecb-8bf6-2d8ac63e8286 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.289796 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754fd3b-d0b5-4ecb-8bf6-2d8ac63e8286 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.290155 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754fd3b-d0b5-4ecb-8bf6-2d8ac63e8286 admin admin] PATH_INFO: `/v3/users/1c24ae2fcabe4449a7beebce995730e4` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.291503 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754fd3b-d0b5-4ecb-8bf6-2d8ac63e8286 admin admin] RBAC: Authorizing `identity:get_user(user_id=1c24ae2fcabe4449a7beebce995730e4)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:51.293915 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754fd3b-d0b5-4ecb-8bf6-2d8ac63e8286 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:51.295974 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 82/157] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:51 2022] GET /identity/v3/users/1c24ae2fcabe4449a7beebce995730e4 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:51.301280 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf3857-ba23-4d9e-ae2d-f8b0ac066384 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:51.311774 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf3857-ba23-4d9e-ae2d-f8b0ac066384 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:51.317097 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2930c7a-9999-413b-8526-097e5ca73a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:51.318017 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2930c7a-9999-413b-8526-097e5ca73a02 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.318517 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2930c7a-9999-413b-8526-097e5ca73a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.319003 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2930c7a-9999-413b-8526-097e5ca73a02 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.327740 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2930c7a-9999-413b-8526-097e5ca73a02 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:51.329872 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2930c7a-9999-413b-8526-097e5ca73a02 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:51.339342 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 76/158] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:34:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:34:51.345654 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754fd3b-d0b5-4ecb-8bf6-2d8ac63e8286 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:51.356686 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754fd3b-d0b5-4ecb-8bf6-2d8ac63e8286 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:51.361524 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485a377-0ac0-49e9-b86c-5f82aba0e0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:51.362636 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485a377-0ac0-49e9-b86c-5f82aba0e0ff admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.363157 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485a377-0ac0-49e9-b86c-5f82aba0e0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.363681 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485a377-0ac0-49e9-b86c-5f82aba0e0ff admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.365131 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485a377-0ac0-49e9-b86c-5f82aba0e0ff admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:51.367503 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485a377-0ac0-49e9-b86c-5f82aba0e0ff admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:51.369532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 83/159] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:51 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:51.375706 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2930c7a-9999-413b-8526-097e5ca73a02 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:51.385168 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2930c7a-9999-413b-8526-097e5ca73a02 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:51.391680 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f672b5-18b9-4484-9628-ca1633aa207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:51.392668 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f672b5-18b9-4484-9628-ca1633aa207f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.393147 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f672b5-18b9-4484-9628-ca1633aa207f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.393677 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f672b5-18b9-4484-9628-ca1633aa207f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.394797 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f672b5-18b9-4484-9628-ca1633aa207f admin admin] RBAC: Adding query filter params (role.id=6d59759e4d584ea688a6c0883ef5d9c6, scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e, user.id=1c24ae2fcabe4449a7beebce995730e4) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:51.395327 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f672b5-18b9-4484-9628-ca1633aa207f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:51.397482 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f672b5-18b9-4484-9628-ca1633aa207f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:51.404670 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 77/160] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:34:51 2022] GET /identity/v3/role_assignments?user.id=1c24ae2fcabe4449a7beebce995730e4&scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e&role.id=6d59759e4d584ea688a6c0883ef5d9c6 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:51.513275 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a253a0-c62d-4395-970c-f8a05c566b74 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.513626 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a253a0-c62d-4395-970c-f8a05c566b74 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.513816 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a253a0-c62d-4395-970c-f8a05c566b74 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.515860 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 84/161] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:51.521495 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f5d6f-8846-4229-8477-ccf2d44d31ff None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.521769 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f5d6f-8846-4229-8477-ccf2d44d31ff None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.522044 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f5d6f-8846-4229-8477-ccf2d44d31ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.541469 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-615f5d6f-8846-4229-8477-ccf2d44d31ff None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:51.543138 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-615f5d6f-8846-4229-8477-ccf2d44d31ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:51.550816 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 78/162] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:51.577546 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a253a0-c62d-4395-970c-f8a05c566b74 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:51.591682 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a253a0-c62d-4395-970c-f8a05c566b74 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:51.596266 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45381c-b279-40fa-bf88-04133d7c7ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:51.597075 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45381c-b279-40fa-bf88-04133d7c7ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.597350 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45381c-b279-40fa-bf88-04133d7c7ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.597612 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45381c-b279-40fa-bf88-04133d7c7ac4 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.610850 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45381c-b279-40fa-bf88-04133d7c7ac4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:51.617825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-bf45381c-b279-40fa-bf88-04133d7c7ac4 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 12:34:51.619473 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 85/163] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:34:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:51.626421 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f5d6f-8846-4229-8477-ccf2d44d31ff None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:51.636057 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f5d6f-8846-4229-8477-ccf2d44d31ff None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:51.641236 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23793c4d-1fe9-4159-b40e-a4d4c69b2d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:51.641923 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23793c4d-1fe9-4159-b40e-a4d4c69b2d77 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.642199 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23793c4d-1fe9-4159-b40e-a4d4c69b2d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.642463 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23793c4d-1fe9-4159-b40e-a4d4c69b2d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.643244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23793c4d-1fe9-4159-b40e-a4d4c69b2d77 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:51.643594 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23793c4d-1fe9-4159-b40e-a4d4c69b2d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:51.645323 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23793c4d-1fe9-4159-b40e-a4d4c69b2d77 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:51.657188 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 79/164] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:34:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:51.662751 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45381c-b279-40fa-bf88-04133d7c7ac4 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:51.673022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45381c-b279-40fa-bf88-04133d7c7ac4 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:51.678994 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1faec5-2051-4205-a912-1e25e17d618a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:51.679984 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1faec5-2051-4205-a912-1e25e17d618a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.680261 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1faec5-2051-4205-a912-1e25e17d618a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.680532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1faec5-2051-4205-a912-1e25e17d618a admin admin] PATH_INFO: `/v3/users/5f69aca2912c4925a32cd6cb45de0115` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.681840 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1faec5-2051-4205-a912-1e25e17d618a admin admin] RBAC: Authorizing `identity:get_user(user_id=5f69aca2912c4925a32cd6cb45de0115)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:51.684111 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1faec5-2051-4205-a912-1e25e17d618a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:51.685764 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 86/165] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:51 2022] GET /identity/v3/users/5f69aca2912c4925a32cd6cb45de0115 => generated 289 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:34:51.691979 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23793c4d-1fe9-4159-b40e-a4d4c69b2d77 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:51.702488 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23793c4d-1fe9-4159-b40e-a4d4c69b2d77 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:51.708624 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda12ee-03e7-4646-838d-e7bf1b5f3f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:51.709615 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda12ee-03e7-4646-838d-e7bf1b5f3f40 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.709984 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda12ee-03e7-4646-838d-e7bf1b5f3f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.710337 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda12ee-03e7-4646-838d-e7bf1b5f3f40 admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.711665 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda12ee-03e7-4646-838d-e7bf1b5f3f40 admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:51.713820 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda12ee-03e7-4646-838d-e7bf1b5f3f40 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:51.716165 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 80/166] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:51 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:51.721691 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1faec5-2051-4205-a912-1e25e17d618a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:51.734296 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd6a6f-d090-4eaa-8a19-018a55841f7e None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.734581 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd6a6f-d090-4eaa-8a19-018a55841f7e None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.734852 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd6a6f-d090-4eaa-8a19-018a55841f7e None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.735878 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1faec5-2051-4205-a912-1e25e17d618a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:51.736986 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 81/167] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:51.740406 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9af44-55e1-4433-9cfe-44ba47dc0a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:51.741300 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9af44-55e1-4433-9cfe-44ba47dc0a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.741578 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9af44-55e1-4433-9cfe-44ba47dc0a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.741848 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9af44-55e1-4433-9cfe-44ba47dc0a37 admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e/users/5f69aca2912c4925a32cd6cb45de0115/roles/86eb0f09cb0e49e1a58d4bfadbf1e9bf` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.743956 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9af44-55e1-4433-9cfe-44ba47dc0a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a2db78a87c4bd69fde46b3f80e8b5e, user_id=5f69aca2912c4925a32cd6cb45de0115, role_id=86eb0f09cb0e49e1a58d4bfadbf1e9bf)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:51.745488 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac15da-3406-47f4-9bdd-1bdfa5abd4b6 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.745772 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac15da-3406-47f4-9bdd-1bdfa5abd4b6 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.746038 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac15da-3406-47f4-9bdd-1bdfa5abd4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.746767 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9af44-55e1-4433-9cfe-44ba47dc0a37 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:51.764107 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 87/168] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:34:51 2022] PUT /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e/users/5f69aca2912c4925a32cd6cb45de0115/roles/86eb0f09cb0e49e1a58d4bfadbf1e9bf => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:34:51.768695 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-2dac15da-3406-47f4-9bdd-1bdfa5abd4b6 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:51.770023 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-2dac15da-3406-47f4-9bdd-1bdfa5abd4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:51.836901 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 82/169] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:34:51.862550 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9af44-55e1-4433-9cfe-44ba47dc0a37 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:51.873341 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9af44-55e1-4433-9cfe-44ba47dc0a37 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:51.878251 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637a32d-12f6-425c-b8bd-60a5f9f8063b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:51.879128 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637a32d-12f6-425c-b8bd-60a5f9f8063b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.879403 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637a32d-12f6-425c-b8bd-60a5f9f8063b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.879683 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637a32d-12f6-425c-b8bd-60a5f9f8063b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.892385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637a32d-12f6-425c-b8bd-60a5f9f8063b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:51.899508 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-7637a32d-12f6-425c-b8bd-60a5f9f8063b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 12:34:51.901025 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 88/170] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:34:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:51.907052 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac15da-3406-47f4-9bdd-1bdfa5abd4b6 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:51.916561 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac15da-3406-47f4-9bdd-1bdfa5abd4b6 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:51.921627 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e540f-8679-423b-ae3b-653e29f743fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:51.922313 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e540f-8679-423b-ae3b-653e29f743fe admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.922568 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e540f-8679-423b-ae3b-653e29f743fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.922860 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e540f-8679-423b-ae3b-653e29f743fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.923644 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e540f-8679-423b-ae3b-653e29f743fe admin admin] RBAC: Adding query filter params (name=member) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:51.923956 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e540f-8679-423b-ae3b-653e29f743fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:51.925622 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e540f-8679-423b-ae3b-653e29f743fe admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:51.935581 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 83/171] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:34:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:51.941668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637a32d-12f6-425c-b8bd-60a5f9f8063b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:51.952381 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637a32d-12f6-425c-b8bd-60a5f9f8063b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:51.958308 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493f114-3585-4b29-952b-a377c1937886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:51.959321 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493f114-3585-4b29-952b-a377c1937886 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.959701 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493f114-3585-4b29-952b-a377c1937886 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.960049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493f114-3585-4b29-952b-a377c1937886 admin admin] PATH_INFO: `/v3/users/1c24ae2fcabe4449a7beebce995730e4` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.961580 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493f114-3585-4b29-952b-a377c1937886 admin admin] RBAC: Authorizing `identity:get_user(user_id=1c24ae2fcabe4449a7beebce995730e4)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:51.964281 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493f114-3585-4b29-952b-a377c1937886 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:51.966622 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 89/172] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:51 2022] GET /identity/v3/users/1c24ae2fcabe4449a7beebce995730e4 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:51.972058 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e540f-8679-423b-ae3b-653e29f743fe admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:51.982881 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e540f-8679-423b-ae3b-653e29f743fe admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:51.987429 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88de73a-64d2-4fd2-8494-26db19ba465d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:51.988121 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88de73a-64d2-4fd2-8494-26db19ba465d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:51.988383 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88de73a-64d2-4fd2-8494-26db19ba465d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:51.988669 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88de73a-64d2-4fd2-8494-26db19ba465d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:51.998719 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88de73a-64d2-4fd2-8494-26db19ba465d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:52.000592 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88de73a-64d2-4fd2-8494-26db19ba465d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:52.010001 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 84/173] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:34:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:34:52.015883 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493f114-3585-4b29-952b-a377c1937886 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:52.025844 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493f114-3585-4b29-952b-a377c1937886 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:52.030410 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad36d33-1a93-42ad-9c3b-64498ff29283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:52.031279 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad36d33-1a93-42ad-9c3b-64498ff29283 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:52.031593 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad36d33-1a93-42ad-9c3b-64498ff29283 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:52.031869 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad36d33-1a93-42ad-9c3b-64498ff29283 admin admin] PATH_INFO: `/v3/projects/733c9dea52dc4c2a950a33e232d4f516` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:52.033088 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad36d33-1a93-42ad-9c3b-64498ff29283 admin admin] RBAC: Authorizing `identity:get_project(project_id=733c9dea52dc4c2a950a33e232d4f516)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:52.035151 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad36d33-1a93-42ad-9c3b-64498ff29283 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:52.036941 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 90/174] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:52 2022] GET /identity/v3/projects/733c9dea52dc4c2a950a33e232d4f516 => generated 312 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:52.042789 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88de73a-64d2-4fd2-8494-26db19ba465d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:52.045726 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83653ca-1cd6-4412-9960-0362cc907f2a None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:52.046025 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83653ca-1cd6-4412-9960-0362cc907f2a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:52.046336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83653ca-1cd6-4412-9960-0362cc907f2a None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:52.048099 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 91/175] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:52.052039 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88de73a-64d2-4fd2-8494-26db19ba465d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:52.052962 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0c978-41cf-45e6-89b0-ffeea4777ab7 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:52.053339 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0c978-41cf-45e6-89b0-ffeea4777ab7 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:52.053604 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0c978-41cf-45e6-89b0-ffeea4777ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:52.056469 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74780ed4-aa92-4bd5-88a4-1c9f2d671085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:52.057120 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74780ed4-aa92-4bd5-88a4-1c9f2d671085 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:52.057436 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74780ed4-aa92-4bd5-88a4-1c9f2d671085 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:52.057766 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74780ed4-aa92-4bd5-88a4-1c9f2d671085 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:52.058766 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74780ed4-aa92-4bd5-88a4-1c9f2d671085 admin admin] RBAC: Adding query filter params (role.id=e4d526676145442ab5838d824be7bf59, scope.project.id=733c9dea52dc4c2a950a33e232d4f516, user.id=1c24ae2fcabe4449a7beebce995730e4) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:52.059076 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74780ed4-aa92-4bd5-88a4-1c9f2d671085 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:52.060987 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74780ed4-aa92-4bd5-88a4-1c9f2d671085 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:52.067450 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 85/176] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:34:52 2022] GET /identity/v3/role_assignments?user.id=1c24ae2fcabe4449a7beebce995730e4&scope.project.id=733c9dea52dc4c2a950a33e232d4f516&role.id=e4d526676145442ab5838d824be7bf59 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:52.073059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-3cd0c978-41cf-45e6-89b0-ffeea4777ab7 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:52.074848 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-3cd0c978-41cf-45e6-89b0-ffeea4777ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:52.082910 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 92/177] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:52.109817 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74780ed4-aa92-4bd5-88a4-1c9f2d671085 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:52.120362 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74780ed4-aa92-4bd5-88a4-1c9f2d671085 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:52.126023 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171054cf-13b5-4e20-805f-a248b25dd3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:52.126838 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171054cf-13b5-4e20-805f-a248b25dd3de admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:52.127112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171054cf-13b5-4e20-805f-a248b25dd3de admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:52.127374 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171054cf-13b5-4e20-805f-a248b25dd3de admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:52.128674 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171054cf-13b5-4e20-805f-a248b25dd3de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:52.130430 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171054cf-13b5-4e20-805f-a248b25dd3de admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:52.132385 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 86/178] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:34:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:52.138639 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0c978-41cf-45e6-89b0-ffeea4777ab7 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:52.148303 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0c978-41cf-45e6-89b0-ffeea4777ab7 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:52.153740 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e29fc-6956-4e9a-bf94-9a19ca595450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:52.154590 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e29fc-6956-4e9a-bf94-9a19ca595450 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:52.154971 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e29fc-6956-4e9a-bf94-9a19ca595450 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:52.155353 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e29fc-6956-4e9a-bf94-9a19ca595450 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:52.156236 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e29fc-6956-4e9a-bf94-9a19ca595450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:52.158315 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e29fc-6956-4e9a-bf94-9a19ca595450 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:52.181493 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 93/179] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Jan 10 12:34:52 2022] POST /identity/v3/users => generated 283 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:34:54.201608 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e97de-aa94-4b39-be6a-9df2392331be None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:54.202135 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e97de-aa94-4b39-be6a-9df2392331be None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:54.202135 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e97de-aa94-4b39-be6a-9df2392331be None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:54.203983 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 87/180] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:54.209416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c675744-17f5-47ae-8253-402486330460 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:54.209821 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c675744-17f5-47ae-8253-402486330460 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:54.209988 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c675744-17f5-47ae-8253-402486330460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:54.228380 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-1c675744-17f5-47ae-8253-402486330460 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:54.229611 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-1c675744-17f5-47ae-8253-402486330460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:54.237272 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 94/181] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:54.261990 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e97de-aa94-4b39-be6a-9df2392331be None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:54.274442 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e97de-aa94-4b39-be6a-9df2392331be None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:54.279261 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34935c6e-a940-47e8-8cfe-42f7e838bf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:54.280113 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34935c6e-a940-47e8-8cfe-42f7e838bf67 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:54.280388 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34935c6e-a940-47e8-8cfe-42f7e838bf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:54.280654 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34935c6e-a940-47e8-8cfe-42f7e838bf67 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:54.293188 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34935c6e-a940-47e8-8cfe-42f7e838bf67 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:54.300313 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-34935c6e-a940-47e8-8cfe-42f7e838bf67 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 12:34:54.301602 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 88/182] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:34:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:54.307935 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c675744-17f5-47ae-8253-402486330460 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:54.317778 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c675744-17f5-47ae-8253-402486330460 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:54.322254 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac967a-7636-42d4-9ce7-86b04b2219c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:54.322930 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac967a-7636-42d4-9ce7-86b04b2219c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:54.323798 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac967a-7636-42d4-9ce7-86b04b2219c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:54.324256 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac967a-7636-42d4-9ce7-86b04b2219c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:54.325050 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac967a-7636-42d4-9ce7-86b04b2219c0 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:54.325357 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac967a-7636-42d4-9ce7-86b04b2219c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:54.327049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac967a-7636-42d4-9ce7-86b04b2219c0 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:54.336440 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 95/183] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:34:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:54.341965 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34935c6e-a940-47e8-8cfe-42f7e838bf67 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:54.352302 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34935c6e-a940-47e8-8cfe-42f7e838bf67 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:54.356742 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276c728-9896-4048-ac17-8a529acf07c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:54.357609 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276c728-9896-4048-ac17-8a529acf07c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:54.357883 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276c728-9896-4048-ac17-8a529acf07c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:54.358149 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276c728-9896-4048-ac17-8a529acf07c9 admin admin] PATH_INFO: `/v3/users/5f69aca2912c4925a32cd6cb45de0115` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:54.359353 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276c728-9896-4048-ac17-8a529acf07c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=5f69aca2912c4925a32cd6cb45de0115)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:54.361550 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276c728-9896-4048-ac17-8a529acf07c9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:54.363354 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 89/184] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:54 2022] GET /identity/v3/users/5f69aca2912c4925a32cd6cb45de0115 => generated 289 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:54.368969 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac967a-7636-42d4-9ce7-86b04b2219c0 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:54.379033 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac967a-7636-42d4-9ce7-86b04b2219c0 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:54.383669 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ac0f6-1707-4e20-9d37-664a9042240a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:54.384369 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ac0f6-1707-4e20-9d37-664a9042240a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:54.384648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ac0f6-1707-4e20-9d37-664a9042240a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:54.384921 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ac0f6-1707-4e20-9d37-664a9042240a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:54.394312 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ac0f6-1707-4e20-9d37-664a9042240a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:54.396419 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ac0f6-1707-4e20-9d37-664a9042240a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:54.407440 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 96/185] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:34:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:34:54.413298 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276c728-9896-4048-ac17-8a529acf07c9 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:54.423670 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276c728-9896-4048-ac17-8a529acf07c9 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:54.428221 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120d0d0-079c-4665-8cb1-dd3c8d4f1115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:54.429299 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120d0d0-079c-4665-8cb1-dd3c8d4f1115 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:54.429577 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120d0d0-079c-4665-8cb1-dd3c8d4f1115 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:54.429843 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120d0d0-079c-4665-8cb1-dd3c8d4f1115 admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:54.431166 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120d0d0-079c-4665-8cb1-dd3c8d4f1115 admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:54.433402 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120d0d0-079c-4665-8cb1-dd3c8d4f1115 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:54.435195 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 90/186] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:54 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:54.441578 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ac0f6-1707-4e20-9d37-664a9042240a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:54.451686 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ac0f6-1707-4e20-9d37-664a9042240a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:54.456074 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70726d-f0c7-407c-8e47-0247284195c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:54.456740 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70726d-f0c7-407c-8e47-0247284195c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:54.457016 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70726d-f0c7-407c-8e47-0247284195c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:54.457288 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70726d-f0c7-407c-8e47-0247284195c2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:54.458142 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70726d-f0c7-407c-8e47-0247284195c2 admin admin] RBAC: Adding query filter params (role.id=86eb0f09cb0e49e1a58d4bfadbf1e9bf, scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e, user.id=5f69aca2912c4925a32cd6cb45de0115) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:54.458451 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70726d-f0c7-407c-8e47-0247284195c2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:54.460363 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70726d-f0c7-407c-8e47-0247284195c2 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:54.467884 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 97/187] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:34:54 2022] GET /identity/v3/role_assignments?user.id=5f69aca2912c4925a32cd6cb45de0115&scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e&role.id=86eb0f09cb0e49e1a58d4bfadbf1e9bf => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:54.762348 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d200c-3ce8-4cac-b318-fc5fd4240d86 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:54.762783 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d200c-3ce8-4cac-b318-fc5fd4240d86 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:54.763279 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d200c-3ce8-4cac-b318-fc5fd4240d86 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:54.765964 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 91/188] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:54.773495 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf838fd0-6acb-4cd6-9032-87f0ebb473a3 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:54.773495 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf838fd0-6acb-4cd6-9032-87f0ebb473a3 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:54.773495 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf838fd0-6acb-4cd6-9032-87f0ebb473a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:54.793339 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-cf838fd0-6acb-4cd6-9032-87f0ebb473a3 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:54.794881 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-cf838fd0-6acb-4cd6-9032-87f0ebb473a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:54.802951 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 98/189] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:54.831290 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d200c-3ce8-4cac-b318-fc5fd4240d86 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:54.844092 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d200c-3ce8-4cac-b318-fc5fd4240d86 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:54.848779 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d63bd1-f7a6-4ec9-b1f3-d3b74d62f78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:54.849582 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d63bd1-f7a6-4ec9-b1f3-d3b74d62f78f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:54.849858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d63bd1-f7a6-4ec9-b1f3-d3b74d62f78f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:54.850133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d63bd1-f7a6-4ec9-b1f3-d3b74d62f78f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:54.863336 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d63bd1-f7a6-4ec9-b1f3-d3b74d62f78f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:54.871161 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-b8d63bd1-f7a6-4ec9-b1f3-d3b74d62f78f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:34:54.872592 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 92/190] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:34:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:54.873326 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f6684-ec51-42ea-97a0-e337d1fe9140 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:54.873613 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f6684-ec51-42ea-97a0-e337d1fe9140 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:54.873976 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f6684-ec51-42ea-97a0-e337d1fe9140 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:54.875827 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 99/191] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:34:54.878881 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d63bd1-f7a6-4ec9-b1f3-d3b74d62f78f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:54.881765 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cf468-27b3-42bc-a308-9864c88187f9 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:54.882065 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cf468-27b3-42bc-a308-9864c88187f9 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:54.882321 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cf468-27b3-42bc-a308-9864c88187f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:54.889972 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d63bd1-f7a6-4ec9-b1f3-d3b74d62f78f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:54.894442 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054162e-c3d3-48a7-9d06-cfc609fe944a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:54.895109 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054162e-c3d3-48a7-9d06-cfc609fe944a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:54.895388 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054162e-c3d3-48a7-9d06-cfc609fe944a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:54.896076 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054162e-c3d3-48a7-9d06-cfc609fe944a admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:54.896461 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054162e-c3d3-48a7-9d06-cfc609fe944a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:54.896769 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054162e-c3d3-48a7-9d06-cfc609fe944a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:54.898444 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054162e-c3d3-48a7-9d06-cfc609fe944a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:54.902780 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-2c7cf468-27b3-42bc-a308-9864c88187f9 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:54.903997 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-2c7cf468-27b3-42bc-a308-9864c88187f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:54.908194 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 93/192] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:34:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:34:54.909504 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd972f41-e516-4cc0-a720-04a23011fd1f None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:54.909779 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd972f41-e516-4cc0-a720-04a23011fd1f None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:54.910053 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd972f41-e516-4cc0-a720-04a23011fd1f None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:54.911898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 94/193] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:54.914045 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 100/194] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:34:54.915666 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd972f41-e516-4cc0-a720-04a23011fd1f None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:54.918363 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f27b72-ed96-4a4b-9ca4-d6094c825ff2 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:54.918867 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f27b72-ed96-4a4b-9ca4-d6094c825ff2 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:54.919286 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f27b72-ed96-4a4b-9ca4-d6094c825ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:54.932636 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd972f41-e516-4cc0-a720-04a23011fd1f None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:54.938417 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3c9bf-c2b3-421f-a9a6-6e9ab78093b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:54.939294 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3c9bf-c2b3-421f-a9a6-6e9ab78093b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:54.940911 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3c9bf-c2b3-421f-a9a6-6e9ab78093b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:54.940911 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a3c9bf-c2b3-421f-a9a6-6e9ab78093b8 admin admin] PATH_INFO: `/v3/users/3d5acdf621e4460980a92f95f6acfde1` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:54.942929 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-76f27b72-ed96-4a4b-9ca4-d6094c825ff2 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:54.944232 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-76f27b72-ed96-4a4b-9ca4-d6094c825ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:54.963897 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 101/195] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:34:54.963897 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f27b72-ed96-4a4b-9ca4-d6094c825ff2 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:54.964516 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3c9bf-c2b3-421f-a9a6-6e9ab78093b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d5acdf621e4460980a92f95f6acfde1)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:54.964516 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a3c9bf-c2b3-421f-a9a6-6e9ab78093b8 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:54.964516 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 95/196] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:54 2022] GET /identity/v3/users/3d5acdf621e4460980a92f95f6acfde1 => generated 283 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:34:54.964690 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f27b72-ed96-4a4b-9ca4-d6094c825ff2 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:54.966026 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3c9bf-c2b3-421f-a9a6-6e9ab78093b8 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:54.969854 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb852d2-c0fa-47ff-a984-d1955c681b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:54.970693 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb852d2-c0fa-47ff-a984-d1955c681b21 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:54.970923 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb852d2-c0fa-47ff-a984-d1955c681b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:54.971187 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb852d2-c0fa-47ff-a984-d1955c681b21 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:54.972905 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb852d2-c0fa-47ff-a984-d1955c681b21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:54.975348 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb852d2-c0fa-47ff-a984-d1955c681b21 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:54.975463 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a3c9bf-c2b3-421f-a9a6-6e9ab78093b8 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:54.978024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 102/197] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:34:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:54.980606 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88183ad3-393d-4391-a722-79b9ef99de6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:54.981246 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88183ad3-393d-4391-a722-79b9ef99de6f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:54.981340 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb852d2-c0fa-47ff-a984-d1955c681b21 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:54.981516 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88183ad3-393d-4391-a722-79b9ef99de6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:54.981782 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88183ad3-393d-4391-a722-79b9ef99de6f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:54.990404 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88183ad3-393d-4391-a722-79b9ef99de6f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:54.991966 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb852d2-c0fa-47ff-a984-d1955c681b21 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:54.992227 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88183ad3-393d-4391-a722-79b9ef99de6f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:54.998214 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdecbdc-ddbc-497d-a267-2e51fd5d22c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:54.999013 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdecbdc-ddbc-497d-a267-2e51fd5d22c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:54.999288 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdecbdc-ddbc-497d-a267-2e51fd5d22c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:54.999587 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdecbdc-ddbc-497d-a267-2e51fd5d22c9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:55.001322 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 96/198] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:34:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 12:34:55.002100 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88183ad3-393d-4391-a722-79b9ef99de6f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:55.011325 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88183ad3-393d-4391-a722-79b9ef99de6f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:55.011772 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdecbdc-ddbc-497d-a267-2e51fd5d22c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:55.015604 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bbc4b-09a6-4503-b4e4-b64c11290999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:55.016261 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bbc4b-09a6-4503-b4e4-b64c11290999 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:55.016538 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bbc4b-09a6-4503-b4e4-b64c11290999 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:55.016807 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bbc4b-09a6-4503-b4e4-b64c11290999 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:55.017531 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032bbc4b-09a6-4503-b4e4-b64c11290999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:55.018562 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-032bbc4b-09a6-4503-b4e4-b64c11290999 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:34:55.018562 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:34:55.018562 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:34:55.019784 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032bbc4b-09a6-4503-b4e4-b64c11290999 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:55.020310 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-8bdecbdc-ddbc-497d-a267-2e51fd5d22c9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 12:34:55.021891 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 103/199] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:34:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:34:55.022345 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdecbdc-ddbc-497d-a267-2e51fd5d22c9 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:55.035545 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdecbdc-ddbc-497d-a267-2e51fd5d22c9 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:55.041701 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb7482-794f-494a-9a3c-47b3ebdeaa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:55.043080 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb7482-794f-494a-9a3c-47b3ebdeaa50 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:55.043379 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb7482-794f-494a-9a3c-47b3ebdeaa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:55.043658 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb7482-794f-494a-9a3c-47b3ebdeaa50 admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:55.044905 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb7482-794f-494a-9a3c-47b3ebdeaa50 admin admin] RBAC: Authorizing `identity:get_project(project_id=098496e4eb9b450d987e89a0eed6c412)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:55.047024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb7482-794f-494a-9a3c-47b3ebdeaa50 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:55.048761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 104/201] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:55 2022] GET /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:55.060851 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 97/201] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Jan 10 12:34:55 2022] POST /identity/v3/users => generated 297 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:34:55.060937 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb7482-794f-494a-9a3c-47b3ebdeaa50 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:55.061009 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb7482-794f-494a-9a3c-47b3ebdeaa50 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:55.062231 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bbc4b-09a6-4503-b4e4-b64c11290999 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:55.065927 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d36073-6868-4b40-941c-46d43cb563e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:55.066640 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d36073-6868-4b40-941c-46d43cb563e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:55.066915 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d36073-6868-4b40-941c-46d43cb563e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:55.067179 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d36073-6868-4b40-941c-46d43cb563e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:55.067997 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d36073-6868-4b40-941c-46d43cb563e1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:55.068296 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d36073-6868-4b40-941c-46d43cb563e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:55.069933 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d36073-6868-4b40-941c-46d43cb563e1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:55.072615 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bbc4b-09a6-4503-b4e4-b64c11290999 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:55.078679 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d060492-93b5-4d82-8066-4f1084073d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:55.079359 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d060492-93b5-4d82-8066-4f1084073d68 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:55.079683 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d060492-93b5-4d82-8066-4f1084073d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:55.079947 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d060492-93b5-4d82-8066-4f1084073d68 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:55.080922 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d060492-93b5-4d82-8066-4f1084073d68 admin admin] RBAC: Adding query filter params (role.id=9d097c033f454263a874fbafe92c9aea, scope.project.id=098496e4eb9b450d987e89a0eed6c412, user.id=3d5acdf621e4460980a92f95f6acfde1) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:55.085825 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d060492-93b5-4d82-8066-4f1084073d68 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:55.086047 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 105/202] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:34:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:55.086131 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d060492-93b5-4d82-8066-4f1084073d68 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:55.089093 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d36073-6868-4b40-941c-46d43cb563e1 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:55.094922 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 98/203] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:34:55 2022] GET /identity/v3/role_assignments?user.id=3d5acdf621e4460980a92f95f6acfde1&scope.project.id=098496e4eb9b450d987e89a0eed6c412&role.id=9d097c033f454263a874fbafe92c9aea => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:55.099401 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d36073-6868-4b40-941c-46d43cb563e1 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:55.105751 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd4a60-22e0-49a9-bdc5-675f33a41cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:55.106962 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd4a60-22e0-49a9-bdc5-675f33a41cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:55.107246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd4a60-22e0-49a9-bdc5-675f33a41cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:55.107541 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd4a60-22e0-49a9-bdc5-675f33a41cf8 admin admin] PATH_INFO: `/v3/users/3d5acdf621e4460980a92f95f6acfde1` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:55.109012 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd4a60-22e0-49a9-bdc5-675f33a41cf8 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d5acdf621e4460980a92f95f6acfde1)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:55.111259 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd4a60-22e0-49a9-bdc5-675f33a41cf8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:55.113388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 106/204] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:55 2022] GET /identity/v3/users/3d5acdf621e4460980a92f95f6acfde1 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:34:55.119362 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d060492-93b5-4d82-8066-4f1084073d68 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:55.134036 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d060492-93b5-4d82-8066-4f1084073d68 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:55.139622 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1582c7-5c31-42b9-b3e6-7c62473a456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:55.140305 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1582c7-5c31-42b9-b3e6-7c62473a456d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:55.140533 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1582c7-5c31-42b9-b3e6-7c62473a456d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:55.140825 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1582c7-5c31-42b9-b3e6-7c62473a456d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:55.150214 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1582c7-5c31-42b9-b3e6-7c62473a456d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:55.152512 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1582c7-5c31-42b9-b3e6-7c62473a456d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:55.163166 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 99/205] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:34:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:34:55.169561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd4a60-22e0-49a9-bdc5-675f33a41cf8 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:55.181399 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd4a60-22e0-49a9-bdc5-675f33a41cf8 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:55.186155 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f1e82-d352-4249-9a24-cb0d1fa1e47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:55.187056 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f1e82-d352-4249-9a24-cb0d1fa1e47f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:55.187330 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f1e82-d352-4249-9a24-cb0d1fa1e47f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:55.187624 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f1e82-d352-4249-9a24-cb0d1fa1e47f admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:55.188926 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f1e82-d352-4249-9a24-cb0d1fa1e47f admin admin] RBAC: Authorizing `identity:get_project(project_id=098496e4eb9b450d987e89a0eed6c412)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:55.191438 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f1e82-d352-4249-9a24-cb0d1fa1e47f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:55.193492 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 107/206] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:55 2022] GET /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:55.199856 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1582c7-5c31-42b9-b3e6-7c62473a456d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:55.209991 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1582c7-5c31-42b9-b3e6-7c62473a456d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:55.215102 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bf121-0994-4de1-8935-22013bafdf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:55.215819 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bf121-0994-4de1-8935-22013bafdf2a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:55.216101 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bf121-0994-4de1-8935-22013bafdf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:55.216374 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bf121-0994-4de1-8935-22013bafdf2a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:55.217240 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bf121-0994-4de1-8935-22013bafdf2a admin admin] RBAC: Adding query filter params (role.id=6d59759e4d584ea688a6c0883ef5d9c6, scope.project.id=098496e4eb9b450d987e89a0eed6c412, user.id=3d5acdf621e4460980a92f95f6acfde1) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:55.217546 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bf121-0994-4de1-8935-22013bafdf2a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:55.219465 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bf121-0994-4de1-8935-22013bafdf2a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:55.226162 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 100/207] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:34:55 2022] GET /identity/v3/role_assignments?user.id=3d5acdf621e4460980a92f95f6acfde1&scope.project.id=098496e4eb9b450d987e89a0eed6c412&role.id=6d59759e4d584ea688a6c0883ef5d9c6 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:57.591457 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efe92d-9a48-4d73-adf1-5a2ad700a169 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.592012 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efe92d-9a48-4d73-adf1-5a2ad700a169 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.592012 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99efe92d-9a48-4d73-adf1-5a2ad700a169 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:57.593829 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 108/208] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:57.599255 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b7cb8-4456-4993-b3f2-9f5d82481192 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.599717 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b7cb8-4456-4993-b3f2-9f5d82481192 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.599884 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b7cb8-4456-4993-b3f2-9f5d82481192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:57.618539 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-241b7cb8-4456-4993-b3f2-9f5d82481192 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:57.619978 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-241b7cb8-4456-4993-b3f2-9f5d82481192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:57.627863 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 101/209] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:57.652479 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efe92d-9a48-4d73-adf1-5a2ad700a169 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:57.656769 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4a2fa-b823-4955-9901-9be1e63e9b63 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.657050 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4a2fa-b823-4955-9901-9be1e63e9b63 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.657320 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4a2fa-b823-4955-9901-9be1e63e9b63 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:57.659111 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 102/210] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:57.664091 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926a6ef-bdf7-495f-9a36-a9c3216f825c None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.664371 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926a6ef-bdf7-495f-9a36-a9c3216f825c None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.664639 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926a6ef-bdf7-495f-9a36-a9c3216f825c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:57.666007 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99efe92d-9a48-4d73-adf1-5a2ad700a169 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:57.670772 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61ad69-0689-43d7-8e50-1f5f24b73cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:57.671610 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61ad69-0689-43d7-8e50-1f5f24b73cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.671889 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61ad69-0689-43d7-8e50-1f5f24b73cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.672159 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61ad69-0689-43d7-8e50-1f5f24b73cc4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:57.682909 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-9926a6ef-bdf7-495f-9a36-a9c3216f825c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:57.684278 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9926a6ef-bdf7-495f-9a36-a9c3216f825c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:57.684416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61ad69-0689-43d7-8e50-1f5f24b73cc4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:57.691600 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-ea61ad69-0689-43d7-8e50-1f5f24b73cc4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:34:57.692099 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 103/211] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:34:57.692811 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 109/212] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:34:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:57.694325 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b443529-78f8-47bf-b8ea-4cbff30de80b None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.694608 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b443529-78f8-47bf-b8ea-4cbff30de80b None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.694878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b443529-78f8-47bf-b8ea-4cbff30de80b None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:57.696832 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 104/213] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:57.697144 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c186d-99a0-42da-9e42-b4a799d83eb9 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.697645 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c186d-99a0-42da-9e42-b4a799d83eb9 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.698002 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c186d-99a0-42da-9e42-b4a799d83eb9 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:57.699995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 110/214] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:34:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:34:57.700501 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b443529-78f8-47bf-b8ea-4cbff30de80b None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:57.702116 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0b55d-3aed-428e-a677-4dec0252a1a2 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.702671 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0b55d-3aed-428e-a677-4dec0252a1a2 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.703264 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0b55d-3aed-428e-a677-4dec0252a1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:57.713676 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b443529-78f8-47bf-b8ea-4cbff30de80b None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:57.717953 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465b1bf-6473-46b4-b823-96a24dbeeb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:57.718612 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465b1bf-6473-46b4-b823-96a24dbeeb39 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.718887 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465b1bf-6473-46b4-b823-96a24dbeeb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.719153 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465b1bf-6473-46b4-b823-96a24dbeeb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:57.719994 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465b1bf-6473-46b4-b823-96a24dbeeb39 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:57.720297 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465b1bf-6473-46b4-b823-96a24dbeeb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:57.721924 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465b1bf-6473-46b4-b823-96a24dbeeb39 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:57.722164 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-8bb0b55d-3aed-428e-a677-4dec0252a1a2 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:57.723358 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-8bb0b55d-3aed-428e-a677-4dec0252a1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:57.730586 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 105/215] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:34:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:57.731200 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 111/216] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:34:57.735854 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0b55d-3aed-428e-a677-4dec0252a1a2 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:57.736481 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ce0bd-03a8-4704-9466-c25c1b115993 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.736767 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ce0bd-03a8-4704-9466-c25c1b115993 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.737040 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ce0bd-03a8-4704-9466-c25c1b115993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:57.747694 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0b55d-3aed-428e-a677-4dec0252a1a2 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:57.751965 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2aa585-e0a3-4842-a086-b604b11272fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:57.752763 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aa585-e0a3-4842-a086-b604b11272fb admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.753043 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aa585-e0a3-4842-a086-b604b11272fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.753311 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aa585-e0a3-4842-a086-b604b11272fb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:57.755393 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-ab0ce0bd-03a8-4704-9466-c25c1b115993 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:34:57.756641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-ab0ce0bd-03a8-4704-9466-c25c1b115993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:34:57.764422 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 106/217] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:34:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:34:57.765110 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2aa585-e0a3-4842-a086-b604b11272fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:57.765231 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ce0bd-03a8-4704-9466-c25c1b115993 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:57.773644 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-8d2aa585-e0a3-4842-a086-b604b11272fb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 12:34:57.774183 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ce0bd-03a8-4704-9466-c25c1b115993 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:57.774872 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 112/218] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:34:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:57.776749 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2aa585-e0a3-4842-a086-b604b11272fb admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:57.778905 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6afee9-2d8d-4bcd-b0dc-638ff3313d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:57.779800 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6afee9-2d8d-4bcd-b0dc-638ff3313d6d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.780076 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6afee9-2d8d-4bcd-b0dc-638ff3313d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.780344 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6afee9-2d8d-4bcd-b0dc-638ff3313d6d admin admin] PATH_INFO: `/v3/users/3d5acdf621e4460980a92f95f6acfde1` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:57.781556 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6afee9-2d8d-4bcd-b0dc-638ff3313d6d admin admin] RBAC: Authorizing `identity:get_user(user_id=3d5acdf621e4460980a92f95f6acfde1)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:57.783743 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6afee9-2d8d-4bcd-b0dc-638ff3313d6d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:57.785352 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 107/219] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:57 2022] GET /identity/v3/users/3d5acdf621e4460980a92f95f6acfde1 => generated 283 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:57.788330 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2aa585-e0a3-4842-a086-b604b11272fb admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:57.788542 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6afee9-2d8d-4bcd-b0dc-638ff3313d6d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:57.792982 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20eecb-8562-4d5c-9875-122f981457cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:57.793758 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20eecb-8562-4d5c-9875-122f981457cf admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.794036 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20eecb-8562-4d5c-9875-122f981457cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.794304 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20eecb-8562-4d5c-9875-122f981457cf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:57.795485 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20eecb-8562-4d5c-9875-122f981457cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:57.797251 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20eecb-8562-4d5c-9875-122f981457cf admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:57.797903 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6afee9-2d8d-4bcd-b0dc-638ff3313d6d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:57.799209 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 113/220] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:34:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:57.799940 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20eecb-8562-4d5c-9875-122f981457cf admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:57.805824 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb4fd6-bacd-4609-941d-cd9f5af021f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:57.806475 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb4fd6-bacd-4609-941d-cd9f5af021f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.806750 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb4fd6-bacd-4609-941d-cd9f5af021f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.807018 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb4fd6-bacd-4609-941d-cd9f5af021f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:57.807848 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb4fd6-bacd-4609-941d-cd9f5af021f6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:57.808153 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb4fd6-bacd-4609-941d-cd9f5af021f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:57.809720 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb4fd6-bacd-4609-941d-cd9f5af021f6 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:57.809955 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20eecb-8562-4d5c-9875-122f981457cf admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:57.814081 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1bf55-dbff-422d-8cce-85d965029503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:57.814807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1bf55-dbff-422d-8cce-85d965029503 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.815441 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1bf55-dbff-422d-8cce-85d965029503 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.815739 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1bf55-dbff-422d-8cce-85d965029503 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:57.818436 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 108/221] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:34:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:57.820378 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb4fd6-bacd-4609-941d-cd9f5af021f6 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:57.825986 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1bf55-dbff-422d-8cce-85d965029503 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:34:57.829648 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb4fd6-bacd-4609-941d-cd9f5af021f6 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:57.833088 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-c5a1bf55-dbff-422d-8cce-85d965029503 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 12:34:57.833854 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6034bd-3e84-414f-83f3-58e4a3028bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:57.834249 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 114/222] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:34:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:34:57.834673 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6034bd-3e84-414f-83f3-58e4a3028bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.834949 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6034bd-3e84-414f-83f3-58e4a3028bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.835044 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1bf55-dbff-422d-8cce-85d965029503 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:57.835283 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6034bd-3e84-414f-83f3-58e4a3028bb5 admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:57.836512 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6034bd-3e84-414f-83f3-58e4a3028bb5 admin admin] RBAC: Authorizing `identity:get_project(project_id=098496e4eb9b450d987e89a0eed6c412)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:57.838578 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6034bd-3e84-414f-83f3-58e4a3028bb5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:57.840393 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 109/223] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:57 2022] GET /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:57.841120 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6034bd-3e84-414f-83f3-58e4a3028bb5 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:57.848748 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1bf55-dbff-422d-8cce-85d965029503 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:57.850032 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6034bd-3e84-414f-83f3-58e4a3028bb5 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:57.852898 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a757b-d63a-4407-8811-0bb4da399024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:57.853544 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a757b-d63a-4407-8811-0bb4da399024 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.853824 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a757b-d63a-4407-8811-0bb4da399024 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.854093 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a757b-d63a-4407-8811-0bb4da399024 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:57.854267 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07464666-f0e2-4aa3-b0ea-2d62abace6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:57.855062 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07464666-f0e2-4aa3-b0ea-2d62abace6cc admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.855159 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a757b-d63a-4407-8811-0bb4da399024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:57.855340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07464666-f0e2-4aa3-b0ea-2d62abace6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.855649 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07464666-f0e2-4aa3-b0ea-2d62abace6cc admin admin] PATH_INFO: `/v3/users/85337d18c9fc4aa1aece0eedfc5d7196` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:57.857003 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a757b-d63a-4407-8811-0bb4da399024 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:57.869674 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07464666-f0e2-4aa3-b0ea-2d62abace6cc admin admin] RBAC: Authorizing `identity:get_user(user_id=85337d18c9fc4aa1aece0eedfc5d7196)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:57.872210 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07464666-f0e2-4aa3-b0ea-2d62abace6cc admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:57.873873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 110/224] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:57 2022] GET /identity/v3/users/85337d18c9fc4aa1aece0eedfc5d7196 => generated 297 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:57.874628 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07464666-f0e2-4aa3-b0ea-2d62abace6cc admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:57.876856 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 115/225] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Jan 10 12:34:57 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:34:57.877503 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a757b-d63a-4407-8811-0bb4da399024 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:57.887710 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07464666-f0e2-4aa3-b0ea-2d62abace6cc admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:57.888810 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a757b-d63a-4407-8811-0bb4da399024 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:57.893048 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7d6cd-92b3-4e67-a0ff-559cf2bd3851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:57.893925 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da9043-3114-497f-8b58-b1ae50ef69b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:57.894185 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7d6cd-92b3-4e67-a0ff-559cf2bd3851 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.894616 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7d6cd-92b3-4e67-a0ff-559cf2bd3851 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.894840 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da9043-3114-497f-8b58-b1ae50ef69b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.895116 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da9043-3114-497f-8b58-b1ae50ef69b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.895310 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7d6cd-92b3-4e67-a0ff-559cf2bd3851 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:57.895424 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da9043-3114-497f-8b58-b1ae50ef69b8 admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412/users/3d5acdf621e4460980a92f95f6acfde1/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:57.896427 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7d6cd-92b3-4e67-a0ff-559cf2bd3851 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:57.896876 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7d6cd-92b3-4e67-a0ff-559cf2bd3851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:57.897775 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da9043-3114-497f-8b58-b1ae50ef69b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098496e4eb9b450d987e89a0eed6c412, user_id=3d5acdf621e4460980a92f95f6acfde1, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:57.898870 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7d6cd-92b3-4e67-a0ff-559cf2bd3851 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:57.900736 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da9043-3114-497f-8b58-b1ae50ef69b8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:57.909797 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 111/226] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:34:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:57.911075 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7d6cd-92b3-4e67-a0ff-559cf2bd3851 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:57.923907 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 116/227] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:34:57 2022] PUT /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412/users/3d5acdf621e4460980a92f95f6acfde1/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:34:57.924938 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7d6cd-92b3-4e67-a0ff-559cf2bd3851 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:57.925359 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da9043-3114-497f-8b58-b1ae50ef69b8 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:57.995645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fd58b-b89f-4869-b0bf-70b9d87e7525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:57.996643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fd58b-b89f-4869-b0bf-70b9d87e7525 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:57.997124 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fd58b-b89f-4869-b0bf-70b9d87e7525 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:57.997540 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fd58b-b89f-4869-b0bf-70b9d87e7525 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:58.007668 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fd58b-b89f-4869-b0bf-70b9d87e7525 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:58.008492 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da9043-3114-497f-8b58-b1ae50ef69b8 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:58.011288 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fd58b-b89f-4869-b0bf-70b9d87e7525 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:58.013393 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bdc90-cdaf-4158-9a07-1fbbeec76c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:58.014405 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bdc90-cdaf-4158-9a07-1fbbeec76c08 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:58.014755 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bdc90-cdaf-4158-9a07-1fbbeec76c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:58.015093 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bdc90-cdaf-4158-9a07-1fbbeec76c08 admin admin] PATH_INFO: `/v3/users/3d5acdf621e4460980a92f95f6acfde1` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:58.016877 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bdc90-cdaf-4158-9a07-1fbbeec76c08 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d5acdf621e4460980a92f95f6acfde1)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:58.020368 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bdc90-cdaf-4158-9a07-1fbbeec76c08 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:58.022487 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 117/228] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:34:57 2022] GET /identity/v3/users/3d5acdf621e4460980a92f95f6acfde1 => generated 283 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:58.023946 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 112/229] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:34:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:34:58.031619 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bdc90-cdaf-4158-9a07-1fbbeec76c08 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:58.032916 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fd58b-b89f-4869-b0bf-70b9d87e7525 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:58.041507 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bdc90-cdaf-4158-9a07-1fbbeec76c08 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:58.043348 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fd58b-b89f-4869-b0bf-70b9d87e7525 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:58.046920 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d19bc6-dfd9-4b05-b55e-e8b0cbf28b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:58.048102 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2087ccd-11a1-4e8f-b742-e51b06f03493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:58.048417 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d19bc6-dfd9-4b05-b55e-e8b0cbf28b82 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:58.048856 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d19bc6-dfd9-4b05-b55e-e8b0cbf28b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:58.049289 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d19bc6-dfd9-4b05-b55e-e8b0cbf28b82 admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:58.049456 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2087ccd-11a1-4e8f-b742-e51b06f03493 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:58.049855 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2087ccd-11a1-4e8f-b742-e51b06f03493 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:58.050218 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2087ccd-11a1-4e8f-b742-e51b06f03493 admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:58.051282 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d19bc6-dfd9-4b05-b55e-e8b0cbf28b82 admin admin] RBAC: Authorizing `identity:get_project(project_id=098496e4eb9b450d987e89a0eed6c412)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:58.051745 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2087ccd-11a1-4e8f-b742-e51b06f03493 admin admin] RBAC: Authorizing `identity:get_project(project_id=098496e4eb9b450d987e89a0eed6c412)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:58.053812 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d19bc6-dfd9-4b05-b55e-e8b0cbf28b82 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:58.054045 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2087ccd-11a1-4e8f-b742-e51b06f03493 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:58.056294 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 113/230] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:58 2022] GET /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:58.056640 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 118/231] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:34:58 2022] GET /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:58.065540 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2087ccd-11a1-4e8f-b742-e51b06f03493 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:58.065945 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d19bc6-dfd9-4b05-b55e-e8b0cbf28b82 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:34:58.075997 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2087ccd-11a1-4e8f-b742-e51b06f03493 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:58.076889 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d19bc6-dfd9-4b05-b55e-e8b0cbf28b82 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:34:58.080626 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de188b44-cddb-4c99-abaf-79561742f5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:58.081389 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de188b44-cddb-4c99-abaf-79561742f5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:58.081754 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de188b44-cddb-4c99-abaf-79561742f5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:58.082094 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de188b44-cddb-4c99-abaf-79561742f5d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:58.082637 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b999f-53b2-490d-89ee-47074d6ec737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:34:58.083098 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de188b44-cddb-4c99-abaf-79561742f5d1 admin admin] RBAC: Adding query filter params (role.id=e4d526676145442ab5838d824be7bf59, scope.project.id=098496e4eb9b450d987e89a0eed6c412, user.id=85337d18c9fc4aa1aece0eedfc5d7196) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:34:58.083475 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de188b44-cddb-4c99-abaf-79561742f5d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:58.084155 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b999f-53b2-490d-89ee-47074d6ec737 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:34:58.084614 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b999f-53b2-490d-89ee-47074d6ec737 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:34:58.085071 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b999f-53b2-490d-89ee-47074d6ec737 admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412/users/3d5acdf621e4460980a92f95f6acfde1/roles/6d59759e4d584ea688a6c0883ef5d9c6` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:34:58.085758 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de188b44-cddb-4c99-abaf-79561742f5d1 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:58.088197 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b999f-53b2-490d-89ee-47074d6ec737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098496e4eb9b450d987e89a0eed6c412, user_id=3d5acdf621e4460980a92f95f6acfde1, role_id=6d59759e4d584ea688a6c0883ef5d9c6)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:34:58.091300 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b999f-53b2-490d-89ee-47074d6ec737 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:34:58.100115 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 114/232] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:34:58 2022] GET /identity/v3/role_assignments?user.id=85337d18c9fc4aa1aece0eedfc5d7196&scope.project.id=098496e4eb9b450d987e89a0eed6c412&role.id=e4d526676145442ab5838d824be7bf59 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:34:58.112270 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 119/233] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:34:58 2022] PUT /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412/users/3d5acdf621e4460980a92f95f6acfde1/roles/6d59759e4d584ea688a6c0883ef5d9c6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:35:00.871409 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f902e-3722-4a52-a6d8-8fbe110ac2db None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:00.871943 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f902e-3722-4a52-a6d8-8fbe110ac2db None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:00.872015 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f902e-3722-4a52-a6d8-8fbe110ac2db None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:00.874024 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 115/234] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:00.879260 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a571ea-db86-413c-bbd4-f5ab39e0cbb3 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:00.879683 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a571ea-db86-413c-bbd4-f5ab39e0cbb3 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:00.879845 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a571ea-db86-413c-bbd4-f5ab39e0cbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:00.898204 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-d7a571ea-db86-413c-bbd4-f5ab39e0cbb3 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:00.899402 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d7a571ea-db86-413c-bbd4-f5ab39e0cbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:00.959959 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 120/235] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:00.984642 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f902e-3722-4a52-a6d8-8fbe110ac2db None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:00.998888 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f902e-3722-4a52-a6d8-8fbe110ac2db None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.003195 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510f04a-32f1-4a42-9d6f-9a466bda4446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.004019 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510f04a-32f1-4a42-9d6f-9a466bda4446 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.004299 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510f04a-32f1-4a42-9d6f-9a466bda4446 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.004571 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510f04a-32f1-4a42-9d6f-9a466bda4446 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.015338 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510f04a-32f1-4a42-9d6f-9a466bda4446 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:01.022142 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-f510f04a-32f1-4a42-9d6f-9a466bda4446 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:35:01.023363 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 116/236] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:35:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:01.029382 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a571ea-db86-413c-bbd4-f5ab39e0cbb3 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.038566 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a571ea-db86-413c-bbd4-f5ab39e0cbb3 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.043234 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad0ef5-b53b-419c-8efa-2dda1672ea80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.043950 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad0ef5-b53b-419c-8efa-2dda1672ea80 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.044231 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad0ef5-b53b-419c-8efa-2dda1672ea80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.044500 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad0ef5-b53b-419c-8efa-2dda1672ea80 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.045287 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad0ef5-b53b-419c-8efa-2dda1672ea80 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:01.045594 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad0ef5-b53b-419c-8efa-2dda1672ea80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.047220 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad0ef5-b53b-419c-8efa-2dda1672ea80 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.056308 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 121/237] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:01.062226 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510f04a-32f1-4a42-9d6f-9a466bda4446 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.073219 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510f04a-32f1-4a42-9d6f-9a466bda4446 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.077657 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809cf05-525c-4e44-aacd-8154035cba36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.078523 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809cf05-525c-4e44-aacd-8154035cba36 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.078800 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809cf05-525c-4e44-aacd-8154035cba36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.079066 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809cf05-525c-4e44-aacd-8154035cba36 admin admin] PATH_INFO: `/v3/users/3d5acdf621e4460980a92f95f6acfde1` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.080310 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809cf05-525c-4e44-aacd-8154035cba36 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d5acdf621e4460980a92f95f6acfde1)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.082454 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809cf05-525c-4e44-aacd-8154035cba36 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.084162 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 117/238] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/users/3d5acdf621e4460980a92f95f6acfde1 => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:01.090275 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad0ef5-b53b-419c-8efa-2dda1672ea80 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.100258 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad0ef5-b53b-419c-8efa-2dda1672ea80 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.104702 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba28b7e-ee68-44a5-86d1-c7da67668840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.105360 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba28b7e-ee68-44a5-86d1-c7da67668840 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.105642 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba28b7e-ee68-44a5-86d1-c7da67668840 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.105913 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba28b7e-ee68-44a5-86d1-c7da67668840 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.114318 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba28b7e-ee68-44a5-86d1-c7da67668840 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.116148 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba28b7e-ee68-44a5-86d1-c7da67668840 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.121412 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a327743-020c-4e42-926b-bffa9e5f679b None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.121673 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a327743-020c-4e42-926b-bffa9e5f679b None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.122516 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a327743-020c-4e42-926b-bffa9e5f679b None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.124657 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 118/239] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:01.132293 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 122/240] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 12:35:01.134636 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a500f98-2fb6-44ce-81f7-13d2ec5addc6 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.134636 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a500f98-2fb6-44ce-81f7-13d2ec5addc6 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.134636 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a500f98-2fb6-44ce-81f7-13d2ec5addc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.141202 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4268ee-e45d-4b00-8fa9-a9828ff8f7e9 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.141488 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4268ee-e45d-4b00-8fa9-a9828ff8f7e9 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.141761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4268ee-e45d-4b00-8fa9-a9828ff8f7e9 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.143582 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 123/241] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:01.149639 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b7964-7522-48d3-85d8-d4784b9d9206 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.150004 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b7964-7522-48d3-85d8-d4784b9d9206 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.150348 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b7964-7522-48d3-85d8-d4784b9d9206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.160384 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-6a500f98-2fb6-44ce-81f7-13d2ec5addc6 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:01.162048 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-6a500f98-2fb6-44ce-81f7-13d2ec5addc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:01.168924 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-fd3b7964-7522-48d3-85d8-d4784b9d9206 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:01.170083 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-fd3b7964-7522-48d3-85d8-d4784b9d9206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:01.171787 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 119/242] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:01.175550 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a500f98-2fb6-44ce-81f7-13d2ec5addc6 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.181596 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 124/243] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:35:01.185447 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a500f98-2fb6-44ce-81f7-13d2ec5addc6 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.187045 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1e897-e470-4565-9d05-a4e0738c5e0e None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.187598 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1e897-e470-4565-9d05-a4e0738c5e0e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.188115 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1e897-e470-4565-9d05-a4e0738c5e0e None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.190426 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b711026-a2f0-480e-88f1-c80f5de59021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.190749 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 125/244] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:01.191458 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b711026-a2f0-480e-88f1-c80f5de59021 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.191860 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b711026-a2f0-480e-88f1-c80f5de59021 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.192243 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b711026-a2f0-480e-88f1-c80f5de59021 admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.192466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6df2f-136c-4361-bca8-c588f789db81 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.192987 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6df2f-136c-4361-bca8-c588f789db81 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.193396 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6df2f-136c-4361-bca8-c588f789db81 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.193810 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b711026-a2f0-480e-88f1-c80f5de59021 admin admin] RBAC: Authorizing `identity:get_project(project_id=098496e4eb9b450d987e89a0eed6c412)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.195295 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 126/245] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:01.199283 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b711026-a2f0-480e-88f1-c80f5de59021 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.199283 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 120/246] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:01.199283 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d2a2a-473e-4dcd-9096-7b3387cb0b8a None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.199897 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d2a2a-473e-4dcd-9096-7b3387cb0b8a None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.200342 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d2a2a-473e-4dcd-9096-7b3387cb0b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.203058 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d728c-a6e8-4043-8c9f-c30985a2f37b None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.203343 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d728c-a6e8-4043-8c9f-c30985a2f37b None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.203886 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d728c-a6e8-4043-8c9f-c30985a2f37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.219426 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-c27d2a2a-473e-4dcd-9096-7b3387cb0b8a None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:01.220689 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-c27d2a2a-473e-4dcd-9096-7b3387cb0b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:01.221300 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-f16d728c-a6e8-4043-8c9f-c30985a2f37b None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:01.222448 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f16d728c-a6e8-4043-8c9f-c30985a2f37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:01.228237 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 121/247] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:01.229110 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d2a2a-473e-4dcd-9096-7b3387cb0b8a None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.230777 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 127/248] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:35:01.232395 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d728c-a6e8-4043-8c9f-c30985a2f37b None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.238231 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d2a2a-473e-4dcd-9096-7b3387cb0b8a None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.242690 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e82dc-5225-4c22-8f40-0de4b37c3585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.243038 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e82dc-5225-4c22-8f40-0de4b37c3585 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.243314 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e82dc-5225-4c22-8f40-0de4b37c3585 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.243618 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e82dc-5225-4c22-8f40-0de4b37c3585 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.244456 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e82dc-5225-4c22-8f40-0de4b37c3585 admin admin] RBAC: Adding query filter params (role.id=9d097c033f454263a874fbafe92c9aea, scope.project.id=098496e4eb9b450d987e89a0eed6c412, user.id=3d5acdf621e4460980a92f95f6acfde1) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:01.244812 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e82dc-5225-4c22-8f40-0de4b37c3585 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.246761 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e82dc-5225-4c22-8f40-0de4b37c3585 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.247768 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d728c-a6e8-4043-8c9f-c30985a2f37b None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.255658 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 122/249] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/role_assignments?user.id=3d5acdf621e4460980a92f95f6acfde1&scope.project.id=098496e4eb9b450d987e89a0eed6c412&role.id=9d097c033f454263a874fbafe92c9aea => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:01.255658 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e82dc-5225-4c22-8f40-0de4b37c3585 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.256208 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4768dd-2aa9-4ee2-9f94-754076cf40fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.257023 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4768dd-2aa9-4ee2-9f94-754076cf40fb admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.257299 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4768dd-2aa9-4ee2-9f94-754076cf40fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.257564 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4768dd-2aa9-4ee2-9f94-754076cf40fb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.265438 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e82dc-5225-4c22-8f40-0de4b37c3585 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.270327 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4768dd-2aa9-4ee2-9f94-754076cf40fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:01.272516 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614142a7-fdf8-4642-93f6-8716749c3a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.273337 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614142a7-fdf8-4642-93f6-8716749c3a08 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.273618 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614142a7-fdf8-4642-93f6-8716749c3a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.273887 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614142a7-fdf8-4642-93f6-8716749c3a08 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.277856 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-fa4768dd-2aa9-4ee2-9f94-754076cf40fb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 12:35:01.279309 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 128/250] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:01.280060 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4768dd-2aa9-4ee2-9f94-754076cf40fb admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.290526 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4768dd-2aa9-4ee2-9f94-754076cf40fb admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.291464 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614142a7-fdf8-4642-93f6-8716749c3a08 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:01.295383 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0589a7-ee8e-4bc1-8acf-4eeefe825884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.296240 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0589a7-ee8e-4bc1-8acf-4eeefe825884 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.296527 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0589a7-ee8e-4bc1-8acf-4eeefe825884 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.296796 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0589a7-ee8e-4bc1-8acf-4eeefe825884 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.298771 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-614142a7-fdf8-4642-93f6-8716749c3a08 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 12:35:01.304715 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 123/251] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:01.304715 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614142a7-fdf8-4642-93f6-8716749c3a08 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.313668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0589a7-ee8e-4bc1-8acf-4eeefe825884 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:01.314544 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614142a7-fdf8-4642-93f6-8716749c3a08 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.319266 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43886ae2-5d07-4fcf-abb1-0be8782935bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.320115 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43886ae2-5d07-4fcf-abb1-0be8782935bf admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.320394 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43886ae2-5d07-4fcf-abb1-0be8782935bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.320659 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43886ae2-5d07-4fcf-abb1-0be8782935bf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.321380 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-4f0589a7-ee8e-4bc1-8acf-4eeefe825884 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 12:35:01.321894 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43886ae2-5d07-4fcf-abb1-0be8782935bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.322943 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 129/252] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:01.323887 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0589a7-ee8e-4bc1-8acf-4eeefe825884 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.325160 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43886ae2-5d07-4fcf-abb1-0be8782935bf admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.327670 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 124/253] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:01.328779 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43886ae2-5d07-4fcf-abb1-0be8782935bf admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.338436 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0589a7-ee8e-4bc1-8acf-4eeefe825884 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.339061 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43886ae2-5d07-4fcf-abb1-0be8782935bf admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.343489 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23084a57-9304-4f0a-b867-84962ebae21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.343817 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b8cb8-26dc-4343-8d5f-ae9b5825a1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.344267 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23084a57-9304-4f0a-b867-84962ebae21c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.344462 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b8cb8-26dc-4343-8d5f-ae9b5825a1be admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.344576 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23084a57-9304-4f0a-b867-84962ebae21c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.344739 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b8cb8-26dc-4343-8d5f-ae9b5825a1be admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.344834 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23084a57-9304-4f0a-b867-84962ebae21c admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.345009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b8cb8-26dc-4343-8d5f-ae9b5825a1be admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.345575 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23084a57-9304-4f0a-b867-84962ebae21c admin admin] RBAC: Adding query filter params (name=member) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:01.345808 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b8cb8-26dc-4343-8d5f-ae9b5825a1be admin admin] RBAC: Adding query filter params (name=reader) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:01.345900 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23084a57-9304-4f0a-b867-84962ebae21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.346114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b8cb8-26dc-4343-8d5f-ae9b5825a1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.347661 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23084a57-9304-4f0a-b867-84962ebae21c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.347767 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b8cb8-26dc-4343-8d5f-ae9b5825a1be admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.357226 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 130/254] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:01.358445 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 125/255] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:01.360532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23084a57-9304-4f0a-b867-84962ebae21c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.361569 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b8cb8-26dc-4343-8d5f-ae9b5825a1be admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.372388 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b8cb8-26dc-4343-8d5f-ae9b5825a1be admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.376744 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3a64d-fe2a-459d-bd0e-6af9e65f6119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.376896 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23084a57-9304-4f0a-b867-84962ebae21c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.377432 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a64d-fe2a-459d-bd0e-6af9e65f6119 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.377699 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a64d-fe2a-459d-bd0e-6af9e65f6119 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.378071 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a64d-fe2a-459d-bd0e-6af9e65f6119 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.378811 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3a64d-fe2a-459d-bd0e-6af9e65f6119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.380790 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3a64d-fe2a-459d-bd0e-6af9e65f6119 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.381276 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa7f2f-baad-460d-adf7-d4fc11b01911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.381962 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa7f2f-baad-460d-adf7-d4fc11b01911 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.382245 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa7f2f-baad-460d-adf7-d4fc11b01911 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.382521 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa7f2f-baad-460d-adf7-d4fc11b01911 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.383302 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa7f2f-baad-460d-adf7-d4fc11b01911 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:01.383638 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa7f2f-baad-460d-adf7-d4fc11b01911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.385273 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafa7f2f-baad-460d-adf7-d4fc11b01911 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.400808 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 131/256] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:01.400808 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa7f2f-baad-460d-adf7-d4fc11b01911 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.407689 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 126/257] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Jan 10 12:35:01 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:35:01.410351 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafa7f2f-baad-460d-adf7-d4fc11b01911 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.416914 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1d3d5-8694-4b56-9c33-36427ddeef91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.417923 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1d3d5-8694-4b56-9c33-36427ddeef91 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.418199 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1d3d5-8694-4b56-9c33-36427ddeef91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.418470 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1d3d5-8694-4b56-9c33-36427ddeef91 admin admin] PATH_INFO: `/v3/users/85337d18c9fc4aa1aece0eedfc5d7196` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.420016 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1d3d5-8694-4b56-9c33-36427ddeef91 admin admin] RBAC: Authorizing `identity:get_user(user_id=85337d18c9fc4aa1aece0eedfc5d7196)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.420902 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3a64d-fe2a-459d-bd0e-6af9e65f6119 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.422505 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1d3d5-8694-4b56-9c33-36427ddeef91 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.429493 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 132/258] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/users/85337d18c9fc4aa1aece0eedfc5d7196 => generated 297 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:01.430560 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1d3d5-8694-4b56-9c33-36427ddeef91 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.433726 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3a64d-fe2a-459d-bd0e-6af9e65f6119 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.439014 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201236f-ede1-4934-9a1e-e8073e94ed2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.440728 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201236f-ede1-4934-9a1e-e8073e94ed2c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.441215 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201236f-ede1-4934-9a1e-e8073e94ed2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.441657 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1d3d5-8694-4b56-9c33-36427ddeef91 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.441926 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201236f-ede1-4934-9a1e-e8073e94ed2c admin admin] PATH_INFO: `/v3/users/788d8d5887e74631a2f129fddc639151` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.448014 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6c799-507e-40bd-b9df-b80c7b0479cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.450147 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6c799-507e-40bd-b9df-b80c7b0479cd admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.450600 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6c799-507e-40bd-b9df-b80c7b0479cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.451037 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6c799-507e-40bd-b9df-b80c7b0479cd admin admin] PATH_INFO: `/v3/users/3d5acdf621e4460980a92f95f6acfde1` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.452679 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6c799-507e-40bd-b9df-b80c7b0479cd admin admin] RBAC: Authorizing `identity:get_user(user_id=3d5acdf621e4460980a92f95f6acfde1)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.455000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6c799-507e-40bd-b9df-b80c7b0479cd admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.456871 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 133/259] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/users/3d5acdf621e4460980a92f95f6acfde1 => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:01.457742 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6c799-507e-40bd-b9df-b80c7b0479cd admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.462177 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201236f-ede1-4934-9a1e-e8073e94ed2c admin admin] RBAC: Authorizing `identity:get_user(user_id=788d8d5887e74631a2f129fddc639151)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.465267 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201236f-ede1-4934-9a1e-e8073e94ed2c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.471956 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6c799-507e-40bd-b9df-b80c7b0479cd admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.472160 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 127/260] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/users/788d8d5887e74631a2f129fddc639151 => generated 297 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:01.472688 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201236f-ede1-4934-9a1e-e8073e94ed2c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.478947 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4b9ab-15bc-4aa0-bb25-925ef624bb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.480455 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4b9ab-15bc-4aa0-bb25-925ef624bb96 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.480960 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4b9ab-15bc-4aa0-bb25-925ef624bb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.481427 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4b9ab-15bc-4aa0-bb25-925ef624bb96 admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.483159 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4b9ab-15bc-4aa0-bb25-925ef624bb96 admin admin] RBAC: Authorizing `identity:get_project(project_id=098496e4eb9b450d987e89a0eed6c412)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.483824 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201236f-ede1-4934-9a1e-e8073e94ed2c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.486403 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4b9ab-15bc-4aa0-bb25-925ef624bb96 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.488721 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033a9db-1289-4b2c-b74f-3519281c5289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.489450 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033a9db-1289-4b2c-b74f-3519281c5289 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.489875 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033a9db-1289-4b2c-b74f-3519281c5289 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.490024 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033a9db-1289-4b2c-b74f-3519281c5289 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.490205 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 134/261] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:01.491387 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4b9ab-15bc-4aa0-bb25-925ef624bb96 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.503056 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4b9ab-15bc-4aa0-bb25-925ef624bb96 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.505441 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033a9db-1289-4b2c-b74f-3519281c5289 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.507315 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033a9db-1289-4b2c-b74f-3519281c5289 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.508433 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97966a92-cb40-4a33-84ad-11938cb946ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.509176 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97966a92-cb40-4a33-84ad-11938cb946ca admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.510290 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97966a92-cb40-4a33-84ad-11938cb946ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.510704 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97966a92-cb40-4a33-84ad-11938cb946ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.518312 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 128/262] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:01.519204 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033a9db-1289-4b2c-b74f-3519281c5289 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.524670 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97966a92-cb40-4a33-84ad-11938cb946ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.526754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97966a92-cb40-4a33-84ad-11938cb946ca admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.529056 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033a9db-1289-4b2c-b74f-3519281c5289 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.534812 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f30bf9-a691-430e-828a-c91ff8761709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.535831 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f30bf9-a691-430e-828a-c91ff8761709 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.536168 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f30bf9-a691-430e-828a-c91ff8761709 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.536503 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f30bf9-a691-430e-828a-c91ff8761709 admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412/users/85337d18c9fc4aa1aece0eedfc5d7196/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.538228 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 135/263] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:01.538654 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f30bf9-a691-430e-828a-c91ff8761709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098496e4eb9b450d987e89a0eed6c412, user_id=85337d18c9fc4aa1aece0eedfc5d7196, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.541439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f30bf9-a691-430e-828a-c91ff8761709 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.543823 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97966a92-cb40-4a33-84ad-11938cb946ca admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.554822 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97966a92-cb40-4a33-84ad-11938cb946ca admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.558669 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 129/264] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:35:01 2022] PUT /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412/users/85337d18c9fc4aa1aece0eedfc5d7196/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:35:01.559399 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f30bf9-a691-430e-828a-c91ff8761709 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.628800 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9d7c3-f934-4262-bb04-47716abe1cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.629812 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d7c3-f934-4262-bb04-47716abe1cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.630178 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d7c3-f934-4262-bb04-47716abe1cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.630515 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d7c3-f934-4262-bb04-47716abe1cd5 admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.631947 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9d7c3-f934-4262-bb04-47716abe1cd5 admin admin] RBAC: Authorizing `identity:get_project(project_id=098496e4eb9b450d987e89a0eed6c412)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.634057 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9d7c3-f934-4262-bb04-47716abe1cd5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.636674 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 136/265] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412 => generated 302 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:01.642976 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9d7c3-f934-4262-bb04-47716abe1cd5 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.653399 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9d7c3-f934-4262-bb04-47716abe1cd5 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.659473 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710c4a5-5835-4efb-9a42-5df6e9ba4486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.660191 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710c4a5-5835-4efb-9a42-5df6e9ba4486 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.660471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710c4a5-5835-4efb-9a42-5df6e9ba4486 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.660741 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710c4a5-5835-4efb-9a42-5df6e9ba4486 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.661611 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710c4a5-5835-4efb-9a42-5df6e9ba4486 admin admin] RBAC: Adding query filter params (role.id=6d59759e4d584ea688a6c0883ef5d9c6, scope.project.id=098496e4eb9b450d987e89a0eed6c412, user.id=3d5acdf621e4460980a92f95f6acfde1) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:01.661920 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710c4a5-5835-4efb-9a42-5df6e9ba4486 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.664017 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710c4a5-5835-4efb-9a42-5df6e9ba4486 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.670019 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f30bf9-a691-430e-828a-c91ff8761709 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.670644 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 137/266] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/role_assignments?user.id=3d5acdf621e4460980a92f95f6acfde1&scope.project.id=098496e4eb9b450d987e89a0eed6c412&role.id=6d59759e4d584ea688a6c0883ef5d9c6 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:01.679755 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e7ed9-7d30-48d1-82cb-3895479410aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.680999 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e7ed9-7d30-48d1-82cb-3895479410aa admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.681460 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e7ed9-7d30-48d1-82cb-3895479410aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.681752 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e7ed9-7d30-48d1-82cb-3895479410aa admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.683643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e7ed9-7d30-48d1-82cb-3895479410aa admin admin] RBAC: Authorizing `identity:get_project(project_id=098496e4eb9b450d987e89a0eed6c412)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.685944 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e7ed9-7d30-48d1-82cb-3895479410aa admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.688004 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 130/267] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412 => generated 302 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:01.694761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710c4a5-5835-4efb-9a42-5df6e9ba4486 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:01.713269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710c4a5-5835-4efb-9a42-5df6e9ba4486 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:01.718978 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f4e6d-b968-4e6a-8256-bae80eec52af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:01.720115 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f4e6d-b968-4e6a-8256-bae80eec52af admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:01.720541 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f4e6d-b968-4e6a-8256-bae80eec52af admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:01.720988 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f4e6d-b968-4e6a-8256-bae80eec52af admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:01.722159 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f4e6d-b968-4e6a-8256-bae80eec52af admin admin] RBAC: Adding query filter params (role.id=86eb0f09cb0e49e1a58d4bfadbf1e9bf, scope.project.id=098496e4eb9b450d987e89a0eed6c412, user.id=788d8d5887e74631a2f129fddc639151) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:01.722630 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f4e6d-b968-4e6a-8256-bae80eec52af admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:01.724802 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f4e6d-b968-4e6a-8256-bae80eec52af admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:01.732031 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 138/268] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:01 2022] GET /identity/v3/role_assignments?user.id=788d8d5887e74631a2f129fddc639151&scope.project.id=098496e4eb9b450d987e89a0eed6c412&role.id=86eb0f09cb0e49e1a58d4bfadbf1e9bf => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:04.073807 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cade1-edbb-4e3d-9696-fb19955d47b5 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.074310 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cade1-edbb-4e3d-9696-fb19955d47b5 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.074310 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cade1-edbb-4e3d-9696-fb19955d47b5 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.075987 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 131/269] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:04.081281 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8a3b5-da4e-4524-9168-45da018cb52b None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.081686 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8a3b5-da4e-4524-9168-45da018cb52b None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.081852 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8a3b5-da4e-4524-9168-45da018cb52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.099987 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-a1f8a3b5-da4e-4524-9168-45da018cb52b None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:04.101174 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-a1f8a3b5-da4e-4524-9168-45da018cb52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:04.108915 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 139/270] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:35:04.118756 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4de6b-d216-4d83-b7a2-813c0b3dda95 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.119042 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4de6b-d216-4d83-b7a2-813c0b3dda95 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.119316 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4de6b-d216-4d83-b7a2-813c0b3dda95 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.121467 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 132/271] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:04.126616 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbc7e4-30e2-4c04-a88c-203c00593bd7 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.126900 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbc7e4-30e2-4c04-a88c-203c00593bd7 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.127178 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbc7e4-30e2-4c04-a88c-203c00593bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.137783 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4de6b-d216-4d83-b7a2-813c0b3dda95 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:04.145858 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-18dbc7e4-30e2-4c04-a88c-203c00593bd7 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:04.147047 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-18dbc7e4-30e2-4c04-a88c-203c00593bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:04.159548 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 140/272] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:04.163168 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4de6b-d216-4d83-b7a2-813c0b3dda95 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:04.167754 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff32195-e27f-4dc7-a423-86a7bef97fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:04.168772 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff32195-e27f-4dc7-a423-86a7bef97fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.169195 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff32195-e27f-4dc7-a423-86a7bef97fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.169608 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff32195-e27f-4dc7-a423-86a7bef97fb3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.171600 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5da11-2509-4a8e-bc39-1506467a7830 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.171893 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5da11-2509-4a8e-bc39-1506467a7830 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.172164 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5da11-2509-4a8e-bc39-1506467a7830 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.173950 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 141/273] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:35:04.179121 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dc851-ba11-4036-8af4-ea3dcd599bb4 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.179427 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dc851-ba11-4036-8af4-ea3dcd599bb4 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.179729 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434dc851-ba11-4036-8af4-ea3dcd599bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.182237 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff32195-e27f-4dc7-a423-86a7bef97fb3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:04.189251 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-4ff32195-e27f-4dc7-a423-86a7bef97fb3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 12:35:04.190925 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 133/274] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:04.191576 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff32195-e27f-4dc7-a423-86a7bef97fb3 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:04.198411 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-434dc851-ba11-4036-8af4-ea3dcd599bb4 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:04.199622 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-434dc851-ba11-4036-8af4-ea3dcd599bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:04.201310 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff32195-e27f-4dc7-a423-86a7bef97fb3 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:04.205701 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a57d83-13c4-49b4-9a7f-75fa772a91a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:04.206470 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a57d83-13c4-49b4-9a7f-75fa772a91a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.206745 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a57d83-13c4-49b4-9a7f-75fa772a91a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.207009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a57d83-13c4-49b4-9a7f-75fa772a91a0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.207224 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 142/275] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:35:04.212469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434dc851-ba11-4036-8af4-ea3dcd599bb4 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:04.218497 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a57d83-13c4-49b4-9a7f-75fa772a91a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:04.221951 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434dc851-ba11-4036-8af4-ea3dcd599bb4 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:04.225575 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-a4a57d83-13c4-49b4-9a7f-75fa772a91a0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 12:35:04.226276 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2444d-be7e-4dcc-b4ab-a770eef514a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:04.226905 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 134/276] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:04.227008 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2444d-be7e-4dcc-b4ab-a770eef514a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.230799 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2444d-be7e-4dcc-b4ab-a770eef514a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.230799 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2444d-be7e-4dcc-b4ab-a770eef514a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.231000 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cbf65-3c19-40a4-8c90-59de549972ec None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.231073 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2444d-be7e-4dcc-b4ab-a770eef514a0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:04.231150 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cbf65-3c19-40a4-8c90-59de549972ec None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.231150 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cbf65-3c19-40a4-8c90-59de549972ec None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.231280 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2444d-be7e-4dcc-b4ab-a770eef514a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:04.231280 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2444d-be7e-4dcc-b4ab-a770eef514a0 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:04.231397 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 135/277] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:04.234456 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cbf65-3c19-40a4-8c90-59de549972ec None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:04.239344 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 143/278] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:35:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:04.240017 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2444d-be7e-4dcc-b4ab-a770eef514a0 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:04.248255 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cbf65-3c19-40a4-8c90-59de549972ec None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:04.249158 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2444d-be7e-4dcc-b4ab-a770eef514a0 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:04.252804 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ff991-ffb4-4f7f-86b9-b695ea633180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:04.253321 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6382b5-b4fe-4f9a-b988-79415b8072a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:04.253580 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ff991-ffb4-4f7f-86b9-b695ea633180 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.253860 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ff991-ffb4-4f7f-86b9-b695ea633180 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.253945 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6382b5-b4fe-4f9a-b988-79415b8072a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.254129 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ff991-ffb4-4f7f-86b9-b695ea633180 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.254215 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6382b5-b4fe-4f9a-b988-79415b8072a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.254481 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6382b5-b4fe-4f9a-b988-79415b8072a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.255237 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6382b5-b4fe-4f9a-b988-79415b8072a9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:04.255381 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ff991-ffb4-4f7f-86b9-b695ea633180 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:04.255561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6382b5-b4fe-4f9a-b988-79415b8072a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:04.257129 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ff991-ffb4-4f7f-86b9-b695ea633180 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:04.257245 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6382b5-b4fe-4f9a-b988-79415b8072a9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:04.258873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 136/279] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:04.260273 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc32d1-f70e-47e8-b16b-04f3f37a9bde None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.260557 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc32d1-f70e-47e8-b16b-04f3f37a9bde None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.260818 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc32d1-f70e-47e8-b16b-04f3f37a9bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.266204 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 144/280] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:35:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:04.267055 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6382b5-b4fe-4f9a-b988-79415b8072a9 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:04.276382 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6382b5-b4fe-4f9a-b988-79415b8072a9 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:04.279389 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-60cc32d1-f70e-47e8-b16b-04f3f37a9bde None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:04.280619 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-60cc32d1-f70e-47e8-b16b-04f3f37a9bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:04.281063 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d4dcf-3e79-4dcc-b164-038a936a75c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:04.281892 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d4dcf-3e79-4dcc-b164-038a936a75c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.282166 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d4dcf-3e79-4dcc-b164-038a936a75c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.282446 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d4dcf-3e79-4dcc-b164-038a936a75c2 admin admin] PATH_INFO: `/v3/users/85337d18c9fc4aa1aece0eedfc5d7196` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.283665 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d4dcf-3e79-4dcc-b164-038a936a75c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=85337d18c9fc4aa1aece0eedfc5d7196)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:04.285830 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d4dcf-3e79-4dcc-b164-038a936a75c2 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:04.287379 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 145/281] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:35:04 2022] GET /identity/v3/users/85337d18c9fc4aa1aece0eedfc5d7196 => generated 297 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:04.288275 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d4dcf-3e79-4dcc-b164-038a936a75c2 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:04.288393 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 137/282] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:04.289019 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc32d1-f70e-47e8-b16b-04f3f37a9bde None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:04.297796 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d4dcf-3e79-4dcc-b164-038a936a75c2 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:04.298443 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc32d1-f70e-47e8-b16b-04f3f37a9bde None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:04.302597 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0da8c-5bce-41ed-a44e-34467dc1a574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:04.303235 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0da8c-5bce-41ed-a44e-34467dc1a574 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.303537 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0da8c-5bce-41ed-a44e-34467dc1a574 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.303814 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0da8c-5bce-41ed-a44e-34467dc1a574 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.304524 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0da8c-5bce-41ed-a44e-34467dc1a574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:04.304956 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80ab1c-ade6-458d-86d9-8e677cedc3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:04.306021 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80ab1c-ade6-458d-86d9-8e677cedc3ab admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.306414 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0da8c-5bce-41ed-a44e-34467dc1a574 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:04.306712 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80ab1c-ade6-458d-86d9-8e677cedc3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.307197 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80ab1c-ade6-458d-86d9-8e677cedc3ab admin admin] PATH_INFO: `/v3/users/3ce267580b214b7f9b985ca3befc4d1b` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.322960 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80ab1c-ade6-458d-86d9-8e677cedc3ab admin admin] RBAC: Authorizing `identity:get_user(user_id=3ce267580b214b7f9b985ca3befc4d1b)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:04.325206 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80ab1c-ade6-458d-86d9-8e677cedc3ab admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:04.327015 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 138/283] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:35:04 2022] GET /identity/v3/users/3ce267580b214b7f9b985ca3befc4d1b => generated 293 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:04.327138 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 146/284] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Jan 10 12:35:04 2022] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:35:04.327724 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80ab1c-ade6-458d-86d9-8e677cedc3ab admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:04.327840 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0da8c-5bce-41ed-a44e-34467dc1a574 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:04.337345 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0da8c-5bce-41ed-a44e-34467dc1a574 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:04.337540 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80ab1c-ade6-458d-86d9-8e677cedc3ab admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:04.342224 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d8691-b851-4a48-b607-fdf28cd65594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:04.342850 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80eedc3-f918-4a33-96ac-3045aaf023af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:04.342972 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d8691-b851-4a48-b607-fdf28cd65594 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.343167 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d8691-b851-4a48-b607-fdf28cd65594 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.343442 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d8691-b851-4a48-b607-fdf28cd65594 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.344412 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80eedc3-f918-4a33-96ac-3045aaf023af admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.344924 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80eedc3-f918-4a33-96ac-3045aaf023af admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.345410 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80eedc3-f918-4a33-96ac-3045aaf023af admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.352114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d8691-b851-4a48-b607-fdf28cd65594 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:04.353934 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d8691-b851-4a48-b607-fdf28cd65594 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:04.361571 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80eedc3-f918-4a33-96ac-3045aaf023af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:04.369130 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 139/285] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:04.369130 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d8691-b851-4a48-b607-fdf28cd65594 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:04.369384 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-e80eedc3-f918-4a33-96ac-3045aaf023af admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 12:35:04.370412 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 147/286] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:04.371166 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80eedc3-f918-4a33-96ac-3045aaf023af admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:04.379754 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d8691-b851-4a48-b607-fdf28cd65594 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:04.381190 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80eedc3-f918-4a33-96ac-3045aaf023af admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:04.384363 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b1559-4f7e-4366-a2d3-ba41e841b05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:04.385218 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b1559-4f7e-4366-a2d3-ba41e841b05f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.385511 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de026324-3e7e-4cc4-a490-484eddc8ec02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:04.385862 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b1559-4f7e-4366-a2d3-ba41e841b05f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.386270 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b1559-4f7e-4366-a2d3-ba41e841b05f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.386575 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de026324-3e7e-4cc4-a490-484eddc8ec02 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.386853 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de026324-3e7e-4cc4-a490-484eddc8ec02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.387120 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de026324-3e7e-4cc4-a490-484eddc8ec02 admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.387768 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b1559-4f7e-4366-a2d3-ba41e841b05f admin admin] RBAC: Adding query filter params (role.id=e4d526676145442ab5838d824be7bf59, user.id=3ce267580b214b7f9b985ca3befc4d1b, scope.system=all) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:04.388220 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b1559-4f7e-4366-a2d3-ba41e841b05f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:04.388431 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de026324-3e7e-4cc4-a490-484eddc8ec02 admin admin] RBAC: Authorizing `identity:get_project(project_id=098496e4eb9b450d987e89a0eed6c412)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:04.390413 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b1559-4f7e-4366-a2d3-ba41e841b05f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:04.390551 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de026324-3e7e-4cc4-a490-484eddc8ec02 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:04.392347 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 148/287] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:04 2022] GET /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:04.393517 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de026324-3e7e-4cc4-a490-484eddc8ec02 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:04.400259 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 140/288] 10.222.0.13 () {56 vars in 1329 bytes} [Mon Jan 10 12:35:04 2022] GET /identity/v3/role_assignments?user.id=3ce267580b214b7f9b985ca3befc4d1b&scope.system=all&role.id=e4d526676145442ab5838d824be7bf59 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:04.401586 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b1559-4f7e-4366-a2d3-ba41e841b05f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:04.413211 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de026324-3e7e-4cc4-a490-484eddc8ec02 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:04.413820 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b1559-4f7e-4366-a2d3-ba41e841b05f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:04.419135 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a35f18-da77-4a67-976b-891ba1ef890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:04.419408 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef197c-6625-401f-8ae5-83ddd8c905e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:04.419895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef197c-6625-401f-8ae5-83ddd8c905e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.420477 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef197c-6625-401f-8ae5-83ddd8c905e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.420751 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef197c-6625-401f-8ae5-83ddd8c905e2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.421138 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a35f18-da77-4a67-976b-891ba1ef890d admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.421661 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef197c-6625-401f-8ae5-83ddd8c905e2 admin admin] RBAC: Adding query filter params (role.id=e4d526676145442ab5838d824be7bf59, scope.project.id=098496e4eb9b450d987e89a0eed6c412, user.id=85337d18c9fc4aa1aece0eedfc5d7196) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:04.421770 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a35f18-da77-4a67-976b-891ba1ef890d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.421967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef197c-6625-401f-8ae5-83ddd8c905e2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:04.422415 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a35f18-da77-4a67-976b-891ba1ef890d admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.423470 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a35f18-da77-4a67-976b-891ba1ef890d admin admin] RBAC: Adding query filter params (name=reader) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:04.424045 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a35f18-da77-4a67-976b-891ba1ef890d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:04.424149 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef197c-6625-401f-8ae5-83ddd8c905e2 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:04.426054 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a35f18-da77-4a67-976b-891ba1ef890d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:04.432058 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 141/289] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:04 2022] GET /identity/v3/role_assignments?user.id=85337d18c9fc4aa1aece0eedfc5d7196&scope.project.id=098496e4eb9b450d987e89a0eed6c412&role.id=e4d526676145442ab5838d824be7bf59 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:04.436862 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 149/290] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:35:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:04.443237 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef197c-6625-401f-8ae5-83ddd8c905e2 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:04.457586 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef197c-6625-401f-8ae5-83ddd8c905e2 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:04.463021 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dc73f-b2b4-4825-8f7a-8b1f42473907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:04.464544 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dc73f-b2b4-4825-8f7a-8b1f42473907 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.465089 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dc73f-b2b4-4825-8f7a-8b1f42473907 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.465605 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dc73f-b2b4-4825-8f7a-8b1f42473907 admin admin] PATH_INFO: `/v3/users/788d8d5887e74631a2f129fddc639151` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.467643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dc73f-b2b4-4825-8f7a-8b1f42473907 admin admin] RBAC: Authorizing `identity:get_user(user_id=788d8d5887e74631a2f129fddc639151)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:04.470435 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dc73f-b2b4-4825-8f7a-8b1f42473907 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:04.472847 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 142/291] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:35:04 2022] GET /identity/v3/users/788d8d5887e74631a2f129fddc639151 => generated 297 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:04.481777 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a35f18-da77-4a67-976b-891ba1ef890d admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:04.492200 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a35f18-da77-4a67-976b-891ba1ef890d admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:04.497672 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d49c65-8a20-43c5-a35a-0fdee0347d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:04.498974 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d49c65-8a20-43c5-a35a-0fdee0347d67 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.499456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d49c65-8a20-43c5-a35a-0fdee0347d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.499996 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d49c65-8a20-43c5-a35a-0fdee0347d67 admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.501666 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d49c65-8a20-43c5-a35a-0fdee0347d67 admin admin] RBAC: Authorizing `identity:get_project(project_id=098496e4eb9b450d987e89a0eed6c412)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:04.504151 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d49c65-8a20-43c5-a35a-0fdee0347d67 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:04.506770 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 150/292] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:04 2022] GET /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:04.513432 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dc73f-b2b4-4825-8f7a-8b1f42473907 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:04.526146 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dc73f-b2b4-4825-8f7a-8b1f42473907 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:04.531607 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bc692-f81b-4864-a93a-050202bee9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:04.532960 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bc692-f81b-4864-a93a-050202bee9ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:04.533481 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bc692-f81b-4864-a93a-050202bee9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:04.533956 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bc692-f81b-4864-a93a-050202bee9ca admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412/users/788d8d5887e74631a2f129fddc639151/roles/86eb0f09cb0e49e1a58d4bfadbf1e9bf` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:04.536573 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bc692-f81b-4864-a93a-050202bee9ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=098496e4eb9b450d987e89a0eed6c412, user_id=788d8d5887e74631a2f129fddc639151, role_id=86eb0f09cb0e49e1a58d4bfadbf1e9bf)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:04.539858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bc692-f81b-4864-a93a-050202bee9ca admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:04.559010 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 143/293] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:35:04 2022] PUT /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412/users/788d8d5887e74631a2f129fddc639151/roles/86eb0f09cb0e49e1a58d4bfadbf1e9bf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:35:06.830379 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7a663-bee8-43b5-be17-3a95403fcbc3 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:06.831340 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7a663-bee8-43b5-be17-3a95403fcbc3 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:06.831857 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7a663-bee8-43b5-be17-3a95403fcbc3 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:06.833974 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 151/294] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:06.839490 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c2629-1c55-4a8a-8d56-f8c56a773d8f None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:06.839968 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c2629-1c55-4a8a-8d56-f8c56a773d8f None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:06.840045 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c2629-1c55-4a8a-8d56-f8c56a773d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:06.861187 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-b59c2629-1c55-4a8a-8d56-f8c56a773d8f None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:06.862888 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-b59c2629-1c55-4a8a-8d56-f8c56a773d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:06.923166 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 144/295] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:35:06.947388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7a663-bee8-43b5-be17-3a95403fcbc3 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:06.959907 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7a663-bee8-43b5-be17-3a95403fcbc3 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:06.962081 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9f003-04df-405a-8a65-6614d1efc386 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:06.962369 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9f003-04df-405a-8a65-6614d1efc386 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:06.962630 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9f003-04df-405a-8a65-6614d1efc386 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:06.964785 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 145/296] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:35:06.964983 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c1107-889c-4734-9b54-44256f38e466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:06.965884 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c1107-889c-4734-9b54-44256f38e466 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:06.966164 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c1107-889c-4734-9b54-44256f38e466 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:06.966442 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c1107-889c-4734-9b54-44256f38e466 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:06.969543 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58859fba-56f5-4664-8e3d-0312d0640d77 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:06.969830 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58859fba-56f5-4664-8e3d-0312d0640d77 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:06.970106 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58859fba-56f5-4664-8e3d-0312d0640d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:06.978454 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c1107-889c-4734-9b54-44256f38e466 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:06.985601 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-527c1107-889c-4734-9b54-44256f38e466 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 12:35:06.987771 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-58859fba-56f5-4664-8e3d-0312d0640d77 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:06.988962 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-58859fba-56f5-4664-8e3d-0312d0640d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:06.991494 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 152/297] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:06.992699 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c1107-889c-4734-9b54-44256f38e466 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:06.996959 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 146/298] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:35:07.002954 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c1107-889c-4734-9b54-44256f38e466 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:07.007373 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8bd0f2-9877-4da8-bd11-c04bd654e2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:07.008077 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bd0f2-9877-4da8-bd11-c04bd654e2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:07.008352 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bd0f2-9877-4da8-bd11-c04bd654e2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:07.008683 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bd0f2-9877-4da8-bd11-c04bd654e2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:07.009456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8bd0f2-9877-4da8-bd11-c04bd654e2d3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:07.009761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8bd0f2-9877-4da8-bd11-c04bd654e2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:07.011413 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8bd0f2-9877-4da8-bd11-c04bd654e2d3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:07.023620 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 153/299] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:35:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:07.026384 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58859fba-56f5-4664-8e3d-0312d0640d77 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:07.028544 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8bd0f2-9877-4da8-bd11-c04bd654e2d3 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:07.035867 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58859fba-56f5-4664-8e3d-0312d0640d77 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:07.040121 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdf4ba-d362-4472-b7f0-23b9b6dc0cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:07.040871 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8bd0f2-9877-4da8-bd11-c04bd654e2d3 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:07.040980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdf4ba-d362-4472-b7f0-23b9b6dc0cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:07.041232 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdf4ba-d362-4472-b7f0-23b9b6dc0cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:07.041540 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdf4ba-d362-4472-b7f0-23b9b6dc0cd6 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:07.046422 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971ff1d-51cf-489e-b5b3-2788f7f79574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:07.047941 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971ff1d-51cf-489e-b5b3-2788f7f79574 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:07.048373 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971ff1d-51cf-489e-b5b3-2788f7f79574 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:07.048652 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971ff1d-51cf-489e-b5b3-2788f7f79574 admin admin] PATH_INFO: `/v3/users/3ce267580b214b7f9b985ca3befc4d1b` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:07.049888 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971ff1d-51cf-489e-b5b3-2788f7f79574 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ce267580b214b7f9b985ca3befc4d1b)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:07.052076 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971ff1d-51cf-489e-b5b3-2788f7f79574 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:07.052805 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdf4ba-d362-4472-b7f0-23b9b6dc0cd6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:07.053696 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 154/300] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:35:07 2022] GET /identity/v3/users/3ce267580b214b7f9b985ca3befc4d1b => generated 293 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:07.059362 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a90100-1f82-480e-b5eb-38d14c1f1159 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:07.059677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a90100-1f82-480e-b5eb-38d14c1f1159 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:07.060172 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a90100-1f82-480e-b5eb-38d14c1f1159 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:07.060913 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-aacdf4ba-d362-4472-b7f0-23b9b6dc0cd6 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 12:35:07.061815 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 155/301] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:07.062477 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 147/302] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:07.067702 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a90100-1f82-480e-b5eb-38d14c1f1159 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:07.067794 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45879b-422c-49b0-acf9-c972d3ecc64b None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:07.067865 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45879b-422c-49b0-acf9-c972d3ecc64b None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:07.068113 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45879b-422c-49b0-acf9-c972d3ecc64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:07.078798 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a90100-1f82-480e-b5eb-38d14c1f1159 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:07.082960 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3f548-fb52-4c01-b8dd-0171a7af5ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:07.083843 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3f548-fb52-4c01-b8dd-0171a7af5ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:07.084120 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3f548-fb52-4c01-b8dd-0171a7af5ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:07.084388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3f548-fb52-4c01-b8dd-0171a7af5ac5 admin admin] PATH_INFO: `/v3/system/users/3ce267580b214b7f9b985ca3befc4d1b/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:07.085777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-ea45879b-422c-49b0-acf9-c972d3ecc64b None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:07.085879 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3f548-fb52-4c01-b8dd-0171a7af5ac5 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3ce267580b214b7f9b985ca3befc4d1b, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:07.086869 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING py.warnings [None req-15e3f548-fb52-4c01-b8dd-0171a7af5ac5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:35:07.086869 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: warnings.warn(msg) Jan 10 12:35:07.086869 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: Jan 10 12:35:07.087088 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-ea45879b-422c-49b0-acf9-c972d3ecc64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:07.087775 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3f548-fb52-4c01-b8dd-0171a7af5ac5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:07.094735 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 148/303] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:35:07.095533 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45879b-422c-49b0-acf9-c972d3ecc64b None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:07.097428 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 156/304] 10.222.0.13 () {58 vars in 1355 bytes} [Mon Jan 10 12:35:07 2022] PUT /identity/v3/system/users/3ce267580b214b7f9b985ca3befc4d1b/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:35:07.099006 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e024008-204c-495f-9197-1760ab89befe None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:07.099465 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e024008-204c-495f-9197-1760ab89befe None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:07.099768 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e024008-204c-495f-9197-1760ab89befe None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:07.103557 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 157/305] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:07.107268 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dabd39-6beb-4d2b-8f67-14444ff74853 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:07.109646 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45879b-422c-49b0-acf9-c972d3ecc64b None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:07.110547 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dabd39-6beb-4d2b-8f67-14444ff74853 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:07.110850 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dabd39-6beb-4d2b-8f67-14444ff74853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:07.114546 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcdc5c-9b43-41e3-99a9-a242c6e3c031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:07.115229 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcdc5c-9b43-41e3-99a9-a242c6e3c031 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:07.115503 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcdc5c-9b43-41e3-99a9-a242c6e3c031 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:07.115804 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcdc5c-9b43-41e3-99a9-a242c6e3c031 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:07.116599 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdcdc5c-9b43-41e3-99a9-a242c6e3c031 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:07.116913 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdcdc5c-9b43-41e3-99a9-a242c6e3c031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:07.118797 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdcdc5c-9b43-41e3-99a9-a242c6e3c031 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:07.132208 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 149/306] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:35:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:07.133713 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcdc5c-9b43-41e3-99a9-a242c6e3c031 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:07.134220 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-04dabd39-6beb-4d2b-8f67-14444ff74853 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:07.135630 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-04dabd39-6beb-4d2b-8f67-14444ff74853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:07.143503 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 158/307] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:35:07.144491 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dabd39-6beb-4d2b-8f67-14444ff74853 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:07.154485 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dabd39-6beb-4d2b-8f67-14444ff74853 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:07.154688 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcdc5c-9b43-41e3-99a9-a242c6e3c031 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:07.158985 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d86fab-5d73-4009-8f35-fe8e7e705507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:07.159804 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59cd5d-df7f-45a8-8f17-042c6877207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:07.160040 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d86fab-5d73-4009-8f35-fe8e7e705507 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:07.160319 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d86fab-5d73-4009-8f35-fe8e7e705507 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:07.160589 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d86fab-5d73-4009-8f35-fe8e7e705507 admin admin] PATH_INFO: `/v3/users/b82fba32c93e49fb967a031b3f8680ca` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:07.161530 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59cd5d-df7f-45a8-8f17-042c6877207f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:07.161976 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59cd5d-df7f-45a8-8f17-042c6877207f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:07.162407 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59cd5d-df7f-45a8-8f17-042c6877207f admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:07.176712 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d86fab-5d73-4009-8f35-fe8e7e705507 admin admin] RBAC: Authorizing `identity:get_user(user_id=b82fba32c93e49fb967a031b3f8680ca)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:07.178395 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59cd5d-df7f-45a8-8f17-042c6877207f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:07.178910 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d86fab-5d73-4009-8f35-fe8e7e705507 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:07.180780 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 159/308] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:35:07 2022] GET /identity/v3/users/b82fba32c93e49fb967a031b3f8680ca => generated 293 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:07.181678 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d86fab-5d73-4009-8f35-fe8e7e705507 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:07.187083 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-fd59cd5d-df7f-45a8-8f17-042c6877207f admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 12:35:07.189253 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 150/309] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:07.189253 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59cd5d-df7f-45a8-8f17-042c6877207f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:07.194746 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d86fab-5d73-4009-8f35-fe8e7e705507 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:07.197296 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67208c4-798b-46ba-b695-b5b324ac06c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:07.198160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67208c4-798b-46ba-b695-b5b324ac06c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:07.198437 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67208c4-798b-46ba-b695-b5b324ac06c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:07.198709 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67208c4-798b-46ba-b695-b5b324ac06c0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:07.200207 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67208c4-798b-46ba-b695-b5b324ac06c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:07.202015 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67208c4-798b-46ba-b695-b5b324ac06c0 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:07.203931 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 160/310] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:07.204631 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67208c4-798b-46ba-b695-b5b324ac06c0 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:07.209017 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59cd5d-df7f-45a8-8f17-042c6877207f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:07.214350 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1637f6f-b450-49bd-bc7e-ee36f7f21a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:07.214836 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67208c4-798b-46ba-b695-b5b324ac06c0 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:07.215445 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1637f6f-b450-49bd-bc7e-ee36f7f21a72 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:07.215886 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1637f6f-b450-49bd-bc7e-ee36f7f21a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:07.216289 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1637f6f-b450-49bd-bc7e-ee36f7f21a72 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:07.217290 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1637f6f-b450-49bd-bc7e-ee36f7f21a72 admin admin] RBAC: Adding query filter params (role.id=86eb0f09cb0e49e1a58d4bfadbf1e9bf, user.id=b82fba32c93e49fb967a031b3f8680ca, scope.system=all) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:07.217754 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1637f6f-b450-49bd-bc7e-ee36f7f21a72 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:07.219205 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0135e17-df99-44c2-b314-98648ee73699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:07.219905 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0135e17-df99-44c2-b314-98648ee73699 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:07.220155 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1637f6f-b450-49bd-bc7e-ee36f7f21a72 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:07.220253 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0135e17-df99-44c2-b314-98648ee73699 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:07.220437 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0135e17-df99-44c2-b314-98648ee73699 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:07.221200 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0135e17-df99-44c2-b314-98648ee73699 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:07.221504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0135e17-df99-44c2-b314-98648ee73699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:07.223181 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0135e17-df99-44c2-b314-98648ee73699 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:07.227182 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 151/311] 10.222.0.13 () {56 vars in 1329 bytes} [Mon Jan 10 12:35:07 2022] GET /identity/v3/role_assignments?user.id=b82fba32c93e49fb967a031b3f8680ca&scope.system=all&role.id=86eb0f09cb0e49e1a58d4bfadbf1e9bf => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:07.228372 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1637f6f-b450-49bd-bc7e-ee36f7f21a72 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:07.241780 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1637f6f-b450-49bd-bc7e-ee36f7f21a72 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:07.247132 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 161/312] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:35:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:07.248483 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0135e17-df99-44c2-b314-98648ee73699 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:07.255818 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e483eb-c38c-4a1e-b2cf-8cac425e26f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:07.256872 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e483eb-c38c-4a1e-b2cf-8cac425e26f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:07.257329 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e483eb-c38c-4a1e-b2cf-8cac425e26f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:07.257682 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e483eb-c38c-4a1e-b2cf-8cac425e26f9 admin admin] PATH_INFO: `/v3/groups` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:07.258418 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e483eb-c38c-4a1e-b2cf-8cac425e26f9 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:07.259559 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-27e483eb-c38c-4a1e-b2cf-8cac425e26f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:35:07.259559 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:35:07.259559 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:35:07.260986 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e483eb-c38c-4a1e-b2cf-8cac425e26f9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:07.262280 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0135e17-df99-44c2-b314-98648ee73699 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:07.268537 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a5735-0b1d-4dd8-8e14-f63c8fdfd92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:07.269438 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a5735-0b1d-4dd8-8e14-f63c8fdfd92e admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:07.269747 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a5735-0b1d-4dd8-8e14-f63c8fdfd92e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:07.269985 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a5735-0b1d-4dd8-8e14-f63c8fdfd92e admin admin] PATH_INFO: `/v3/users/788d8d5887e74631a2f129fddc639151` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:07.271497 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a5735-0b1d-4dd8-8e14-f63c8fdfd92e admin admin] RBAC: Authorizing `identity:get_user(user_id=788d8d5887e74631a2f129fddc639151)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:07.273904 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a5735-0b1d-4dd8-8e14-f63c8fdfd92e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:07.280674 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 162/313] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:35:07 2022] GET /identity/v3/users/788d8d5887e74631a2f129fddc639151 => generated 297 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:07.282279 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a5735-0b1d-4dd8-8e14-f63c8fdfd92e admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:07.292426 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 152/314] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Jan 10 12:35:07 2022] POST /identity/v3/groups => generated 229 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:35:07.303545 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a5735-0b1d-4dd8-8e14-f63c8fdfd92e admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:07.303545 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967a316-11ad-4b50-b542-10cfcc623abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:07.303545 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967a316-11ad-4b50-b542-10cfcc623abe admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:07.303948 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967a316-11ad-4b50-b542-10cfcc623abe admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:07.304177 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967a316-11ad-4b50-b542-10cfcc623abe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:07.314214 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967a316-11ad-4b50-b542-10cfcc623abe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:07.316679 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7967a316-11ad-4b50-b542-10cfcc623abe admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:07.329966 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 163/315] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 12:35:07.336363 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e483eb-c38c-4a1e-b2cf-8cac425e26f9 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:07.347740 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e483eb-c38c-4a1e-b2cf-8cac425e26f9 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:07.353180 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77566a6d-9aca-459a-93fd-65749f8807b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:07.354227 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77566a6d-9aca-459a-93fd-65749f8807b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:07.354512 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77566a6d-9aca-459a-93fd-65749f8807b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:07.354784 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77566a6d-9aca-459a-93fd-65749f8807b6 admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:07.356332 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77566a6d-9aca-459a-93fd-65749f8807b6 admin admin] RBAC: Authorizing `identity:get_project(project_id=098496e4eb9b450d987e89a0eed6c412)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:07.358469 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77566a6d-9aca-459a-93fd-65749f8807b6 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:07.363559 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 153/316] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:07 2022] GET /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:07.372998 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967a316-11ad-4b50-b542-10cfcc623abe admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:07.384044 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967a316-11ad-4b50-b542-10cfcc623abe admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:07.394169 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef856e-d5c4-4cf0-bdb0-b4d66ea55937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:07.394909 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef856e-d5c4-4cf0-bdb0-b4d66ea55937 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:07.395190 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef856e-d5c4-4cf0-bdb0-b4d66ea55937 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:07.395549 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef856e-d5c4-4cf0-bdb0-b4d66ea55937 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:07.396468 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef856e-d5c4-4cf0-bdb0-b4d66ea55937 admin admin] RBAC: Adding query filter params (role.id=86eb0f09cb0e49e1a58d4bfadbf1e9bf, scope.project.id=098496e4eb9b450d987e89a0eed6c412, user.id=788d8d5887e74631a2f129fddc639151) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:07.396779 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef856e-d5c4-4cf0-bdb0-b4d66ea55937 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:07.398803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef856e-d5c4-4cf0-bdb0-b4d66ea55937 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:07.410668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 164/317] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:07 2022] GET /identity/v3/role_assignments?user.id=788d8d5887e74631a2f129fddc639151&scope.project.id=098496e4eb9b450d987e89a0eed6c412&role.id=86eb0f09cb0e49e1a58d4bfadbf1e9bf => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:09.643207 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde94fee-6d43-4d50-878d-f5d31c494d34 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:09.643816 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde94fee-6d43-4d50-878d-f5d31c494d34 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:09.643816 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde94fee-6d43-4d50-878d-f5d31c494d34 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:09.645930 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 154/318] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:09.651203 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1f68e-27ec-40a4-8607-264b75d6a9c4 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:09.651681 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1f68e-27ec-40a4-8607-264b75d6a9c4 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:09.651758 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1f68e-27ec-40a4-8607-264b75d6a9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:09.670251 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-66a1f68e-27ec-40a4-8607-264b75d6a9c4 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:09.671476 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-66a1f68e-27ec-40a4-8607-264b75d6a9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:09.673002 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e25df3-1fe0-4bad-a8d2-b519c9180d96 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:09.673257 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e25df3-1fe0-4bad-a8d2-b519c9180d96 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:09.673527 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e25df3-1fe0-4bad-a8d2-b519c9180d96 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:09.675303 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 155/319] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:35:09.679640 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 165/320] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:09.680484 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c9cb0-8ac4-42af-b703-66aab5b42eb5 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:09.680853 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c9cb0-8ac4-42af-b703-66aab5b42eb5 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:09.681190 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c9cb0-8ac4-42af-b703-66aab5b42eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:09.699653 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-914c9cb0-8ac4-42af-b703-66aab5b42eb5 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:09.700963 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-914c9cb0-8ac4-42af-b703-66aab5b42eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:09.704656 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1f68e-27ec-40a4-8607-264b75d6a9c4 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:09.709447 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 156/321] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:09.713909 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1f68e-27ec-40a4-8607-264b75d6a9c4 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:09.718713 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31276844-c2e4-462e-9a8a-3aa4bd168dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:09.719505 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31276844-c2e4-462e-9a8a-3aa4bd168dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:09.719818 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31276844-c2e4-462e-9a8a-3aa4bd168dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:09.720071 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31276844-c2e4-462e-9a8a-3aa4bd168dc3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:09.733316 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849e64c-3a09-4c3d-9680-e1fd76c82f25 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:09.733603 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849e64c-3a09-4c3d-9680-e1fd76c82f25 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:09.733876 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849e64c-3a09-4c3d-9680-e1fd76c82f25 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:09.735336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31276844-c2e4-462e-9a8a-3aa4bd168dc3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:09.735680 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 157/322] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:35:09.736368 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849e64c-3a09-4c3d-9680-e1fd76c82f25 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:09.742258 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-31276844-c2e4-462e-9a8a-3aa4bd168dc3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 12:35:09.747998 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 166/323] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:09.747998 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3afc7-93ff-4931-a4d1-7986409a340d None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:09.747998 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3afc7-93ff-4931-a4d1-7986409a340d None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:09.747998 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3afc7-93ff-4931-a4d1-7986409a340d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:09.751280 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849e64c-3a09-4c3d-9680-e1fd76c82f25 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:09.755468 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391550f-3959-4447-8ca2-6595dd88a983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:09.756365 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391550f-3959-4447-8ca2-6595dd88a983 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:09.756641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391550f-3959-4447-8ca2-6595dd88a983 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:09.756909 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391550f-3959-4447-8ca2-6595dd88a983 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:09.762995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-5dc3afc7-93ff-4931-a4d1-7986409a340d None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:09.764216 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-5dc3afc7-93ff-4931-a4d1-7986409a340d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:09.767485 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391550f-3959-4447-8ca2-6595dd88a983 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:09.771524 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 167/324] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:09.772296 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3afc7-93ff-4931-a4d1-7986409a340d None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:09.774433 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-9391550f-3959-4447-8ca2-6595dd88a983 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 12:35:09.775794 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 158/325] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:09.781247 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391550f-3959-4447-8ca2-6595dd88a983 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:09.786334 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3afc7-93ff-4931-a4d1-7986409a340d None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:09.790253 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391550f-3959-4447-8ca2-6595dd88a983 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:09.791323 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb3cf6-2f24-4922-bf5d-2e7ab875fa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:09.792096 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb3cf6-2f24-4922-bf5d-2e7ab875fa3c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:09.792378 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb3cf6-2f24-4922-bf5d-2e7ab875fa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:09.792647 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb3cf6-2f24-4922-bf5d-2e7ab875fa3c admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:09.793418 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb3cf6-2f24-4922-bf5d-2e7ab875fa3c admin admin] RBAC: Adding query filter params (name=member) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:09.793728 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb3cf6-2f24-4922-bf5d-2e7ab875fa3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:09.795139 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654b405-74e5-4264-845a-427b888eb803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:09.795424 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb3cf6-2f24-4922-bf5d-2e7ab875fa3c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:09.795827 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b405-74e5-4264-845a-427b888eb803 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:09.796108 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b405-74e5-4264-845a-427b888eb803 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:09.796379 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654b405-74e5-4264-845a-427b888eb803 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:09.797136 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654b405-74e5-4264-845a-427b888eb803 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:09.797440 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654b405-74e5-4264-845a-427b888eb803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:09.799388 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654b405-74e5-4264-845a-427b888eb803 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:09.804490 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 168/326] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:35:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:09.805227 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb3cf6-2f24-4922-bf5d-2e7ab875fa3c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:09.812964 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 159/327] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:35:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:09.812964 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654b405-74e5-4264-845a-427b888eb803 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:09.815737 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb3cf6-2f24-4922-bf5d-2e7ab875fa3c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:09.820787 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdff4b-6fc8-495e-a9c2-bec5277488ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:09.821558 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdff4b-6fc8-495e-a9c2-bec5277488ef admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:09.821835 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdff4b-6fc8-495e-a9c2-bec5277488ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:09.822100 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdff4b-6fc8-495e-a9c2-bec5277488ef admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:09.822395 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654b405-74e5-4264-845a-427b888eb803 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:09.823416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdff4b-6fc8-495e-a9c2-bec5277488ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:09.825146 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdff4b-6fc8-495e-a9c2-bec5277488ef admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:09.826727 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 169/328] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:09.826985 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a03dbb-b772-43d0-b406-f9266d274cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:09.827458 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdff4b-6fc8-495e-a9c2-bec5277488ef admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:09.827900 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a03dbb-b772-43d0-b406-f9266d274cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:09.828179 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a03dbb-b772-43d0-b406-f9266d274cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:09.828445 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a03dbb-b772-43d0-b406-f9266d274cd5 admin admin] PATH_INFO: `/v3/users/3ce267580b214b7f9b985ca3befc4d1b` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:09.829643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a03dbb-b772-43d0-b406-f9266d274cd5 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ce267580b214b7f9b985ca3befc4d1b)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:09.831759 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a03dbb-b772-43d0-b406-f9266d274cd5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:09.833341 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 160/329] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:35:09 2022] GET /identity/v3/users/3ce267580b214b7f9b985ca3befc4d1b => generated 293 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:09.834074 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a03dbb-b772-43d0-b406-f9266d274cd5 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:09.840434 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdff4b-6fc8-495e-a9c2-bec5277488ef admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:09.844402 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a03dbb-b772-43d0-b406-f9266d274cd5 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:09.844767 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d17e9b-d243-4a69-9aab-b5e5b123e282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:09.845602 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d17e9b-d243-4a69-9aab-b5e5b123e282 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:09.845877 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d17e9b-d243-4a69-9aab-b5e5b123e282 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:09.846143 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d17e9b-d243-4a69-9aab-b5e5b123e282 admin admin] PATH_INFO: `/v3/users/b82fba32c93e49fb967a031b3f8680ca` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:09.847391 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d17e9b-d243-4a69-9aab-b5e5b123e282 admin admin] RBAC: Authorizing `identity:get_user(user_id=b82fba32c93e49fb967a031b3f8680ca)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:09.848844 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b462c2-5aac-447c-b557-07db4bba636b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:09.849459 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b462c2-5aac-447c-b557-07db4bba636b admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:09.849562 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d17e9b-d243-4a69-9aab-b5e5b123e282 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:09.849742 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b462c2-5aac-447c-b557-07db4bba636b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:09.850008 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b462c2-5aac-447c-b557-07db4bba636b admin admin] PATH_INFO: `/v3/groups` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:09.850687 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b462c2-5aac-447c-b557-07db4bba636b admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:09.851076 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 170/330] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:35:09 2022] GET /identity/v3/users/b82fba32c93e49fb967a031b3f8680ca => generated 293 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:09.851838 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d17e9b-d243-4a69-9aab-b5e5b123e282 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:09.852639 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b462c2-5aac-447c-b557-07db4bba636b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:09.861851 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d17e9b-d243-4a69-9aab-b5e5b123e282 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:09.866403 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f61af-e0e3-4032-bd57-8cbb8e8baba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:09.866541 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 161/331] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Jan 10 12:35:09 2022] POST /identity/v3/groups => generated 226 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:35:09.867034 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f61af-e0e3-4032-bd57-8cbb8e8baba5 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:09.867194 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b462c2-5aac-447c-b557-07db4bba636b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:09.867344 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f61af-e0e3-4032-bd57-8cbb8e8baba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:09.867607 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f61af-e0e3-4032-bd57-8cbb8e8baba5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:09.868754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f61af-e0e3-4032-bd57-8cbb8e8baba5 admin admin] RBAC: Adding query filter params (role.id=e4d526676145442ab5838d824be7bf59, user.id=3ce267580b214b7f9b985ca3befc4d1b, scope.system=all) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:09.868938 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f61af-e0e3-4032-bd57-8cbb8e8baba5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:09.870986 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f61af-e0e3-4032-bd57-8cbb8e8baba5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:09.881628 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b462c2-5aac-447c-b557-07db4bba636b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:09.886578 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd66cf-800e-4f80-9fbf-b34727331e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:09.887595 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd66cf-800e-4f80-9fbf-b34727331e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:09.887879 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd66cf-800e-4f80-9fbf-b34727331e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:09.888168 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd66cf-800e-4f80-9fbf-b34727331e17 admin admin] PATH_INFO: `/v3/system/users/b82fba32c93e49fb967a031b3f8680ca/roles/86eb0f09cb0e49e1a58d4bfadbf1e9bf` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:09.890673 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd66cf-800e-4f80-9fbf-b34727331e17 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b82fba32c93e49fb967a031b3f8680ca, role_id=86eb0f09cb0e49e1a58d4bfadbf1e9bf)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:09.895671 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 171/332] 10.222.0.13 () {56 vars in 1329 bytes} [Mon Jan 10 12:35:09 2022] GET /identity/v3/role_assignments?user.id=3ce267580b214b7f9b985ca3befc4d1b&scope.system=all&role.id=e4d526676145442ab5838d824be7bf59 => generated 510 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:09.895864 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-8fbd66cf-800e-4f80-9fbf-b34727331e17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:35:09.895864 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:35:09.895864 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:35:09.895864 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd66cf-800e-4f80-9fbf-b34727331e17 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:09.915078 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 162/333] 10.222.0.13 () {58 vars in 1355 bytes} [Mon Jan 10 12:35:09 2022] PUT /identity/v3/system/users/b82fba32c93e49fb967a031b3f8680ca/roles/86eb0f09cb0e49e1a58d4bfadbf1e9bf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:35:12.665992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825baee-f56c-4a71-977b-d85078e159bb None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:12.667118 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825baee-f56c-4a71-977b-d85078e159bb None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:12.667700 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825baee-f56c-4a71-977b-d85078e159bb None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:12.670034 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 172/334] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:12.675199 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ede3f8-edec-43fc-ac39-0400392e904d None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:12.676105 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ede3f8-edec-43fc-ac39-0400392e904d None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:12.676574 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ede3f8-edec-43fc-ac39-0400392e904d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:12.698648 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-69ede3f8-edec-43fc-ac39-0400392e904d None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:12.700245 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-69ede3f8-edec-43fc-ac39-0400392e904d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:12.713767 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 163/335] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:12.756682 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825baee-f56c-4a71-977b-d85078e159bb None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:12.769966 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825baee-f56c-4a71-977b-d85078e159bb None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:12.774727 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c7e76-1a65-4fe0-a0bc-b4f5104c8f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:12.775815 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c7e76-1a65-4fe0-a0bc-b4f5104c8f79 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:12.776315 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c7e76-1a65-4fe0-a0bc-b4f5104c8f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:12.776779 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c7e76-1a65-4fe0-a0bc-b4f5104c8f79 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:12.794297 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c7e76-1a65-4fe0-a0bc-b4f5104c8f79 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:12.801389 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-837c7e76-1a65-4fe0-a0bc-b4f5104c8f79 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 12:35:12.803130 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 173/336] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:12.808753 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ede3f8-edec-43fc-ac39-0400392e904d None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:12.826180 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ede3f8-edec-43fc-ac39-0400392e904d None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:12.830714 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93135f65-956b-4d06-82c2-119be580eaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:12.831391 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93135f65-956b-4d06-82c2-119be580eaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:12.831703 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93135f65-956b-4d06-82c2-119be580eaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:12.831970 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93135f65-956b-4d06-82c2-119be580eaf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:12.832748 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93135f65-956b-4d06-82c2-119be580eaf4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:12.833050 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93135f65-956b-4d06-82c2-119be580eaf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:12.834661 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93135f65-956b-4d06-82c2-119be580eaf4 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:12.854139 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 164/337] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:35:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:12.859948 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c7e76-1a65-4fe0-a0bc-b4f5104c8f79 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:12.872894 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c7e76-1a65-4fe0-a0bc-b4f5104c8f79 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:12.883395 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e95c2-f5b0-43f4-bcf9-92f6dcaf2bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:12.884313 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e95c2-f5b0-43f4-bcf9-92f6dcaf2bda admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:12.884792 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e95c2-f5b0-43f4-bcf9-92f6dcaf2bda admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:12.885520 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e95c2-f5b0-43f4-bcf9-92f6dcaf2bda admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:12.900272 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e95c2-f5b0-43f4-bcf9-92f6dcaf2bda admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:12.902431 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e95c2-f5b0-43f4-bcf9-92f6dcaf2bda admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:12.917917 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 174/338] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:12.923280 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93135f65-956b-4d06-82c2-119be580eaf4 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:12.939107 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93135f65-956b-4d06-82c2-119be580eaf4 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:12.944052 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f78be-6174-4dff-9b0b-cdd103afb5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:12.944924 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f78be-6174-4dff-9b0b-cdd103afb5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:12.945198 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f78be-6174-4dff-9b0b-cdd103afb5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:12.945463 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f78be-6174-4dff-9b0b-cdd103afb5c9 admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:12.946681 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f78be-6174-4dff-9b0b-cdd103afb5c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:12.948820 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f78be-6174-4dff-9b0b-cdd103afb5c9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:12.950515 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 165/339] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:12 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:12.956035 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e95c2-f5b0-43f4-bcf9-92f6dcaf2bda admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:12.968613 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e95c2-f5b0-43f4-bcf9-92f6dcaf2bda admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:12.974673 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b069d0-8569-4d6e-9c24-edbee30cd847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:12.975798 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b069d0-8569-4d6e-9c24-edbee30cd847 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:12.976303 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b069d0-8569-4d6e-9c24-edbee30cd847 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:12.976772 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b069d0-8569-4d6e-9c24-edbee30cd847 admin admin] PATH_INFO: `/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:12.989819 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b069d0-8569-4d6e-9c24-edbee30cd847 admin admin] RBAC: Authorizing `identity:get_group(group_id=3ce31cbeb3ca4e0b9e28e0388ee48d02)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:12.991160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING py.warnings [None req-44b069d0-8569-4d6e-9c24-edbee30cd847 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:35:12.991160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: warnings.warn(msg) Jan 10 12:35:12.991160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: Jan 10 12:35:12.992732 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b069d0-8569-4d6e-9c24-edbee30cd847 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:12.995011 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 175/340] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Jan 10 12:35:12 2022] GET /identity/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:13.000453 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f78be-6174-4dff-9b0b-cdd103afb5c9 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:13.013949 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f78be-6174-4dff-9b0b-cdd103afb5c9 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:13.018314 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7759b5f-155a-4877-bddb-8307d7343226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:13.018970 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7759b5f-155a-4877-bddb-8307d7343226 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:13.019246 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7759b5f-155a-4877-bddb-8307d7343226 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:13.019583 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7759b5f-155a-4877-bddb-8307d7343226 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:13.020394 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7759b5f-155a-4877-bddb-8307d7343226 admin admin] RBAC: Adding query filter params (group.id=3ce31cbeb3ca4e0b9e28e0388ee48d02, role.id=e4d526676145442ab5838d824be7bf59, scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:13.020696 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7759b5f-155a-4877-bddb-8307d7343226 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:13.022565 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7759b5f-155a-4877-bddb-8307d7343226 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:13.033075 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 166/341] 10.222.0.13 () {56 vars in 1397 bytes} [Mon Jan 10 12:35:12 2022] GET /identity/v3/role_assignments?group.id=3ce31cbeb3ca4e0b9e28e0388ee48d02&scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e&role.id=e4d526676145442ab5838d824be7bf59 => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:13.067757 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1628df-e3dd-46e6-8752-0997b9455970 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:13.068385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1628df-e3dd-46e6-8752-0997b9455970 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:13.068855 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1628df-e3dd-46e6-8752-0997b9455970 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:13.071277 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 176/342] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:13.076669 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3ff5d-0c33-49a7-8941-375d89962544 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:13.076975 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3ff5d-0c33-49a7-8941-375d89962544 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:13.077220 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3ff5d-0c33-49a7-8941-375d89962544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:13.092884 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d706598-896f-4846-b144-cd8bb64dc361 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:13.093524 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d706598-896f-4846-b144-cd8bb64dc361 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:13.094000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d706598-896f-4846-b144-cd8bb64dc361 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:13.096422 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 177/343] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:13.102538 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922f0ee-b931-4c99-9666-24fcdeafafec None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:13.103125 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922f0ee-b931-4c99-9666-24fcdeafafec None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:13.103638 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922f0ee-b931-4c99-9666-24fcdeafafec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:13.105612 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-11e3ff5d-0c33-49a7-8941-375d89962544 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:13.106921 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-11e3ff5d-0c33-49a7-8941-375d89962544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:13.115327 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 167/344] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:13.129839 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-0922f0ee-b931-4c99-9666-24fcdeafafec None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:13.131419 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-0922f0ee-b931-4c99-9666-24fcdeafafec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:13.148616 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 178/345] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:35:13.157364 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3ff5d-0c33-49a7-8941-375d89962544 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:13.173359 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3ff5d-0c33-49a7-8941-375d89962544 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:13.177802 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7c520-1d97-43b5-93c8-4bf35bd5f32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:13.178633 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7c520-1d97-43b5-93c8-4bf35bd5f32f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:13.178908 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7c520-1d97-43b5-93c8-4bf35bd5f32f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:13.179171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7c520-1d97-43b5-93c8-4bf35bd5f32f admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:13.202616 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922f0ee-b931-4c99-9666-24fcdeafafec None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:13.204316 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7c520-1d97-43b5-93c8-4bf35bd5f32f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:13.211340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-22e7c520-1d97-43b5-93c8-4bf35bd5f32f admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 10 12:35:13.215678 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 168/346] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:13.217659 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922f0ee-b931-4c99-9666-24fcdeafafec None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:13.218410 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7c520-1d97-43b5-93c8-4bf35bd5f32f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:13.233734 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7c520-1d97-43b5-93c8-4bf35bd5f32f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:13.235368 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff524d-893e-4186-99bf-1367a7312c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:13.236512 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff524d-893e-4186-99bf-1367a7312c37 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:13.237027 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff524d-893e-4186-99bf-1367a7312c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:13.237498 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff524d-893e-4186-99bf-1367a7312c37 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:13.241363 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f89e4-de0b-4b2a-9dad-5cf82304736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:13.242153 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f89e4-de0b-4b2a-9dad-5cf82304736a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:13.242432 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f89e4-de0b-4b2a-9dad-5cf82304736a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:13.242711 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f89e4-de0b-4b2a-9dad-5cf82304736a admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:13.243495 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f89e4-de0b-4b2a-9dad-5cf82304736a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:13.243836 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f89e4-de0b-4b2a-9dad-5cf82304736a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:13.245921 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f89e4-de0b-4b2a-9dad-5cf82304736a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:13.260980 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff524d-893e-4186-99bf-1367a7312c37 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:13.263794 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 169/347] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:35:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:13.271595 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f89e4-de0b-4b2a-9dad-5cf82304736a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:13.273624 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-beff524d-893e-4186-99bf-1367a7312c37 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 12:35:13.275500 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 179/348] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:35:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:13.284031 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f89e4-de0b-4b2a-9dad-5cf82304736a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:13.285399 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff524d-893e-4186-99bf-1367a7312c37 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:13.289079 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfb465-f774-40b4-ab9b-fdc9b71dc699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:13.290080 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfb465-f774-40b4-ab9b-fdc9b71dc699 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:13.290441 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfb465-f774-40b4-ab9b-fdc9b71dc699 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:13.290715 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfb465-f774-40b4-ab9b-fdc9b71dc699 admin admin] PATH_INFO: `/v3/users/b82fba32c93e49fb967a031b3f8680ca` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:13.292353 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfb465-f774-40b4-ab9b-fdc9b71dc699 admin admin] RBAC: Authorizing `identity:get_user(user_id=b82fba32c93e49fb967a031b3f8680ca)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:13.294573 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfb465-f774-40b4-ab9b-fdc9b71dc699 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:13.300992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff524d-893e-4186-99bf-1367a7312c37 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:13.307644 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 170/349] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:35:13 2022] GET /identity/v3/users/b82fba32c93e49fb967a031b3f8680ca => generated 293 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:13.310191 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfb465-f774-40b4-ab9b-fdc9b71dc699 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:13.312748 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b8405-e1b3-421a-b9fe-de2619668e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:13.313777 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b8405-e1b3-421a-b9fe-de2619668e36 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:13.314275 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b8405-e1b3-421a-b9fe-de2619668e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:13.314754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b8405-e1b3-421a-b9fe-de2619668e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:13.316452 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b8405-e1b3-421a-b9fe-de2619668e36 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:13.317041 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b8405-e1b3-421a-b9fe-de2619668e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:13.318928 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b8405-e1b3-421a-b9fe-de2619668e36 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:13.325302 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfb465-f774-40b4-ab9b-fdc9b71dc699 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:13.330766 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 180/350] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:13.334198 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c12b98-7daf-4276-9d57-e45a285464e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:13.334873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c12b98-7daf-4276-9d57-e45a285464e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:13.335150 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c12b98-7daf-4276-9d57-e45a285464e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:13.335416 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c12b98-7daf-4276-9d57-e45a285464e0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:13.336351 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c12b98-7daf-4276-9d57-e45a285464e0 admin admin] RBAC: Adding query filter params (role.id=86eb0f09cb0e49e1a58d4bfadbf1e9bf, user.id=b82fba32c93e49fb967a031b3f8680ca, scope.system=all) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:13.336898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c12b98-7daf-4276-9d57-e45a285464e0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:13.338111 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b8405-e1b3-421a-b9fe-de2619668e36 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:13.338631 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c12b98-7daf-4276-9d57-e45a285464e0 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:13.351293 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b8405-e1b3-421a-b9fe-de2619668e36 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:13.359890 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 171/351] 10.222.0.13 () {56 vars in 1329 bytes} [Mon Jan 10 12:35:13 2022] GET /identity/v3/role_assignments?user.id=b82fba32c93e49fb967a031b3f8680ca&scope.system=all&role.id=86eb0f09cb0e49e1a58d4bfadbf1e9bf => generated 510 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:13.366178 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe0dc2-ec20-44af-998a-045f3ab42b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:13.367244 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe0dc2-ec20-44af-998a-045f3ab42b24 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:13.367760 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe0dc2-ec20-44af-998a-045f3ab42b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:13.368247 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe0dc2-ec20-44af-998a-045f3ab42b24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:13.380173 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe0dc2-ec20-44af-998a-045f3ab42b24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:13.382393 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe0dc2-ec20-44af-998a-045f3ab42b24 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:13.393588 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 181/352] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:13.399857 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c12b98-7daf-4276-9d57-e45a285464e0 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:13.410669 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c12b98-7daf-4276-9d57-e45a285464e0 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:13.418697 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8379545-f981-4c75-84d6-cea8a39b02f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:13.420018 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8379545-f981-4c75-84d6-cea8a39b02f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:13.420510 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8379545-f981-4c75-84d6-cea8a39b02f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:13.420984 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8379545-f981-4c75-84d6-cea8a39b02f0 admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:13.423760 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8379545-f981-4c75-84d6-cea8a39b02f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:13.426155 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8379545-f981-4c75-84d6-cea8a39b02f0 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:13.428353 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 172/353] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:13 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:13.434596 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe0dc2-ec20-44af-998a-045f3ab42b24 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:13.445087 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe0dc2-ec20-44af-998a-045f3ab42b24 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:13.452529 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b8320-3d77-4a23-b694-d201b53db67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:13.453820 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b8320-3d77-4a23-b694-d201b53db67a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:13.454315 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b8320-3d77-4a23-b694-d201b53db67a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:13.454792 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b8320-3d77-4a23-b694-d201b53db67a admin admin] PATH_INFO: `/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:13.460486 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b8320-3d77-4a23-b694-d201b53db67a admin admin] RBAC: Authorizing `identity:get_group(group_id=3ce31cbeb3ca4e0b9e28e0388ee48d02)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:13.462825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b8320-3d77-4a23-b694-d201b53db67a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:13.465246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 182/354] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Jan 10 12:35:13 2022] GET /identity/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:13.471507 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8379545-f981-4c75-84d6-cea8a39b02f0 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:13.482441 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8379545-f981-4c75-84d6-cea8a39b02f0 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:13.491958 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b829519-8b10-4382-a327-ab71ac30da33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:13.493010 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b829519-8b10-4382-a327-ab71ac30da33 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:13.493497 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b829519-8b10-4382-a327-ab71ac30da33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:13.494014 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b829519-8b10-4382-a327-ab71ac30da33 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:13.495137 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b829519-8b10-4382-a327-ab71ac30da33 admin admin] RBAC: Adding query filter params (group.id=3ce31cbeb3ca4e0b9e28e0388ee48d02, role.id=6d59759e4d584ea688a6c0883ef5d9c6, scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:13.495704 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b829519-8b10-4382-a327-ab71ac30da33 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:13.497819 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b829519-8b10-4382-a327-ab71ac30da33 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:13.504606 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 173/355] 10.222.0.13 () {56 vars in 1397 bytes} [Mon Jan 10 12:35:13 2022] GET /identity/v3/role_assignments?group.id=3ce31cbeb3ca4e0b9e28e0388ee48d02&scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e&role.id=6d59759e4d584ea688a6c0883ef5d9c6 => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:13.965158 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff550c6-d39b-4356-80d2-ce00e6954b36 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:13.966157 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff550c6-d39b-4356-80d2-ce00e6954b36 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:13.966658 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff550c6-d39b-4356-80d2-ce00e6954b36 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:13.968729 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 183/356] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:13.974323 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0ffb3-a72e-460a-a565-b34e818ad7ed None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:13.975204 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0ffb3-a72e-460a-a565-b34e818ad7ed None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:13.975698 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0ffb3-a72e-460a-a565-b34e818ad7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:13.997490 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-bcb0ffb3-a72e-460a-a565-b34e818ad7ed None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:13.998997 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-bcb0ffb3-a72e-460a-a565-b34e818ad7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:14.010847 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 174/357] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:14.048347 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff550c6-d39b-4356-80d2-ce00e6954b36 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:14.065431 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff550c6-d39b-4356-80d2-ce00e6954b36 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:14.070280 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82495307-077d-4a91-b3e5-3b1b3e78e4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:14.071356 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82495307-077d-4a91-b3e5-3b1b3e78e4fa admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:14.071971 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82495307-077d-4a91-b3e5-3b1b3e78e4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:14.072438 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82495307-077d-4a91-b3e5-3b1b3e78e4fa admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:14.086137 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82495307-077d-4a91-b3e5-3b1b3e78e4fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:14.093342 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-82495307-077d-4a91-b3e5-3b1b3e78e4fa admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 12:35:14.095110 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 184/358] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:14.100617 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0ffb3-a72e-460a-a565-b34e818ad7ed None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:14.110232 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0ffb3-a72e-460a-a565-b34e818ad7ed None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:14.119645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3758999-4228-4f95-9b52-dafe1c54235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:14.120606 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3758999-4228-4f95-9b52-dafe1c54235f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:14.121099 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3758999-4228-4f95-9b52-dafe1c54235f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:14.121585 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3758999-4228-4f95-9b52-dafe1c54235f admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:14.122565 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3758999-4228-4f95-9b52-dafe1c54235f admin admin] RBAC: Adding query filter params (name=member) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:14.123067 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3758999-4228-4f95-9b52-dafe1c54235f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:14.124951 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3758999-4228-4f95-9b52-dafe1c54235f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:14.134320 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 175/359] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:35:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:14.140443 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82495307-077d-4a91-b3e5-3b1b3e78e4fa admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:14.151352 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82495307-077d-4a91-b3e5-3b1b3e78e4fa admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:14.163817 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a41154-fc1d-4212-9e14-b6527c66dcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:14.164834 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a41154-fc1d-4212-9e14-b6527c66dcfe admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:14.165346 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a41154-fc1d-4212-9e14-b6527c66dcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:14.165829 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a41154-fc1d-4212-9e14-b6527c66dcfe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:14.179840 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a41154-fc1d-4212-9e14-b6527c66dcfe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:14.182001 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a41154-fc1d-4212-9e14-b6527c66dcfe admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:14.189152 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a531de6-e961-4282-8069-8ddd6daa8408 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:14.189439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a531de6-e961-4282-8069-8ddd6daa8408 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:14.189710 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a531de6-e961-4282-8069-8ddd6daa8408 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:14.192167 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 176/360] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:14.195037 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 185/361] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:14.199537 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0dbc9-e5b1-4309-96ca-87818ba81874 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:14.199537 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0dbc9-e5b1-4309-96ca-87818ba81874 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:14.199537 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0dbc9-e5b1-4309-96ca-87818ba81874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:14.204548 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a41154-fc1d-4212-9e14-b6527c66dcfe admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:14.213839 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a41154-fc1d-4212-9e14-b6527c66dcfe admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:14.218231 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c1c71-3971-4779-8abe-204d35a0b7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:14.219103 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c1c71-3971-4779-8abe-204d35a0b7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:14.219376 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c1c71-3971-4779-8abe-204d35a0b7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:14.219670 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c1c71-3971-4779-8abe-204d35a0b7b3 admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:14.221229 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c1c71-3971-4779-8abe-204d35a0b7b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=098496e4eb9b450d987e89a0eed6c412)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:14.222931 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c1c71-3971-4779-8abe-204d35a0b7b3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:14.224992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 186/362] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:14 2022] GET /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:14.231910 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c1c71-3971-4779-8abe-204d35a0b7b3 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:14.240906 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-99e0dbc9-e5b1-4309-96ca-87818ba81874 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:14.241663 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c1c71-3971-4779-8abe-204d35a0b7b3 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:14.242128 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-99e0dbc9-e5b1-4309-96ca-87818ba81874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:14.252539 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e157ec-9449-464c-a07d-92e7b7ab56f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:14.253340 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e157ec-9449-464c-a07d-92e7b7ab56f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:14.253620 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e157ec-9449-464c-a07d-92e7b7ab56f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:14.253890 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e157ec-9449-464c-a07d-92e7b7ab56f8 admin admin] PATH_INFO: `/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:14.256571 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 177/363] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:35:14.257271 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e157ec-9449-464c-a07d-92e7b7ab56f8 admin admin] RBAC: Authorizing `identity:get_group(group_id=3ce31cbeb3ca4e0b9e28e0388ee48d02)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:14.259267 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e157ec-9449-464c-a07d-92e7b7ab56f8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:14.261248 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 187/364] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Jan 10 12:35:14 2022] GET /identity/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:14.267044 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0dbc9-e5b1-4309-96ca-87818ba81874 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:14.281033 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0dbc9-e5b1-4309-96ca-87818ba81874 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:14.282708 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e157ec-9449-464c-a07d-92e7b7ab56f8 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:14.295196 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e157ec-9449-464c-a07d-92e7b7ab56f8 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:14.297788 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b1e38-81bb-4eac-96e7-caa5b913548f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:14.298469 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b1e38-81bb-4eac-96e7-caa5b913548f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:14.298747 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b1e38-81bb-4eac-96e7-caa5b913548f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:14.299017 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b1e38-81bb-4eac-96e7-caa5b913548f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:14.300390 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b1e38-81bb-4eac-96e7-caa5b913548f admin admin] RBAC: Adding query filter params (group.id=3ce31cbeb3ca4e0b9e28e0388ee48d02, role.id=e4d526676145442ab5838d824be7bf59, scope.project.id=098496e4eb9b450d987e89a0eed6c412) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:14.300712 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b1e38-81bb-4eac-96e7-caa5b913548f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:14.302606 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b1e38-81bb-4eac-96e7-caa5b913548f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:14.308294 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a3378-211e-4fce-b0b3-149386ee956b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:14.309136 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a3378-211e-4fce-b0b3-149386ee956b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:14.309416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a3378-211e-4fce-b0b3-149386ee956b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:14.309683 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a3378-211e-4fce-b0b3-149386ee956b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:14.319132 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 178/365] 10.222.0.13 () {56 vars in 1397 bytes} [Mon Jan 10 12:35:14 2022] GET /identity/v3/role_assignments?group.id=3ce31cbeb3ca4e0b9e28e0388ee48d02&scope.project.id=098496e4eb9b450d987e89a0eed6c412&role.id=e4d526676145442ab5838d824be7bf59 => generated 260 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:14.327488 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a3378-211e-4fce-b0b3-149386ee956b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:14.335251 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-841a3378-211e-4fce-b0b3-149386ee956b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 12:35:14.337016 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 188/366] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:35:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:14.343210 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b1e38-81bb-4eac-96e7-caa5b913548f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:14.357386 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b1e38-81bb-4eac-96e7-caa5b913548f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:14.367559 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867f940-4958-4e1b-a988-54fcd8e9c722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:14.368248 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867f940-4958-4e1b-a988-54fcd8e9c722 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:14.368528 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867f940-4958-4e1b-a988-54fcd8e9c722 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:14.368799 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867f940-4958-4e1b-a988-54fcd8e9c722 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:14.369640 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867f940-4958-4e1b-a988-54fcd8e9c722 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:14.369939 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867f940-4958-4e1b-a988-54fcd8e9c722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:14.371640 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867f940-4958-4e1b-a988-54fcd8e9c722 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:14.383092 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 179/367] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:14.388839 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a3378-211e-4fce-b0b3-149386ee956b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:14.404610 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a3378-211e-4fce-b0b3-149386ee956b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:14.412042 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f1560-3499-4f54-a73e-aa4cc846eead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:14.412730 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f1560-3499-4f54-a73e-aa4cc846eead admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:14.413064 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f1560-3499-4f54-a73e-aa4cc846eead admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:14.413336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f1560-3499-4f54-a73e-aa4cc846eead admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:14.426784 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f1560-3499-4f54-a73e-aa4cc846eead admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:14.428633 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f1560-3499-4f54-a73e-aa4cc846eead admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:14.441709 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 189/368] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:14.447127 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867f940-4958-4e1b-a988-54fcd8e9c722 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:14.461041 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867f940-4958-4e1b-a988-54fcd8e9c722 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:14.471284 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6967d3-36ae-4591-a0ca-e851eb5c78b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:14.472192 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6967d3-36ae-4591-a0ca-e851eb5c78b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:14.472471 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6967d3-36ae-4591-a0ca-e851eb5c78b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:14.472743 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6967d3-36ae-4591-a0ca-e851eb5c78b2 admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:14.473977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6967d3-36ae-4591-a0ca-e851eb5c78b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=098496e4eb9b450d987e89a0eed6c412)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:14.476102 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6967d3-36ae-4591-a0ca-e851eb5c78b2 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:14.478015 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 180/369] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:14 2022] GET /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:14.483692 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f1560-3499-4f54-a73e-aa4cc846eead admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:14.497359 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f1560-3499-4f54-a73e-aa4cc846eead admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:14.508263 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b240b3-2013-4b31-a327-fa3329ad6bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:14.509120 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b240b3-2013-4b31-a327-fa3329ad6bfd admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:14.509400 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b240b3-2013-4b31-a327-fa3329ad6bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:14.509720 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b240b3-2013-4b31-a327-fa3329ad6bfd admin admin] PATH_INFO: `/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:14.511710 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b240b3-2013-4b31-a327-fa3329ad6bfd admin admin] RBAC: Authorizing `identity:get_group(group_id=3ce31cbeb3ca4e0b9e28e0388ee48d02)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:14.513700 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b240b3-2013-4b31-a327-fa3329ad6bfd admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:14.515523 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 190/370] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Jan 10 12:35:14 2022] GET /identity/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:14.521474 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6967d3-36ae-4591-a0ca-e851eb5c78b2 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:14.536992 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6967d3-36ae-4591-a0ca-e851eb5c78b2 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:14.547413 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad8c91-4084-4fab-9783-3fe8206a4b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:14.548126 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad8c91-4084-4fab-9783-3fe8206a4b59 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:14.548409 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad8c91-4084-4fab-9783-3fe8206a4b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:14.548679 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad8c91-4084-4fab-9783-3fe8206a4b59 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:14.549547 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad8c91-4084-4fab-9783-3fe8206a4b59 admin admin] RBAC: Adding query filter params (group.id=3ce31cbeb3ca4e0b9e28e0388ee48d02, role.id=6d59759e4d584ea688a6c0883ef5d9c6, scope.project.id=098496e4eb9b450d987e89a0eed6c412) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:14.549855 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad8c91-4084-4fab-9783-3fe8206a4b59 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:14.551779 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad8c91-4084-4fab-9783-3fe8206a4b59 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:14.558542 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 181/371] 10.222.0.13 () {56 vars in 1397 bytes} [Mon Jan 10 12:35:14 2022] GET /identity/v3/role_assignments?group.id=3ce31cbeb3ca4e0b9e28e0388ee48d02&scope.project.id=098496e4eb9b450d987e89a0eed6c412&role.id=6d59759e4d584ea688a6c0883ef5d9c6 => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:15.427332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c53e9b-525a-4f28-aa46-bdd9fa3283fc None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:15.428113 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c53e9b-525a-4f28-aa46-bdd9fa3283fc None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:15.428113 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c53e9b-525a-4f28-aa46-bdd9fa3283fc None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:15.429692 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 191/372] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:15.437460 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8833eb2-91ba-4f24-a263-c9f8437c565a None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:15.437460 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8833eb2-91ba-4f24-a263-c9f8437c565a None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:15.437460 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8833eb2-91ba-4f24-a263-c9f8437c565a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:15.464578 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-e8833eb2-91ba-4f24-a263-c9f8437c565a None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:15.466123 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e8833eb2-91ba-4f24-a263-c9f8437c565a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:15.474520 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 182/373] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:15.522467 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c53e9b-525a-4f28-aa46-bdd9fa3283fc None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:15.541532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c53e9b-525a-4f28-aa46-bdd9fa3283fc None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:15.545913 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c4529-2085-49bc-8ee4-f6bfcf8668fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:15.546727 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c4529-2085-49bc-8ee4-f6bfcf8668fc admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:15.547007 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c4529-2085-49bc-8ee4-f6bfcf8668fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:15.547278 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c4529-2085-49bc-8ee4-f6bfcf8668fc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:15.561302 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c4529-2085-49bc-8ee4-f6bfcf8668fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:15.568593 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-ee1c4529-2085-49bc-8ee4-f6bfcf8668fc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:35:15.570157 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 192/374] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:35:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:15.575803 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8833eb2-91ba-4f24-a263-c9f8437c565a None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:15.585128 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8833eb2-91ba-4f24-a263-c9f8437c565a None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:15.595500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffa1ac-f113-45e6-b47f-79fc29d6a5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:15.596444 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffa1ac-f113-45e6-b47f-79fc29d6a5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:15.596907 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffa1ac-f113-45e6-b47f-79fc29d6a5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:15.597379 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffa1ac-f113-45e6-b47f-79fc29d6a5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:15.598329 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffa1ac-f113-45e6-b47f-79fc29d6a5f8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:15.598818 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffa1ac-f113-45e6-b47f-79fc29d6a5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:15.600645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffa1ac-f113-45e6-b47f-79fc29d6a5f8 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:15.613866 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 183/375] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:15.619592 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c4529-2085-49bc-8ee4-f6bfcf8668fc admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:15.634964 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c4529-2085-49bc-8ee4-f6bfcf8668fc admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:15.643049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428bb1d-e5e1-4840-aa1a-e0b54efc9cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:15.643833 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428bb1d-e5e1-4840-aa1a-e0b54efc9cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:15.644116 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428bb1d-e5e1-4840-aa1a-e0b54efc9cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:15.644391 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428bb1d-e5e1-4840-aa1a-e0b54efc9cb2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:15.656481 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428bb1d-e5e1-4840-aa1a-e0b54efc9cb2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:15.658256 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428bb1d-e5e1-4840-aa1a-e0b54efc9cb2 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:15.672523 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 193/376] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:15.678121 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffa1ac-f113-45e6-b47f-79fc29d6a5f8 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:15.691537 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffa1ac-f113-45e6-b47f-79fc29d6a5f8 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:15.703625 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14285d11-b7a6-4067-9544-eeba0c23c7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:15.704761 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14285d11-b7a6-4067-9544-eeba0c23c7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:15.705236 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14285d11-b7a6-4067-9544-eeba0c23c7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:15.705691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14285d11-b7a6-4067-9544-eeba0c23c7a0 admin admin] PATH_INFO: `/v3/projects/230e0a61baae4ee798a1e664588228fe` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:15.712220 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14285d11-b7a6-4067-9544-eeba0c23c7a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=230e0a61baae4ee798a1e664588228fe)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:15.714559 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14285d11-b7a6-4067-9544-eeba0c23c7a0 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:15.716468 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 184/377] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:15 2022] GET /identity/v3/projects/230e0a61baae4ee798a1e664588228fe => generated 344 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:15.722765 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428bb1d-e5e1-4840-aa1a-e0b54efc9cb2 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:15.736745 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428bb1d-e5e1-4840-aa1a-e0b54efc9cb2 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:15.747281 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbba25-c4a0-4534-9222-27cc368e24ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:15.748185 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbba25-c4a0-4534-9222-27cc368e24ae admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:15.748463 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbba25-c4a0-4534-9222-27cc368e24ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:15.748737 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbba25-c4a0-4534-9222-27cc368e24ae admin admin] PATH_INFO: `/v3/groups/36572c0643ad4544aafce7de797a4318` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:15.754204 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbba25-c4a0-4534-9222-27cc368e24ae admin admin] RBAC: Authorizing `identity:get_group(group_id=36572c0643ad4544aafce7de797a4318)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:15.756174 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbba25-c4a0-4534-9222-27cc368e24ae admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:15.758116 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 194/378] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Jan 10 12:35:15 2022] GET /identity/v3/groups/36572c0643ad4544aafce7de797a4318 => generated 229 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:15.763935 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14285d11-b7a6-4067-9544-eeba0c23c7a0 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:15.773910 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14285d11-b7a6-4067-9544-eeba0c23c7a0 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:15.783680 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8804da-42ab-4d4a-ab37-915e11d9e739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:15.784641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8804da-42ab-4d4a-ab37-915e11d9e739 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:15.785126 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8804da-42ab-4d4a-ab37-915e11d9e739 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:15.785585 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8804da-42ab-4d4a-ab37-915e11d9e739 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:15.786634 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8804da-42ab-4d4a-ab37-915e11d9e739 admin admin] RBAC: Adding query filter params (group.id=36572c0643ad4544aafce7de797a4318, role.id=9d097c033f454263a874fbafe92c9aea, scope.project.id=230e0a61baae4ee798a1e664588228fe) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:15.787175 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8804da-42ab-4d4a-ab37-915e11d9e739 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:15.789236 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8804da-42ab-4d4a-ab37-915e11d9e739 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:15.796671 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 185/379] 10.222.0.13 () {56 vars in 1397 bytes} [Mon Jan 10 12:35:15 2022] GET /identity/v3/role_assignments?group.id=36572c0643ad4544aafce7de797a4318&scope.project.id=230e0a61baae4ee798a1e664588228fe&role.id=9d097c033f454263a874fbafe92c9aea => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:16.345816 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa6d8f-7bc5-4123-b430-233eb78b2e95 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:16.346219 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa6d8f-7bc5-4123-b430-233eb78b2e95 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:16.346403 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa6d8f-7bc5-4123-b430-233eb78b2e95 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:16.348475 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 195/380] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:16.353963 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e64e-3cd3-41a0-a338-f32912468317 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:16.354421 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e64e-3cd3-41a0-a338-f32912468317 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:16.355026 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e64e-3cd3-41a0-a338-f32912468317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:16.377378 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-bec0e64e-3cd3-41a0-a338-f32912468317 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:16.378623 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-bec0e64e-3cd3-41a0-a338-f32912468317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:16.390217 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 186/381] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:16.429148 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa6d8f-7bc5-4123-b430-233eb78b2e95 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:16.445660 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa6d8f-7bc5-4123-b430-233eb78b2e95 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:16.450039 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7137b-f1fd-4c67-9ef6-f41df7efab44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:16.450844 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7137b-f1fd-4c67-9ef6-f41df7efab44 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:16.451131 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7137b-f1fd-4c67-9ef6-f41df7efab44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:16.451401 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7137b-f1fd-4c67-9ef6-f41df7efab44 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:16.464791 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7137b-f1fd-4c67-9ef6-f41df7efab44 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:16.471654 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-65c7137b-f1fd-4c67-9ef6-f41df7efab44 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 12:35:16.473058 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 196/382] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:16.479055 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0e64e-3cd3-41a0-a338-f32912468317 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:16.488090 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0e64e-3cd3-41a0-a338-f32912468317 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:16.495181 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f755802-53d0-426f-99ed-7fa76bb1637a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:16.495887 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f755802-53d0-426f-99ed-7fa76bb1637a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:16.496164 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f755802-53d0-426f-99ed-7fa76bb1637a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:16.496438 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f755802-53d0-426f-99ed-7fa76bb1637a admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:16.497217 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f755802-53d0-426f-99ed-7fa76bb1637a admin admin] RBAC: Adding query filter params (name=member) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:16.497522 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f755802-53d0-426f-99ed-7fa76bb1637a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:16.499153 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f755802-53d0-426f-99ed-7fa76bb1637a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:16.508533 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 187/383] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:35:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:16.514196 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7137b-f1fd-4c67-9ef6-f41df7efab44 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:16.524036 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7137b-f1fd-4c67-9ef6-f41df7efab44 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:16.531079 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c7023-3580-4128-b017-37cdbb40b0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:16.531978 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c7023-3580-4128-b017-37cdbb40b0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:16.532258 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c7023-3580-4128-b017-37cdbb40b0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:16.532531 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c7023-3580-4128-b017-37cdbb40b0d9 admin admin] PATH_INFO: `/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:16.533742 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c7023-3580-4128-b017-37cdbb40b0d9 admin admin] RBAC: Authorizing `identity:get_group(group_id=3ce31cbeb3ca4e0b9e28e0388ee48d02)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:16.535694 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c7023-3580-4128-b017-37cdbb40b0d9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:16.537475 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 197/384] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Jan 10 12:35:16 2022] GET /identity/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:16.543133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f755802-53d0-426f-99ed-7fa76bb1637a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:16.552968 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f755802-53d0-426f-99ed-7fa76bb1637a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:16.557369 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38975850-7ce7-4eb6-8cae-f866f67f00df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:16.558218 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38975850-7ce7-4eb6-8cae-f866f67f00df admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:16.558495 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38975850-7ce7-4eb6-8cae-f866f67f00df admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:16.558767 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38975850-7ce7-4eb6-8cae-f866f67f00df admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:16.560013 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38975850-7ce7-4eb6-8cae-f866f67f00df admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:16.562068 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38975850-7ce7-4eb6-8cae-f866f67f00df admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:16.564089 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 188/385] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:16 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:16.570038 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c7023-3580-4128-b017-37cdbb40b0d9 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:16.584482 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c7023-3580-4128-b017-37cdbb40b0d9 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:16.589085 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ad848-5c19-45b9-8cd9-444610dfa6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:16.589968 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ad848-5c19-45b9-8cd9-444610dfa6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:16.590248 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ad848-5c19-45b9-8cd9-444610dfa6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:16.590515 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ad848-5c19-45b9-8cd9-444610dfa6fe admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:16.592534 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ad848-5c19-45b9-8cd9-444610dfa6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a2db78a87c4bd69fde46b3f80e8b5e, group_id=3ce31cbeb3ca4e0b9e28e0388ee48d02, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:16.595189 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ad848-5c19-45b9-8cd9-444610dfa6fe admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:16.629659 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 198/386] 10.222.0.13 () {58 vars in 1463 bytes} [Mon Jan 10 12:35:16 2022] PUT /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:35:16.835274 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d77c9c-c753-47e0-8d25-b9877140e641 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:16.835647 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d77c9c-c753-47e0-8d25-b9877140e641 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:16.835896 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d77c9c-c753-47e0-8d25-b9877140e641 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:16.837737 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 189/387] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:16.843630 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce93cf-63cf-49a6-91ef-74baba2ba53f None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:16.843913 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce93cf-63cf-49a6-91ef-74baba2ba53f None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:16.844194 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce93cf-63cf-49a6-91ef-74baba2ba53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:16.867109 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-94ce93cf-63cf-49a6-91ef-74baba2ba53f None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:16.868396 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-94ce93cf-63cf-49a6-91ef-74baba2ba53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:16.944552 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 199/388] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:16.982840 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d77c9c-c753-47e0-8d25-b9877140e641 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:17.001873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d77c9c-c753-47e0-8d25-b9877140e641 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:17.007335 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba779602-5770-47c3-a599-9d94c95a789d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:17.008272 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba779602-5770-47c3-a599-9d94c95a789d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:17.008554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba779602-5770-47c3-a599-9d94c95a789d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:17.008822 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba779602-5770-47c3-a599-9d94c95a789d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:17.022603 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba779602-5770-47c3-a599-9d94c95a789d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:17.030170 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-ba779602-5770-47c3-a599-9d94c95a789d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 12:35:17.031393 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 190/389] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:35:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:17.037989 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce93cf-63cf-49a6-91ef-74baba2ba53f None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:17.047744 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce93cf-63cf-49a6-91ef-74baba2ba53f None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:17.059215 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffd06e-2932-4d21-adb3-8ae324eb3c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:17.059949 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffd06e-2932-4d21-adb3-8ae324eb3c31 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:17.060226 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffd06e-2932-4d21-adb3-8ae324eb3c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:17.060497 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffd06e-2932-4d21-adb3-8ae324eb3c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:17.061335 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffd06e-2932-4d21-adb3-8ae324eb3c31 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:17.061636 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffd06e-2932-4d21-adb3-8ae324eb3c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:17.063481 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffd06e-2932-4d21-adb3-8ae324eb3c31 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:17.077409 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 200/390] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:17.082843 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba779602-5770-47c3-a599-9d94c95a789d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:17.097478 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba779602-5770-47c3-a599-9d94c95a789d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:17.103205 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77800708-76fc-4966-b077-f7dd89390978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:17.104247 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77800708-76fc-4966-b077-f7dd89390978 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:17.104498 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77800708-76fc-4966-b077-f7dd89390978 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:17.104759 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77800708-76fc-4966-b077-f7dd89390978 admin admin] PATH_INFO: `/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:17.106745 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77800708-76fc-4966-b077-f7dd89390978 admin admin] RBAC: Authorizing `identity:get_group(group_id=3ce31cbeb3ca4e0b9e28e0388ee48d02)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:17.107829 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-77800708-76fc-4966-b077-f7dd89390978 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:35:17.107829 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:35:17.107829 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:35:17.109016 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77800708-76fc-4966-b077-f7dd89390978 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:17.111166 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 191/391] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Jan 10 12:35:17 2022] GET /identity/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:17.121453 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffd06e-2932-4d21-adb3-8ae324eb3c31 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:17.136790 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffd06e-2932-4d21-adb3-8ae324eb3c31 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:17.141372 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da342c6c-af6c-4a54-8824-09570a3b8134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:17.142344 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da342c6c-af6c-4a54-8824-09570a3b8134 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:17.142624 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da342c6c-af6c-4a54-8824-09570a3b8134 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:17.142888 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da342c6c-af6c-4a54-8824-09570a3b8134 admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:17.144167 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da342c6c-af6c-4a54-8824-09570a3b8134 admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:17.146353 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da342c6c-af6c-4a54-8824-09570a3b8134 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:17.148416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 201/392] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:17 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:17.154977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77800708-76fc-4966-b077-f7dd89390978 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:17.167618 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77800708-76fc-4966-b077-f7dd89390978 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:17.172350 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b751b-5322-4c2d-bb9b-f3e5db6b2bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:17.173280 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b751b-5322-4c2d-bb9b-f3e5db6b2bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:17.173559 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b751b-5322-4c2d-bb9b-f3e5db6b2bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:17.173821 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b751b-5322-4c2d-bb9b-f3e5db6b2bfd admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02/roles/6d59759e4d584ea688a6c0883ef5d9c6` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:17.176235 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b751b-5322-4c2d-bb9b-f3e5db6b2bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a2db78a87c4bd69fde46b3f80e8b5e, group_id=3ce31cbeb3ca4e0b9e28e0388ee48d02, role_id=6d59759e4d584ea688a6c0883ef5d9c6)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:17.178943 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b751b-5322-4c2d-bb9b-f3e5db6b2bfd admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:17.202590 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 192/393] 10.222.0.13 () {58 vars in 1463 bytes} [Mon Jan 10 12:35:17 2022] PUT /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02/roles/6d59759e4d584ea688a6c0883ef5d9c6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:35:17.592675 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50018521-a833-4e46-b89b-3e319e0b2191 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:17.593359 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50018521-a833-4e46-b89b-3e319e0b2191 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:17.593359 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50018521-a833-4e46-b89b-3e319e0b2191 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:17.595188 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 202/394] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:17.600384 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5a8ac-64e0-4b90-af93-a1fc7180b079 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:17.600895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5a8ac-64e0-4b90-af93-a1fc7180b079 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:17.600990 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5a8ac-64e0-4b90-af93-a1fc7180b079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:17.624854 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-d2b5a8ac-64e0-4b90-af93-a1fc7180b079 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:17.626060 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-d2b5a8ac-64e0-4b90-af93-a1fc7180b079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:17.699807 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 193/395] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:17.726034 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50018521-a833-4e46-b89b-3e319e0b2191 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:17.743226 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50018521-a833-4e46-b89b-3e319e0b2191 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:17.749835 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f6b1a-aa07-4a60-9ca8-d0680a222543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:17.750687 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f6b1a-aa07-4a60-9ca8-d0680a222543 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:17.750966 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f6b1a-aa07-4a60-9ca8-d0680a222543 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:17.751230 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46f6b1a-aa07-4a60-9ca8-d0680a222543 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:17.765469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46f6b1a-aa07-4a60-9ca8-d0680a222543 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:17.772559 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-e46f6b1a-aa07-4a60-9ca8-d0680a222543 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 12:35:17.774091 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 203/396] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:17.780249 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5a8ac-64e0-4b90-af93-a1fc7180b079 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:17.793457 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5a8ac-64e0-4b90-af93-a1fc7180b079 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:17.800485 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bb377-0331-48da-9352-a06fb83624fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:17.801215 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bb377-0331-48da-9352-a06fb83624fe admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:17.801494 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bb377-0331-48da-9352-a06fb83624fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:17.801759 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bb377-0331-48da-9352-a06fb83624fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:17.802535 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bb377-0331-48da-9352-a06fb83624fe admin admin] RBAC: Adding query filter params (name=member) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:17.802835 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bb377-0331-48da-9352-a06fb83624fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:17.804474 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bb377-0331-48da-9352-a06fb83624fe admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:17.817205 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 194/397] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:35:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:17.823444 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f6b1a-aa07-4a60-9ca8-d0680a222543 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:17.834509 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46f6b1a-aa07-4a60-9ca8-d0680a222543 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:17.843913 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfabb94-534c-4133-9da0-d363efa31195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:17.844759 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfabb94-534c-4133-9da0-d363efa31195 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:17.845039 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfabb94-534c-4133-9da0-d363efa31195 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:17.845305 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfabb94-534c-4133-9da0-d363efa31195 admin admin] PATH_INFO: `/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:17.846646 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfabb94-534c-4133-9da0-d363efa31195 admin admin] RBAC: Authorizing `identity:get_group(group_id=3ce31cbeb3ca4e0b9e28e0388ee48d02)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:17.848764 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfabb94-534c-4133-9da0-d363efa31195 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:17.850751 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 204/398] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Jan 10 12:35:17 2022] GET /identity/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:17.856374 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bb377-0331-48da-9352-a06fb83624fe admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:17.873252 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bb377-0331-48da-9352-a06fb83624fe admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:17.880346 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3f8f5-9252-4c90-a620-eb5f54b9b050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:17.881259 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3f8f5-9252-4c90-a620-eb5f54b9b050 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:17.881533 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3f8f5-9252-4c90-a620-eb5f54b9b050 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:17.881841 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3f8f5-9252-4c90-a620-eb5f54b9b050 admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:17.883444 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3f8f5-9252-4c90-a620-eb5f54b9b050 admin admin] RBAC: Authorizing `identity:get_project(project_id=098496e4eb9b450d987e89a0eed6c412)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:17.885734 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3f8f5-9252-4c90-a620-eb5f54b9b050 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:17.887543 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 195/399] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:17 2022] GET /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:17.893444 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfabb94-534c-4133-9da0-d363efa31195 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:17.904825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfabb94-534c-4133-9da0-d363efa31195 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:17.911045 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca26df-48a3-4ed2-bb1e-ea6f04fd06a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:17.911988 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca26df-48a3-4ed2-bb1e-ea6f04fd06a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:17.912271 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca26df-48a3-4ed2-bb1e-ea6f04fd06a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:17.912539 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca26df-48a3-4ed2-bb1e-ea6f04fd06a9 admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:17.914546 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca26df-48a3-4ed2-bb1e-ea6f04fd06a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098496e4eb9b450d987e89a0eed6c412, group_id=3ce31cbeb3ca4e0b9e28e0388ee48d02, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:17.921817 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca26df-48a3-4ed2-bb1e-ea6f04fd06a9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:17.943057 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 205/400] 10.222.0.13 () {58 vars in 1463 bytes} [Mon Jan 10 12:35:17 2022] PUT /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:35:17.943257 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eaf58-e454-46e6-b898-a49c0c9f9125 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:17.943481 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eaf58-e454-46e6-b898-a49c0c9f9125 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:17.943726 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733eaf58-e454-46e6-b898-a49c0c9f9125 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:17.945954 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 196/401] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:17.952791 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e10e1-6fdc-42be-b844-46a46be623e4 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:17.953124 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e10e1-6fdc-42be-b844-46a46be623e4 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:17.953406 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e10e1-6fdc-42be-b844-46a46be623e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:17.980440 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-b73e10e1-6fdc-42be-b844-46a46be623e4 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:17.981653 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b73e10e1-6fdc-42be-b844-46a46be623e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:18.047714 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 206/402] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:18.090508 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eaf58-e454-46e6-b898-a49c0c9f9125 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:18.107823 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733eaf58-e454-46e6-b898-a49c0c9f9125 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:18.114433 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279c433-18e7-4d06-90bb-882714d1efab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:18.115369 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279c433-18e7-4d06-90bb-882714d1efab admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:18.115683 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279c433-18e7-4d06-90bb-882714d1efab admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:18.115954 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279c433-18e7-4d06-90bb-882714d1efab admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:18.132604 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279c433-18e7-4d06-90bb-882714d1efab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:18.140592 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-e279c433-18e7-4d06-90bb-882714d1efab admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 12:35:18.142075 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 197/403] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:35:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:18.148194 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e10e1-6fdc-42be-b844-46a46be623e4 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:18.161761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e10e1-6fdc-42be-b844-46a46be623e4 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:18.171326 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c20bcc-dec0-4693-9cda-936cb7916303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:18.172055 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c20bcc-dec0-4693-9cda-936cb7916303 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:18.172335 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c20bcc-dec0-4693-9cda-936cb7916303 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:18.172607 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c20bcc-dec0-4693-9cda-936cb7916303 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:18.173392 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c20bcc-dec0-4693-9cda-936cb7916303 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:18.173695 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c20bcc-dec0-4693-9cda-936cb7916303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:18.175343 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c20bcc-dec0-4693-9cda-936cb7916303 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:18.185019 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 207/404] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:18.191482 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279c433-18e7-4d06-90bb-882714d1efab admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:18.205112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279c433-18e7-4d06-90bb-882714d1efab admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:18.211346 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf307f-0f92-43d5-a5e3-a4d34a1c6aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:18.212324 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf307f-0f92-43d5-a5e3-a4d34a1c6aab admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:18.212599 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf307f-0f92-43d5-a5e3-a4d34a1c6aab admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:18.212865 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf307f-0f92-43d5-a5e3-a4d34a1c6aab admin admin] PATH_INFO: `/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:18.215277 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf307f-0f92-43d5-a5e3-a4d34a1c6aab admin admin] RBAC: Authorizing `identity:get_group(group_id=3ce31cbeb3ca4e0b9e28e0388ee48d02)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:18.217381 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf307f-0f92-43d5-a5e3-a4d34a1c6aab admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:18.219214 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 198/405] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Jan 10 12:35:18 2022] GET /identity/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:18.225202 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c20bcc-dec0-4693-9cda-936cb7916303 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:18.241016 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c20bcc-dec0-4693-9cda-936cb7916303 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:18.251248 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4fe17-b2c0-4292-b102-ec9d64967705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:18.252177 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4fe17-b2c0-4292-b102-ec9d64967705 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:18.252456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4fe17-b2c0-4292-b102-ec9d64967705 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:18.252729 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4fe17-b2c0-4292-b102-ec9d64967705 admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:18.253952 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4fe17-b2c0-4292-b102-ec9d64967705 admin admin] RBAC: Authorizing `identity:get_project(project_id=098496e4eb9b450d987e89a0eed6c412)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:18.256117 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4fe17-b2c0-4292-b102-ec9d64967705 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:18.258119 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 208/406] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:18 2022] GET /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:18.264204 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf307f-0f92-43d5-a5e3-a4d34a1c6aab admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:18.276432 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf307f-0f92-43d5-a5e3-a4d34a1c6aab admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:18.283934 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730471d-dafd-4698-bbbe-7bdc9aec6099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:18.284899 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730471d-dafd-4698-bbbe-7bdc9aec6099 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:18.285230 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730471d-dafd-4698-bbbe-7bdc9aec6099 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:18.285548 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730471d-dafd-4698-bbbe-7bdc9aec6099 admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02/roles/6d59759e4d584ea688a6c0883ef5d9c6` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:18.289581 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730471d-dafd-4698-bbbe-7bdc9aec6099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=098496e4eb9b450d987e89a0eed6c412, group_id=3ce31cbeb3ca4e0b9e28e0388ee48d02, role_id=6d59759e4d584ea688a6c0883ef5d9c6)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:18.292595 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730471d-dafd-4698-bbbe-7bdc9aec6099 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:18.320498 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 199/407] 10.222.0.13 () {58 vars in 1463 bytes} [Mon Jan 10 12:35:18 2022] PUT /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02/roles/6d59759e4d584ea688a6c0883ef5d9c6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:35:19.182780 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6578158-c711-43e8-a71d-64a51cca7d12 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:19.183483 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6578158-c711-43e8-a71d-64a51cca7d12 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:19.183483 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6578158-c711-43e8-a71d-64a51cca7d12 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:19.185469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 209/408] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:19.191702 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239a03f-d4cb-4330-869d-d7d3e6143f5b None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:19.192239 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239a03f-d4cb-4330-869d-d7d3e6143f5b None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:19.192239 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239a03f-d4cb-4330-869d-d7d3e6143f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:19.215083 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-b239a03f-d4cb-4330-869d-d7d3e6143f5b None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:19.216325 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-b239a03f-d4cb-4330-869d-d7d3e6143f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:19.287903 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 200/409] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:19.337015 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6578158-c711-43e8-a71d-64a51cca7d12 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:19.354058 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6578158-c711-43e8-a71d-64a51cca7d12 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:19.363086 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c08b8-ac9e-41bb-9de0-1dd98c68d2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:19.363914 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c08b8-ac9e-41bb-9de0-1dd98c68d2ad admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:19.364194 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c08b8-ac9e-41bb-9de0-1dd98c68d2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:19.364521 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c08b8-ac9e-41bb-9de0-1dd98c68d2ad admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:19.376011 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c08b8-ac9e-41bb-9de0-1dd98c68d2ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:19.382834 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-473c08b8-ac9e-41bb-9de0-1dd98c68d2ad admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:35:19.384137 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 210/410] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:35:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:19.390253 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239a03f-d4cb-4330-869d-d7d3e6143f5b None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:19.403204 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239a03f-d4cb-4330-869d-d7d3e6143f5b None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:19.411545 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091a14e-686f-4a99-9b6a-f2478dba9367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:19.412245 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091a14e-686f-4a99-9b6a-f2478dba9367 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:19.412520 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091a14e-686f-4a99-9b6a-f2478dba9367 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:19.412788 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091a14e-686f-4a99-9b6a-f2478dba9367 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:19.413562 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091a14e-686f-4a99-9b6a-f2478dba9367 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:19.413860 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091a14e-686f-4a99-9b6a-f2478dba9367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:19.415482 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091a14e-686f-4a99-9b6a-f2478dba9367 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:19.427051 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 201/411] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:19.433038 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c08b8-ac9e-41bb-9de0-1dd98c68d2ad admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:19.451299 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c08b8-ac9e-41bb-9de0-1dd98c68d2ad admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:19.456922 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bfa44-e05c-4daa-a04e-b4e685f98e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:19.457788 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bfa44-e05c-4daa-a04e-b4e685f98e53 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:19.458070 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bfa44-e05c-4daa-a04e-b4e685f98e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:19.458340 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bfa44-e05c-4daa-a04e-b4e685f98e53 admin admin] PATH_INFO: `/v3/groups/36572c0643ad4544aafce7de797a4318` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:19.459573 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78bfa44-e05c-4daa-a04e-b4e685f98e53 admin admin] RBAC: Authorizing `identity:get_group(group_id=36572c0643ad4544aafce7de797a4318)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:19.461642 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78bfa44-e05c-4daa-a04e-b4e685f98e53 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:19.463636 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 211/412] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Jan 10 12:35:19 2022] GET /identity/v3/groups/36572c0643ad4544aafce7de797a4318 => generated 229 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:19.469164 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091a14e-686f-4a99-9b6a-f2478dba9367 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:19.484427 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091a14e-686f-4a99-9b6a-f2478dba9367 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:19.491459 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4d8c7-b5f6-4a8c-ab59-737747bc746f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:19.492359 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4d8c7-b5f6-4a8c-ab59-737747bc746f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:19.492635 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4d8c7-b5f6-4a8c-ab59-737747bc746f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:19.492902 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4d8c7-b5f6-4a8c-ab59-737747bc746f admin admin] PATH_INFO: `/v3/projects/230e0a61baae4ee798a1e664588228fe` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:19.500376 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4d8c7-b5f6-4a8c-ab59-737747bc746f admin admin] RBAC: Authorizing `identity:get_project(project_id=230e0a61baae4ee798a1e664588228fe)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:19.502198 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4d8c7-b5f6-4a8c-ab59-737747bc746f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:19.504483 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 202/413] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:19 2022] GET /identity/v3/projects/230e0a61baae4ee798a1e664588228fe => generated 344 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:19.510072 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bfa44-e05c-4daa-a04e-b4e685f98e53 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:19.522031 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bfa44-e05c-4daa-a04e-b4e685f98e53 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:19.527851 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8078648-7e6d-4f0a-87ed-8cfb3401f334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:19.528782 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8078648-7e6d-4f0a-87ed-8cfb3401f334 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:19.529116 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8078648-7e6d-4f0a-87ed-8cfb3401f334 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:19.529392 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8078648-7e6d-4f0a-87ed-8cfb3401f334 admin admin] PATH_INFO: `/v3/projects/230e0a61baae4ee798a1e664588228fe/groups/36572c0643ad4544aafce7de797a4318/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:19.535978 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8078648-7e6d-4f0a-87ed-8cfb3401f334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=230e0a61baae4ee798a1e664588228fe, group_id=36572c0643ad4544aafce7de797a4318, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:19.538950 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8078648-7e6d-4f0a-87ed-8cfb3401f334 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:19.566049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 212/414] 10.222.0.13 () {58 vars in 1463 bytes} [Mon Jan 10 12:35:19 2022] PUT /identity/v3/projects/230e0a61baae4ee798a1e664588228fe/groups/36572c0643ad4544aafce7de797a4318/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:35:19.715294 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192588b-1326-41b6-9eac-85fc5bffd833 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:19.715688 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192588b-1326-41b6-9eac-85fc5bffd833 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:19.715880 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192588b-1326-41b6-9eac-85fc5bffd833 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:19.717976 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 203/415] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:19.725124 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e98464-25ae-47f7-a786-ed192078fdaf None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:19.725410 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e98464-25ae-47f7-a786-ed192078fdaf None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:19.725677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e98464-25ae-47f7-a786-ed192078fdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:19.751319 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-53e98464-25ae-47f7-a786-ed192078fdaf None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:19.752596 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-53e98464-25ae-47f7-a786-ed192078fdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:19.844503 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 213/416] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:19.874415 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192588b-1326-41b6-9eac-85fc5bffd833 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:19.888587 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192588b-1326-41b6-9eac-85fc5bffd833 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:19.893897 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5a781-24fd-4fa4-b9a9-0b99eb498a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:19.894748 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5a781-24fd-4fa4-b9a9-0b99eb498a65 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:19.895031 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5a781-24fd-4fa4-b9a9-0b99eb498a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:19.895300 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5a781-24fd-4fa4-b9a9-0b99eb498a65 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:19.907055 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5a781-24fd-4fa4-b9a9-0b99eb498a65 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:19.914205 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-9be5a781-24fd-4fa4-b9a9-0b99eb498a65 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 12:35:19.916958 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 204/417] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:19.923886 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e98464-25ae-47f7-a786-ed192078fdaf None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:19.935943 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e98464-25ae-47f7-a786-ed192078fdaf None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:19.941905 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a3606-794d-4766-8725-e3c880fd658b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:19.942692 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a3606-794d-4766-8725-e3c880fd658b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:19.942923 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a3606-794d-4766-8725-e3c880fd658b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:19.943243 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a3606-794d-4766-8725-e3c880fd658b admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:19.944242 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a3606-794d-4766-8725-e3c880fd658b admin admin] RBAC: Adding query filter params (name=member) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:19.944555 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a3606-794d-4766-8725-e3c880fd658b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:19.946240 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a3606-794d-4766-8725-e3c880fd658b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:19.961086 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 214/418] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:35:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:19.966654 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5a781-24fd-4fa4-b9a9-0b99eb498a65 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:19.979034 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5a781-24fd-4fa4-b9a9-0b99eb498a65 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:19.987290 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4d820-668e-42ea-a432-e6b83bb09d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:19.987984 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4d820-668e-42ea-a432-e6b83bb09d57 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:19.988299 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4d820-668e-42ea-a432-e6b83bb09d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:19.988572 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4d820-668e-42ea-a432-e6b83bb09d57 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:19.997429 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4d820-668e-42ea-a432-e6b83bb09d57 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:19.999200 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4d820-668e-42ea-a432-e6b83bb09d57 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:20.008827 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 205/419] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:20.014674 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a3606-794d-4766-8725-e3c880fd658b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:20.024668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a3606-794d-4766-8725-e3c880fd658b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:20.031612 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e84b2-05a7-4406-8aaf-20bba2022b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:20.032484 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e84b2-05a7-4406-8aaf-20bba2022b07 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:20.032767 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e84b2-05a7-4406-8aaf-20bba2022b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:20.033041 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e84b2-05a7-4406-8aaf-20bba2022b07 admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:20.034263 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e84b2-05a7-4406-8aaf-20bba2022b07 admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:20.039988 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e84b2-05a7-4406-8aaf-20bba2022b07 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:20.043206 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 215/420] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:20 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:20.048849 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4d820-668e-42ea-a432-e6b83bb09d57 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:20.060429 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4d820-668e-42ea-a432-e6b83bb09d57 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:20.065368 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8fa42-2a02-4f4f-8101-3cf9908806bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:20.066223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8fa42-2a02-4f4f-8101-3cf9908806bd admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:20.066499 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8fa42-2a02-4f4f-8101-3cf9908806bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:20.066765 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8fa42-2a02-4f4f-8101-3cf9908806bd admin admin] PATH_INFO: `/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:20.072247 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8fa42-2a02-4f4f-8101-3cf9908806bd admin admin] RBAC: Authorizing `identity:get_group(group_id=3ce31cbeb3ca4e0b9e28e0388ee48d02)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:20.074536 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8fa42-2a02-4f4f-8101-3cf9908806bd admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:20.076539 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 206/421] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Jan 10 12:35:20 2022] GET /identity/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:20.083022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e84b2-05a7-4406-8aaf-20bba2022b07 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:20.093478 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e84b2-05a7-4406-8aaf-20bba2022b07 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:20.104006 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581fbc5-2e31-4fda-89dd-be862227ac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:20.104686 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581fbc5-2e31-4fda-89dd-be862227ac7c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:20.104968 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581fbc5-2e31-4fda-89dd-be862227ac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:20.105236 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581fbc5-2e31-4fda-89dd-be862227ac7c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:20.106101 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581fbc5-2e31-4fda-89dd-be862227ac7c admin admin] RBAC: Adding query filter params (group.id=3ce31cbeb3ca4e0b9e28e0388ee48d02, role.id=e4d526676145442ab5838d824be7bf59, scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:20.106438 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581fbc5-2e31-4fda-89dd-be862227ac7c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:20.108365 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581fbc5-2e31-4fda-89dd-be862227ac7c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:20.115648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 216/422] 10.222.0.13 () {56 vars in 1397 bytes} [Mon Jan 10 12:35:20 2022] GET /identity/v3/role_assignments?group.id=3ce31cbeb3ca4e0b9e28e0388ee48d02&scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e&role.id=e4d526676145442ab5838d824be7bf59 => generated 611 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:20.627573 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee0b8d-52b3-4c5c-bada-9e25b2729c39 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:20.627573 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee0b8d-52b3-4c5c-bada-9e25b2729c39 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:20.627573 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee0b8d-52b3-4c5c-bada-9e25b2729c39 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:20.628800 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 207/423] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:20.635265 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c57ee-84c9-4624-9ef8-280903f20370 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:20.636121 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c57ee-84c9-4624-9ef8-280903f20370 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:20.636630 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c57ee-84c9-4624-9ef8-280903f20370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:20.656909 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-373c57ee-84c9-4624-9ef8-280903f20370 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:20.658424 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-373c57ee-84c9-4624-9ef8-280903f20370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:20.670460 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 217/424] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:20.698241 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee0b8d-52b3-4c5c-bada-9e25b2729c39 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:20.714345 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee0b8d-52b3-4c5c-bada-9e25b2729c39 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:20.720808 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afd306-4417-4488-b98e-5b3d173b732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:20.721637 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afd306-4417-4488-b98e-5b3d173b732c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:20.721916 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afd306-4417-4488-b98e-5b3d173b732c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:20.722183 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afd306-4417-4488-b98e-5b3d173b732c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:20.734168 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5afd306-4417-4488-b98e-5b3d173b732c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:20.741593 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-d5afd306-4417-4488-b98e-5b3d173b732c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 12:35:20.747594 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 208/425] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:35:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:20.749401 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c57ee-84c9-4624-9ef8-280903f20370 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:20.758663 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c57ee-84c9-4624-9ef8-280903f20370 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:20.764393 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc954b-726a-4dac-af5b-12029376b18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:20.765271 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc954b-726a-4dac-af5b-12029376b18b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:20.765727 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc954b-726a-4dac-af5b-12029376b18b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:20.768255 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc954b-726a-4dac-af5b-12029376b18b admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:20.769287 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc954b-726a-4dac-af5b-12029376b18b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:20.769771 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc954b-726a-4dac-af5b-12029376b18b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:20.771592 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc954b-726a-4dac-af5b-12029376b18b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:20.784713 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 218/426] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:20.791179 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afd306-4417-4488-b98e-5b3d173b732c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:20.804674 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5afd306-4417-4488-b98e-5b3d173b732c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:20.812613 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2f37f-f284-4af2-a2d2-23f37ccc7766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:20.813273 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2f37f-f284-4af2-a2d2-23f37ccc7766 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:20.813597 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2f37f-f284-4af2-a2d2-23f37ccc7766 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:20.813863 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2f37f-f284-4af2-a2d2-23f37ccc7766 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:20.825976 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2f37f-f284-4af2-a2d2-23f37ccc7766 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:20.827921 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2f37f-f284-4af2-a2d2-23f37ccc7766 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:20.841373 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 209/427] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:20.847291 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc954b-726a-4dac-af5b-12029376b18b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:20.861598 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc954b-726a-4dac-af5b-12029376b18b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:20.868350 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47eaf3a-ef3a-4a46-ac8d-e490e1cf99d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:20.869442 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47eaf3a-ef3a-4a46-ac8d-e490e1cf99d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:20.870022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47eaf3a-ef3a-4a46-ac8d-e490e1cf99d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:20.870694 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47eaf3a-ef3a-4a46-ac8d-e490e1cf99d9 admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:20.872225 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47eaf3a-ef3a-4a46-ac8d-e490e1cf99d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:20.874479 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47eaf3a-ef3a-4a46-ac8d-e490e1cf99d9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:20.876336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 219/428] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:20 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:20.882130 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2f37f-f284-4af2-a2d2-23f37ccc7766 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:20.893648 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2f37f-f284-4af2-a2d2-23f37ccc7766 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:20.898372 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89a282-b4bb-4dcf-b01e-fb72c23fbfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:20.899458 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89a282-b4bb-4dcf-b01e-fb72c23fbfe1 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:20.899951 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89a282-b4bb-4dcf-b01e-fb72c23fbfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:20.900362 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89a282-b4bb-4dcf-b01e-fb72c23fbfe1 admin admin] PATH_INFO: `/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:20.901743 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89a282-b4bb-4dcf-b01e-fb72c23fbfe1 admin admin] RBAC: Authorizing `identity:get_group(group_id=3ce31cbeb3ca4e0b9e28e0388ee48d02)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:20.903907 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89a282-b4bb-4dcf-b01e-fb72c23fbfe1 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:20.911971 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 210/429] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Jan 10 12:35:20 2022] GET /identity/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:20.912112 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47eaf3a-ef3a-4a46-ac8d-e490e1cf99d9 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:20.926810 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47eaf3a-ef3a-4a46-ac8d-e490e1cf99d9 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:20.936834 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04974a37-451b-4a50-88c2-a0a435b79fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:20.937968 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04974a37-451b-4a50-88c2-a0a435b79fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:20.938449 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04974a37-451b-4a50-88c2-a0a435b79fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:20.938923 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04974a37-451b-4a50-88c2-a0a435b79fc0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:20.940493 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04974a37-451b-4a50-88c2-a0a435b79fc0 admin admin] RBAC: Adding query filter params (group.id=3ce31cbeb3ca4e0b9e28e0388ee48d02, role.id=6d59759e4d584ea688a6c0883ef5d9c6, scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:20.941006 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04974a37-451b-4a50-88c2-a0a435b79fc0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:20.943259 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04974a37-451b-4a50-88c2-a0a435b79fc0 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:20.955662 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 220/430] 10.222.0.13 () {56 vars in 1397 bytes} [Mon Jan 10 12:35:20 2022] GET /identity/v3/role_assignments?group.id=3ce31cbeb3ca4e0b9e28e0388ee48d02&scope.project.id=28a2db78a87c4bd69fde46b3f80e8b5e&role.id=6d59759e4d584ea688a6c0883ef5d9c6 => generated 611 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:21.190964 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ec214-1256-44a7-9beb-b30a51b0b08b None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:21.191740 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ec214-1256-44a7-9beb-b30a51b0b08b None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:21.192241 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ec214-1256-44a7-9beb-b30a51b0b08b None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:21.194242 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 211/431] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:21.200458 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889fe6b-d496-457b-9c69-f927997c13d9 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:21.201002 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889fe6b-d496-457b-9c69-f927997c13d9 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:21.201468 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889fe6b-d496-457b-9c69-f927997c13d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:21.223231 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-8889fe6b-d496-457b-9c69-f927997c13d9 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:21.224801 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-8889fe6b-d496-457b-9c69-f927997c13d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:21.236118 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 221/432] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:21.261492 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ec214-1256-44a7-9beb-b30a51b0b08b None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:21.276613 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ec214-1256-44a7-9beb-b30a51b0b08b None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:21.282836 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ba64e-fe92-40c9-b847-02e893abdab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:21.283980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ba64e-fe92-40c9-b847-02e893abdab3 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:21.284460 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ba64e-fe92-40c9-b847-02e893abdab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:21.284922 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ba64e-fe92-40c9-b847-02e893abdab3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:21.299717 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ba64e-fe92-40c9-b847-02e893abdab3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:21.307024 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-8b0ba64e-fe92-40c9-b847-02e893abdab3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 10 12:35:21.308610 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 212/433] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:21.314688 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889fe6b-d496-457b-9c69-f927997c13d9 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:21.324683 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889fe6b-d496-457b-9c69-f927997c13d9 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:21.332553 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb57a3-2adf-48f5-935d-506e6db6d402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:21.333238 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb57a3-2adf-48f5-935d-506e6db6d402 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:21.333513 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb57a3-2adf-48f5-935d-506e6db6d402 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:21.333779 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb57a3-2adf-48f5-935d-506e6db6d402 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:21.334618 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb57a3-2adf-48f5-935d-506e6db6d402 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:21.334909 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb57a3-2adf-48f5-935d-506e6db6d402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:21.336732 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb57a3-2adf-48f5-935d-506e6db6d402 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:21.346941 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 222/434] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:35:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:21.352492 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ba64e-fe92-40c9-b847-02e893abdab3 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:21.363604 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ba64e-fe92-40c9-b847-02e893abdab3 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:21.368411 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46909ce4-24a0-4a9a-8ed5-609158954a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:21.369065 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46909ce4-24a0-4a9a-8ed5-609158954a0e admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:21.369458 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46909ce4-24a0-4a9a-8ed5-609158954a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:21.370463 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46909ce4-24a0-4a9a-8ed5-609158954a0e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:21.379684 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46909ce4-24a0-4a9a-8ed5-609158954a0e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:21.381550 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46909ce4-24a0-4a9a-8ed5-609158954a0e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:21.392151 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 213/435] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:21.397919 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb57a3-2adf-48f5-935d-506e6db6d402 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:21.408678 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb57a3-2adf-48f5-935d-506e6db6d402 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:21.413034 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4694f57-3581-4200-a058-5a91722a504b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:21.413904 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4694f57-3581-4200-a058-5a91722a504b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:21.414176 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4694f57-3581-4200-a058-5a91722a504b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:21.414438 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4694f57-3581-4200-a058-5a91722a504b admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:21.415862 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4694f57-3581-4200-a058-5a91722a504b admin admin] RBAC: Authorizing `identity:get_project(project_id=098496e4eb9b450d987e89a0eed6c412)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:21.418772 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4694f57-3581-4200-a058-5a91722a504b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:21.420938 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 223/436] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:21 2022] GET /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:21.426582 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46909ce4-24a0-4a9a-8ed5-609158954a0e admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:21.436589 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46909ce4-24a0-4a9a-8ed5-609158954a0e admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:21.442627 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980531c-4680-44e5-ae2d-d58b3d3125e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:21.443430 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980531c-4680-44e5-ae2d-d58b3d3125e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:21.443740 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980531c-4680-44e5-ae2d-d58b3d3125e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:21.444006 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980531c-4680-44e5-ae2d-d58b3d3125e4 admin admin] PATH_INFO: `/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:21.445266 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980531c-4680-44e5-ae2d-d58b3d3125e4 admin admin] RBAC: Authorizing `identity:get_group(group_id=3ce31cbeb3ca4e0b9e28e0388ee48d02)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:21.447244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980531c-4680-44e5-ae2d-d58b3d3125e4 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:21.450110 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 214/437] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Jan 10 12:35:21 2022] GET /identity/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:21.456202 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4694f57-3581-4200-a058-5a91722a504b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:21.468930 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4694f57-3581-4200-a058-5a91722a504b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:21.475571 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cecf25-f219-4dd7-81e4-c7120eecc266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:21.476289 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cecf25-f219-4dd7-81e4-c7120eecc266 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:21.476709 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cecf25-f219-4dd7-81e4-c7120eecc266 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:21.477256 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cecf25-f219-4dd7-81e4-c7120eecc266 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:21.478156 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cecf25-f219-4dd7-81e4-c7120eecc266 admin admin] RBAC: Adding query filter params (group.id=3ce31cbeb3ca4e0b9e28e0388ee48d02, role.id=e4d526676145442ab5838d824be7bf59, scope.project.id=098496e4eb9b450d987e89a0eed6c412) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:21.478462 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cecf25-f219-4dd7-81e4-c7120eecc266 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:21.481007 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cecf25-f219-4dd7-81e4-c7120eecc266 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:21.491605 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 224/438] 10.222.0.13 () {56 vars in 1397 bytes} [Mon Jan 10 12:35:21 2022] GET /identity/v3/role_assignments?group.id=3ce31cbeb3ca4e0b9e28e0388ee48d02&scope.project.id=098496e4eb9b450d987e89a0eed6c412&role.id=e4d526676145442ab5838d824be7bf59 => generated 611 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:21.898890 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52071ec-f0f6-44d2-9ab3-6f4a447c5195 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:21.899439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52071ec-f0f6-44d2-9ab3-6f4a447c5195 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:21.899439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52071ec-f0f6-44d2-9ab3-6f4a447c5195 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:21.902150 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 215/439] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:21.907340 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea5118-6d64-4dcc-bd9b-4cd4fb227bed None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:21.907894 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea5118-6d64-4dcc-bd9b-4cd4fb227bed None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:21.907894 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea5118-6d64-4dcc-bd9b-4cd4fb227bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:21.927015 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-8bea5118-6d64-4dcc-bd9b-4cd4fb227bed None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:21.928220 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-8bea5118-6d64-4dcc-bd9b-4cd4fb227bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:21.936504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 225/440] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:21.962367 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52071ec-f0f6-44d2-9ab3-6f4a447c5195 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:21.975878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52071ec-f0f6-44d2-9ab3-6f4a447c5195 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:21.980840 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab639a6-7452-4821-aea5-2c412892611a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:21.981647 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab639a6-7452-4821-aea5-2c412892611a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:21.981919 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab639a6-7452-4821-aea5-2c412892611a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:21.982183 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab639a6-7452-4821-aea5-2c412892611a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:21.992554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab639a6-7452-4821-aea5-2c412892611a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:22.001478 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-dab639a6-7452-4821-aea5-2c412892611a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 12:35:22.002703 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 216/441] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:35:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:22.008612 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea5118-6d64-4dcc-bd9b-4cd4fb227bed None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:22.019504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea5118-6d64-4dcc-bd9b-4cd4fb227bed None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:22.025198 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a56ff7-3cdc-4e2c-8180-c002ea1c0f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:22.025947 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a56ff7-3cdc-4e2c-8180-c002ea1c0f9d admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:22.026290 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a56ff7-3cdc-4e2c-8180-c002ea1c0f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:22.026614 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a56ff7-3cdc-4e2c-8180-c002ea1c0f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:22.027383 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a56ff7-3cdc-4e2c-8180-c002ea1c0f9d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:22.027717 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a56ff7-3cdc-4e2c-8180-c002ea1c0f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:22.029339 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a56ff7-3cdc-4e2c-8180-c002ea1c0f9d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:22.038047 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 226/442] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:22.044083 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab639a6-7452-4821-aea5-2c412892611a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:22.053998 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab639a6-7452-4821-aea5-2c412892611a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:22.060157 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db328c6-e922-436d-81a5-0477fd10fa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:22.060782 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db328c6-e922-436d-81a5-0477fd10fa4d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:22.061053 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db328c6-e922-436d-81a5-0477fd10fa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:22.061312 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db328c6-e922-436d-81a5-0477fd10fa4d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:22.070620 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db328c6-e922-436d-81a5-0477fd10fa4d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:22.072917 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db328c6-e922-436d-81a5-0477fd10fa4d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:22.081701 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 217/443] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:22.087444 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a56ff7-3cdc-4e2c-8180-c002ea1c0f9d admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:22.097848 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a56ff7-3cdc-4e2c-8180-c002ea1c0f9d admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:22.103314 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1c279-b969-4d08-9abd-6bc8fd238d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:22.104355 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1c279-b969-4d08-9abd-6bc8fd238d8b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:22.104627 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1c279-b969-4d08-9abd-6bc8fd238d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:22.104920 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1c279-b969-4d08-9abd-6bc8fd238d8b admin admin] PATH_INFO: `/v3/projects/098496e4eb9b450d987e89a0eed6c412` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:22.109136 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1c279-b969-4d08-9abd-6bc8fd238d8b admin admin] RBAC: Authorizing `identity:get_project(project_id=098496e4eb9b450d987e89a0eed6c412)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:22.109136 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1c279-b969-4d08-9abd-6bc8fd238d8b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:22.110385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 227/444] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:22 2022] GET /identity/v3/projects/098496e4eb9b450d987e89a0eed6c412 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:22.116148 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db328c6-e922-436d-81a5-0477fd10fa4d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:22.128003 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db328c6-e922-436d-81a5-0477fd10fa4d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:22.133700 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a249c3e-b356-4867-b14a-696b78dd3a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:22.134544 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a249c3e-b356-4867-b14a-696b78dd3a1b admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:22.135063 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a249c3e-b356-4867-b14a-696b78dd3a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:22.135560 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a249c3e-b356-4867-b14a-696b78dd3a1b admin admin] PATH_INFO: `/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:22.136894 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a249c3e-b356-4867-b14a-696b78dd3a1b admin admin] RBAC: Authorizing `identity:get_group(group_id=3ce31cbeb3ca4e0b9e28e0388ee48d02)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:22.138797 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a249c3e-b356-4867-b14a-696b78dd3a1b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:22.140410 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 218/445] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Jan 10 12:35:22 2022] GET /identity/v3/groups/3ce31cbeb3ca4e0b9e28e0388ee48d02 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:22.146284 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1c279-b969-4d08-9abd-6bc8fd238d8b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:22.156818 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1c279-b969-4d08-9abd-6bc8fd238d8b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:22.161907 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042fc08-576d-4fcd-970a-c6da78bb4363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:22.162522 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042fc08-576d-4fcd-970a-c6da78bb4363 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:22.162826 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042fc08-576d-4fcd-970a-c6da78bb4363 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:22.163096 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042fc08-576d-4fcd-970a-c6da78bb4363 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:22.163968 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042fc08-576d-4fcd-970a-c6da78bb4363 admin admin] RBAC: Adding query filter params (group.id=3ce31cbeb3ca4e0b9e28e0388ee48d02, role.id=6d59759e4d584ea688a6c0883ef5d9c6, scope.project.id=098496e4eb9b450d987e89a0eed6c412) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:22.164275 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042fc08-576d-4fcd-970a-c6da78bb4363 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:22.166105 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042fc08-576d-4fcd-970a-c6da78bb4363 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:22.172503 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 228/446] 10.222.0.13 () {56 vars in 1397 bytes} [Mon Jan 10 12:35:22 2022] GET /identity/v3/role_assignments?group.id=3ce31cbeb3ca4e0b9e28e0388ee48d02&scope.project.id=098496e4eb9b450d987e89a0eed6c412&role.id=6d59759e4d584ea688a6c0883ef5d9c6 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:22.415551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d491692-91db-4bdd-bafd-b2b4469a8fc2 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:22.415813 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d491692-91db-4bdd-bafd-b2b4469a8fc2 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:22.416254 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d491692-91db-4bdd-bafd-b2b4469a8fc2 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:22.418528 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 219/447] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:22.423903 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d71da-0421-4c8d-b851-9d85b9807d00 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:22.424265 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d71da-0421-4c8d-b851-9d85b9807d00 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:22.424606 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d71da-0421-4c8d-b851-9d85b9807d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:22.445313 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-a63d71da-0421-4c8d-b851-9d85b9807d00 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:22.446499 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-a63d71da-0421-4c8d-b851-9d85b9807d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:22.456505 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 229/448] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:22.482515 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d491692-91db-4bdd-bafd-b2b4469a8fc2 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:22.495362 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d491692-91db-4bdd-bafd-b2b4469a8fc2 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:22.499882 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59ce33-4785-4ba5-b34f-236da9beab59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:22.500654 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59ce33-4785-4ba5-b34f-236da9beab59 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:22.500927 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59ce33-4785-4ba5-b34f-236da9beab59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:22.501158 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59ce33-4785-4ba5-b34f-236da9beab59 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:22.511800 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59ce33-4785-4ba5-b34f-236da9beab59 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:22.518390 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-ce59ce33-4785-4ba5-b34f-236da9beab59 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:35:22.519619 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 220/449] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:35:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:22.525464 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d71da-0421-4c8d-b851-9d85b9807d00 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:22.534431 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d71da-0421-4c8d-b851-9d85b9807d00 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:22.539388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa3b6c-837e-4258-80a7-3abda07907a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:22.540085 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa3b6c-837e-4258-80a7-3abda07907a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:22.540361 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa3b6c-837e-4258-80a7-3abda07907a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:22.540626 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa3b6c-837e-4258-80a7-3abda07907a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:22.541449 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa3b6c-837e-4258-80a7-3abda07907a4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:22.543960 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa3b6c-837e-4258-80a7-3abda07907a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:22.543960 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa3b6c-837e-4258-80a7-3abda07907a4 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:22.552198 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 230/450] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:22.558010 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59ce33-4785-4ba5-b34f-236da9beab59 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:22.568312 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59ce33-4785-4ba5-b34f-236da9beab59 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:22.573106 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf504a1-1d69-4c36-a5b6-81b46f516177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:22.573735 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf504a1-1d69-4c36-a5b6-81b46f516177 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:22.574010 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf504a1-1d69-4c36-a5b6-81b46f516177 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:22.574281 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf504a1-1d69-4c36-a5b6-81b46f516177 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:22.582987 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf504a1-1d69-4c36-a5b6-81b46f516177 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:22.584783 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf504a1-1d69-4c36-a5b6-81b46f516177 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:22.593667 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 221/451] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 12:35:22.599385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa3b6c-837e-4258-80a7-3abda07907a4 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:22.609816 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa3b6c-837e-4258-80a7-3abda07907a4 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:22.614480 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad291e7f-f1de-42fb-a1b2-0205f6466b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:22.615336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad291e7f-f1de-42fb-a1b2-0205f6466b4c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:22.615658 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad291e7f-f1de-42fb-a1b2-0205f6466b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:22.615930 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad291e7f-f1de-42fb-a1b2-0205f6466b4c admin admin] PATH_INFO: `/v3/projects/230e0a61baae4ee798a1e664588228fe` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:22.617209 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad291e7f-f1de-42fb-a1b2-0205f6466b4c admin admin] RBAC: Authorizing `identity:get_project(project_id=230e0a61baae4ee798a1e664588228fe)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:22.619022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad291e7f-f1de-42fb-a1b2-0205f6466b4c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:22.620813 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 231/452] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:35:22 2022] GET /identity/v3/projects/230e0a61baae4ee798a1e664588228fe => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:22.625963 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf504a1-1d69-4c36-a5b6-81b46f516177 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:22.635785 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf504a1-1d69-4c36-a5b6-81b46f516177 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:22.640412 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1568b2-0f76-4217-90d5-993f05292973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:22.641244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1568b2-0f76-4217-90d5-993f05292973 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:22.641524 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1568b2-0f76-4217-90d5-993f05292973 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:22.641801 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1568b2-0f76-4217-90d5-993f05292973 admin admin] PATH_INFO: `/v3/groups/36572c0643ad4544aafce7de797a4318` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:22.643082 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1568b2-0f76-4217-90d5-993f05292973 admin admin] RBAC: Authorizing `identity:get_group(group_id=36572c0643ad4544aafce7de797a4318)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:22.645039 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1568b2-0f76-4217-90d5-993f05292973 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:22.646593 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 222/453] 10.222.0.13 () {56 vars in 1201 bytes} [Mon Jan 10 12:35:22 2022] GET /identity/v3/groups/36572c0643ad4544aafce7de797a4318 => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:22.652136 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad291e7f-f1de-42fb-a1b2-0205f6466b4c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:22.661640 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad291e7f-f1de-42fb-a1b2-0205f6466b4c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:22.666632 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fad45-bd81-481a-9be9-e02a7fd6f2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:22.667185 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fad45-bd81-481a-9be9-e02a7fd6f2cb admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:22.667467 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fad45-bd81-481a-9be9-e02a7fd6f2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:22.667835 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fad45-bd81-481a-9be9-e02a7fd6f2cb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:22.668771 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fad45-bd81-481a-9be9-e02a7fd6f2cb admin admin] RBAC: Adding query filter params (group.id=36572c0643ad4544aafce7de797a4318, role.id=9d097c033f454263a874fbafe92c9aea, scope.project.id=230e0a61baae4ee798a1e664588228fe) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:22.669081 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fad45-bd81-481a-9be9-e02a7fd6f2cb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:22.670885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fad45-bd81-481a-9be9-e02a7fd6f2cb admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:22.676777 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 232/454] 10.222.0.13 () {56 vars in 1397 bytes} [Mon Jan 10 12:35:22 2022] GET /identity/v3/role_assignments?group.id=36572c0643ad4544aafce7de797a4318&scope.project.id=230e0a61baae4ee798a1e664588228fe&role.id=9d097c033f454263a874fbafe92c9aea => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:25.524482 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5634bc-d8fc-448a-9d85-f2f0cc56ec90 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:25.525014 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5634bc-d8fc-448a-9d85-f2f0cc56ec90 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:25.525014 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5634bc-d8fc-448a-9d85-f2f0cc56ec90 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:25.527179 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 223/455] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:25.532541 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12839fc2-04d0-421c-aa1c-237a40c51dcd None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:25.533007 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12839fc2-04d0-421c-aa1c-237a40c51dcd None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:25.533084 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12839fc2-04d0-421c-aa1c-237a40c51dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:25.550946 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-12839fc2-04d0-421c-aa1c-237a40c51dcd None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:25.552174 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-12839fc2-04d0-421c-aa1c-237a40c51dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:25.560433 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 233/456] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:25.609327 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5634bc-d8fc-448a-9d85-f2f0cc56ec90 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:25.628768 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5634bc-d8fc-448a-9d85-f2f0cc56ec90 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:25.633246 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd28d-289e-44a1-844e-01f0dc32e5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:25.634036 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd28d-289e-44a1-844e-01f0dc32e5cc admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:25.634312 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd28d-289e-44a1-844e-01f0dc32e5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:25.634576 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dd28d-289e-44a1-844e-01f0dc32e5cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:25.645698 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dd28d-289e-44a1-844e-01f0dc32e5cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:25.647559 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dd28d-289e-44a1-844e-01f0dc32e5cc admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:25.672445 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-5a4dd28d-289e-44a1-844e-01f0dc32e5cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:25.673680 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 224/457] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:25.679547 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12839fc2-04d0-421c-aa1c-237a40c51dcd None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:25.688783 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12839fc2-04d0-421c-aa1c-237a40c51dcd None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:25.693962 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738d70e-6e22-4b46-9cd5-f2d0869401b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:25.694630 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738d70e-6e22-4b46-9cd5-f2d0869401b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:25.694909 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738d70e-6e22-4b46-9cd5-f2d0869401b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:25.695179 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738d70e-6e22-4b46-9cd5-f2d0869401b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:25.695972 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738d70e-6e22-4b46-9cd5-f2d0869401b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:25.696275 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738d70e-6e22-4b46-9cd5-f2d0869401b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:25.697351 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING py.warnings [None req-e738d70e-6e22-4b46-9cd5-f2d0869401b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:35:25.697351 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: warnings.warn(msg) Jan 10 12:35:25.697351 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: Jan 10 12:35:25.698230 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738d70e-6e22-4b46-9cd5-f2d0869401b3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:25.716302 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 234/458] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:25.721674 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd28d-289e-44a1-844e-01f0dc32e5cc admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:25.732023 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dd28d-289e-44a1-844e-01f0dc32e5cc admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:25.737096 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cfa55-4145-41b6-a162-2d76f849d1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:25.737767 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cfa55-4145-41b6-a162-2d76f849d1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:25.738046 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cfa55-4145-41b6-a162-2d76f849d1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:25.738314 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cfa55-4145-41b6-a162-2d76f849d1f6 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:25.739068 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0cfa55-4145-41b6-a162-2d76f849d1f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:25.741034 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0cfa55-4145-41b6-a162-2d76f849d1f6 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:25.764005 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 225/459] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Jan 10 12:35:25 2022] POST /identity/v3/users => generated 246 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:35:25.973117 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0daec8-47f9-4e5f-b5b6-e59302593459 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:25.973519 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0daec8-47f9-4e5f-b5b6-e59302593459 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:25.973700 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0daec8-47f9-4e5f-b5b6-e59302593459 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:25.975867 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 235/460] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:25.981533 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcd83b-d47e-42a4-bdbd-89070d1434af None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:25.981826 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcd83b-d47e-42a4-bdbd-89070d1434af None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:25.982064 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcd83b-d47e-42a4-bdbd-89070d1434af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:26.013123 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-56fcd83b-d47e-42a4-bdbd-89070d1434af None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:26.013591 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b229d8-b6b8-4be0-aac0-fe2221bf73c4 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:26.013591 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b229d8-b6b8-4be0-aac0-fe2221bf73c4 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:26.013591 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b229d8-b6b8-4be0-aac0-fe2221bf73c4 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:26.014244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-56fcd83b-d47e-42a4-bdbd-89070d1434af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:26.014490 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 236/461] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:35:26.023550 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 226/462] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:26.044551 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47982936-08cb-4be5-b9b6-f56e6f2a2bb6 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:26.044873 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47982936-08cb-4be5-b9b6-f56e6f2a2bb6 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:26.045104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47982936-08cb-4be5-b9b6-f56e6f2a2bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:26.055753 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcd83b-d47e-42a4-bdbd-89070d1434af None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:26.067701 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-47982936-08cb-4be5-b9b6-f56e6f2a2bb6 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:26.068907 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-47982936-08cb-4be5-b9b6-f56e6f2a2bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:26.069338 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcd83b-d47e-42a4-bdbd-89070d1434af None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:26.075228 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e4d1c-f163-4be8-ab2c-6ee40386980e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:26.076496 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e4d1c-f163-4be8-ab2c-6ee40386980e admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:26.076995 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e4d1c-f163-4be8-ab2c-6ee40386980e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:26.077486 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e4d1c-f163-4be8-ab2c-6ee40386980e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:26.079560 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 237/463] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:26.094663 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e4d1c-f163-4be8-ab2c-6ee40386980e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:26.096878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e4d1c-f163-4be8-ab2c-6ee40386980e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:26.106623 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47982936-08cb-4be5-b9b6-f56e6f2a2bb6 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:26.114391 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-cb2e4d1c-f163-4be8-ab2c-6ee40386980e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:26.115941 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 227/464] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:26.116976 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47982936-08cb-4be5-b9b6-f56e6f2a2bb6 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:26.122239 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e4d1c-f163-4be8-ab2c-6ee40386980e admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:26.123008 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f444a-e04b-4855-847c-9021c56e5e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:26.124103 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f444a-e04b-4855-847c-9021c56e5e08 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:26.124578 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f444a-e04b-4855-847c-9021c56e5e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:26.125036 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f444a-e04b-4855-847c-9021c56e5e08 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:26.133193 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e4d1c-f163-4be8-ab2c-6ee40386980e admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:26.138283 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f444a-e04b-4855-847c-9021c56e5e08 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:26.138657 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da65a95-e755-45c2-beeb-0b284c8e72c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:26.139329 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da65a95-e755-45c2-beeb-0b284c8e72c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:26.139648 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da65a95-e755-45c2-beeb-0b284c8e72c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:26.139922 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da65a95-e755-45c2-beeb-0b284c8e72c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:26.140686 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da65a95-e755-45c2-beeb-0b284c8e72c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:26.140972 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da65a95-e755-45c2-beeb-0b284c8e72c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:26.141744 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f444a-e04b-4855-847c-9021c56e5e08 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:26.143117 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da65a95-e755-45c2-beeb-0b284c8e72c1 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:26.155342 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 228/465] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:26.160812 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da65a95-e755-45c2-beeb-0b284c8e72c1 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:26.166631 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-440f444a-e04b-4855-847c-9021c56e5e08 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:26.168628 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 238/466] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:26.174412 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f444a-e04b-4855-847c-9021c56e5e08 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:26.174557 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da65a95-e755-45c2-beeb-0b284c8e72c1 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:26.180089 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5e04f-d9d4-4591-9211-d3e9a465878b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:26.181385 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5e04f-d9d4-4591-9211-d3e9a465878b admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:26.181773 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5e04f-d9d4-4591-9211-d3e9a465878b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:26.182113 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5e04f-d9d4-4591-9211-d3e9a465878b admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:26.182902 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5e04f-d9d4-4591-9211-d3e9a465878b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:26.185189 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5e04f-d9d4-4591-9211-d3e9a465878b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:26.185823 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f444a-e04b-4855-847c-9021c56e5e08 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:26.192182 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e14cbd-be47-425d-8ff3-6779ae2be7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:26.193060 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e14cbd-be47-425d-8ff3-6779ae2be7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:26.193504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e14cbd-be47-425d-8ff3-6779ae2be7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:26.193964 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e14cbd-be47-425d-8ff3-6779ae2be7e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:26.194953 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e14cbd-be47-425d-8ff3-6779ae2be7e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:26.195442 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e14cbd-be47-425d-8ff3-6779ae2be7e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:26.197490 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e14cbd-be47-425d-8ff3-6779ae2be7e4 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:26.212659 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 239/468] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:26.212918 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 229/468] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Jan 10 12:35:26 2022] POST /identity/v3/users => generated 248 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:35:26.219037 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e14cbd-be47-425d-8ff3-6779ae2be7e4 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:26.230526 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e14cbd-be47-425d-8ff3-6779ae2be7e4 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:26.235322 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba5e18-4b65-4950-a691-df1a88a6d51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:26.236176 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba5e18-4b65-4950-a691-df1a88a6d51a admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:26.236457 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba5e18-4b65-4950-a691-df1a88a6d51a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:26.236720 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba5e18-4b65-4950-a691-df1a88a6d51a admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:26.237502 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba5e18-4b65-4950-a691-df1a88a6d51a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:26.239647 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba5e18-4b65-4950-a691-df1a88a6d51a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:26.268337 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325faecb-51b6-442d-9810-24b7dd9a9801 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:26.268965 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 240/469] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Jan 10 12:35:26 2022] POST /identity/v3/users => generated 248 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:35:26.269244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325faecb-51b6-442d-9810-24b7dd9a9801 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:26.269708 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325faecb-51b6-442d-9810-24b7dd9a9801 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:26.272886 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 230/470] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:26.277560 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e8b6a-f962-40b9-94fd-8e465d24bbdc None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:26.277873 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e8b6a-f962-40b9-94fd-8e465d24bbdc None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:26.278104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e8b6a-f962-40b9-94fd-8e465d24bbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:26.301962 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-0a5e8b6a-f962-40b9-94fd-8e465d24bbdc None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:26.303196 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-0a5e8b6a-f962-40b9-94fd-8e465d24bbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:26.315804 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 241/471] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:26.371614 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325faecb-51b6-442d-9810-24b7dd9a9801 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:26.388975 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325faecb-51b6-442d-9810-24b7dd9a9801 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:26.393367 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0b7c6-0538-4fba-a3a6-1f8eef618295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:26.394237 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0b7c6-0538-4fba-a3a6-1f8eef618295 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:26.394515 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0b7c6-0538-4fba-a3a6-1f8eef618295 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:26.394830 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0b7c6-0538-4fba-a3a6-1f8eef618295 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:26.412369 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0b7c6-0538-4fba-a3a6-1f8eef618295 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:26.414256 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0b7c6-0538-4fba-a3a6-1f8eef618295 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:26.436087 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-b6a0b7c6-0538-4fba-a3a6-1f8eef618295 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:26.437360 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 231/472] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:26.444108 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e8b6a-f962-40b9-94fd-8e465d24bbdc None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:26.462019 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e8b6a-f962-40b9-94fd-8e465d24bbdc None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:26.473469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0800a0b-336f-4b11-9601-c1fdf3f76a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:26.474166 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0800a0b-336f-4b11-9601-c1fdf3f76a12 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:26.474443 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0800a0b-336f-4b11-9601-c1fdf3f76a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:26.474711 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0800a0b-336f-4b11-9601-c1fdf3f76a12 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:26.475479 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0800a0b-336f-4b11-9601-c1fdf3f76a12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:26.475807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0800a0b-336f-4b11-9601-c1fdf3f76a12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:26.477494 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0800a0b-336f-4b11-9601-c1fdf3f76a12 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:26.501713 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 242/473] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:26.507234 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0b7c6-0538-4fba-a3a6-1f8eef618295 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:26.519778 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0b7c6-0538-4fba-a3a6-1f8eef618295 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:26.524500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7be95b-8948-4120-ad5c-43ae9a2576bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:26.525204 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7be95b-8948-4120-ad5c-43ae9a2576bd admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:26.525550 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7be95b-8948-4120-ad5c-43ae9a2576bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:26.525822 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7be95b-8948-4120-ad5c-43ae9a2576bd admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:26.526590 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7be95b-8948-4120-ad5c-43ae9a2576bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:26.528664 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7be95b-8948-4120-ad5c-43ae9a2576bd admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:26.554566 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 232/474] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Jan 10 12:35:26 2022] POST /identity/v3/users => generated 249 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:35:27.235765 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6093-a086-4466-bb7a-99e3bdcbcd69 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:27.236301 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6093-a086-4466-bb7a-99e3bdcbcd69 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:27.236301 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6093-a086-4466-bb7a-99e3bdcbcd69 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:27.238339 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 243/475] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:27.243876 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb19a6-5ecb-40d0-a356-17fa93149b3d None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:27.244474 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb19a6-5ecb-40d0-a356-17fa93149b3d None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:27.244474 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb19a6-5ecb-40d0-a356-17fa93149b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:27.269452 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-e7fb19a6-5ecb-40d0-a356-17fa93149b3d None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:27.270679 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e7fb19a6-5ecb-40d0-a356-17fa93149b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:27.283319 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 233/476] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:35:27.321716 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a6093-a086-4466-bb7a-99e3bdcbcd69 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:27.341571 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a6093-a086-4466-bb7a-99e3bdcbcd69 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:27.350079 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47885844-9bce-41e0-aa64-4b3a4024012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:27.350761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47885844-9bce-41e0-aa64-4b3a4024012e admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:27.351067 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47885844-9bce-41e0-aa64-4b3a4024012e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:27.351335 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47885844-9bce-41e0-aa64-4b3a4024012e admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:27.352148 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47885844-9bce-41e0-aa64-4b3a4024012e admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:27.353181 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING py.warnings [None req-47885844-9bce-41e0-aa64-4b3a4024012e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:35:27.353181 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: warnings.warn(msg) Jan 10 12:35:27.353181 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: Jan 10 12:35:27.354107 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47885844-9bce-41e0-aa64-4b3a4024012e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:27.369001 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.sql.core [None req-47885844-9bce-41e0-aa64-4b3a4024012e admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jan 10 12:35:27.369001 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jan 10 12:35:27.369001 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [parameters: {'id': 'f39bd430050d47ab9aade69205ac37cf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jan 10 12:35:27.369001 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86081) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 10 12:35:27.383318 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-47885844-9bce-41e0-aa64-4b3a4024012e admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jan 10 12:35:27.385201 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 244/477] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:35:27 2022] POST /identity/v3/roles => generated 144 bytes in 64 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:27.390584 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb19a6-5ecb-40d0-a356-17fa93149b3d None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:27.404874 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb19a6-5ecb-40d0-a356-17fa93149b3d None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:27.412255 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d730f-d645-4c45-bfe8-fa749734f37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:27.413071 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d730f-d645-4c45-bfe8-fa749734f37e admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:27.413343 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d730f-d645-4c45-bfe8-fa749734f37e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:27.413607 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d730f-d645-4c45-bfe8-fa749734f37e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:27.431782 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d730f-d645-4c45-bfe8-fa749734f37e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:27.438921 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-392d730f-d645-4c45-bfe8-fa749734f37e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 10 12:35:27.445104 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 234/478] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:35:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:27.446186 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47885844-9bce-41e0-aa64-4b3a4024012e admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:27.465616 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47885844-9bce-41e0-aa64-4b3a4024012e admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:27.479013 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13304d2e-78c4-47d6-a3ea-a5ee77a56c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:27.479739 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13304d2e-78c4-47d6-a3ea-a5ee77a56c13 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:27.480018 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13304d2e-78c4-47d6-a3ea-a5ee77a56c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:27.480286 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13304d2e-78c4-47d6-a3ea-a5ee77a56c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:27.481067 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13304d2e-78c4-47d6-a3ea-a5ee77a56c13 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:27.481370 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13304d2e-78c4-47d6-a3ea-a5ee77a56c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:27.483035 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13304d2e-78c4-47d6-a3ea-a5ee77a56c13 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:27.495385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 245/479] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:28.843369 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a05f7c-76bc-4e83-96b1-669fcaf21a6c None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:28.843924 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a05f7c-76bc-4e83-96b1-669fcaf21a6c None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:28.843924 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a05f7c-76bc-4e83-96b1-669fcaf21a6c None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:28.845993 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 235/480] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:28.850832 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ef480-6abe-41ad-a7d4-d8a674deeec6 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:28.851254 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ef480-6abe-41ad-a7d4-d8a674deeec6 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:28.851351 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ef480-6abe-41ad-a7d4-d8a674deeec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:28.876501 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-047ef480-6abe-41ad-a7d4-d8a674deeec6 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:28.877713 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-047ef480-6abe-41ad-a7d4-d8a674deeec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:28.885489 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 246/481] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:35:28.910532 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a05f7c-76bc-4e83-96b1-669fcaf21a6c None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:28.925619 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a05f7c-76bc-4e83-96b1-669fcaf21a6c None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:28.933199 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496d05e-fa76-4d24-b284-084c9f01c86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:28.934009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496d05e-fa76-4d24-b284-084c9f01c86d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:28.934280 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496d05e-fa76-4d24-b284-084c9f01c86d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:28.934616 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496d05e-fa76-4d24-b284-084c9f01c86d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:28.949411 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d496d05e-fa76-4d24-b284-084c9f01c86d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:28.956314 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-d496d05e-fa76-4d24-b284-084c9f01c86d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:35:28.957848 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 236/482] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:28.963391 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ef480-6abe-41ad-a7d4-d8a674deeec6 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:28.972483 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ef480-6abe-41ad-a7d4-d8a674deeec6 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:28.982801 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b2837-8813-4424-9832-41ee8bd25a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:28.983427 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b2837-8813-4424-9832-41ee8bd25a14 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:28.983734 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b2837-8813-4424-9832-41ee8bd25a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:28.984007 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b2837-8813-4424-9832-41ee8bd25a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:28.984784 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b2837-8813-4424-9832-41ee8bd25a14 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:28.985088 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b2837-8813-4424-9832-41ee8bd25a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:28.986728 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b2837-8813-4424-9832-41ee8bd25a14 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.000274 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 247/483] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:35:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:29.005485 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496d05e-fa76-4d24-b284-084c9f01c86d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.019789 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496d05e-fa76-4d24-b284-084c9f01c86d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.024296 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b470e67-af74-4e8e-8643-b007c667cdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.025099 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b470e67-af74-4e8e-8643-b007c667cdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.025475 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b470e67-af74-4e8e-8643-b007c667cdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.025751 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b470e67-af74-4e8e-8643-b007c667cdb8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.036972 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b470e67-af74-4e8e-8643-b007c667cdb8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.038851 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b470e67-af74-4e8e-8643-b007c667cdb8 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.055558 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-7b470e67-af74-4e8e-8643-b007c667cdb8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:29.057132 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 237/484] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:29.062526 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b2837-8813-4424-9832-41ee8bd25a14 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.076837 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b2837-8813-4424-9832-41ee8bd25a14 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.081930 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99705cc-c2a1-4fcf-bf20-31c4f6f9cd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.082641 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99705cc-c2a1-4fcf-bf20-31c4f6f9cd95 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.082919 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99705cc-c2a1-4fcf-bf20-31c4f6f9cd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.083187 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99705cc-c2a1-4fcf-bf20-31c4f6f9cd95 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.083950 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99705cc-c2a1-4fcf-bf20-31c4f6f9cd95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:29.084251 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99705cc-c2a1-4fcf-bf20-31c4f6f9cd95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.085904 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99705cc-c2a1-4fcf-bf20-31c4f6f9cd95 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.102484 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 248/485] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:29.107586 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b470e67-af74-4e8e-8643-b007c667cdb8 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.117580 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b470e67-af74-4e8e-8643-b007c667cdb8 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.122112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013a600-3e67-4b77-a5db-c6e9bac16149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.122902 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013a600-3e67-4b77-a5db-c6e9bac16149 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.123225 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013a600-3e67-4b77-a5db-c6e9bac16149 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.123493 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013a600-3e67-4b77-a5db-c6e9bac16149 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.136407 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013a600-3e67-4b77-a5db-c6e9bac16149 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.138459 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013a600-3e67-4b77-a5db-c6e9bac16149 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.153228 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-6013a600-3e67-4b77-a5db-c6e9bac16149 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 12:35:29.154795 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 238/486] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:29.163192 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99705cc-c2a1-4fcf-bf20-31c4f6f9cd95 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.164431 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24d20-6643-4c82-bf98-2902e8010468 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.164720 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24d20-6643-4c82-bf98-2902e8010468 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.164987 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24d20-6643-4c82-bf98-2902e8010468 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.166914 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 239/487] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:29.173845 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89bb2f-22a0-49f6-a712-fe90702b3ef1 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.174137 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89bb2f-22a0-49f6-a712-fe90702b3ef1 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.174393 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89bb2f-22a0-49f6-a712-fe90702b3ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.185748 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99705cc-c2a1-4fcf-bf20-31c4f6f9cd95 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.193474 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-dd89bb2f-22a0-49f6-a712-fe90702b3ef1 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:29.194749 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-dd89bb2f-22a0-49f6-a712-fe90702b3ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:29.203230 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 240/488] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:35:29.203773 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d19d43-dad4-4a84-9027-bc557b8843d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.204623 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d19d43-dad4-4a84-9027-bc557b8843d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.205027 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d19d43-dad4-4a84-9027-bc557b8843d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.205439 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d19d43-dad4-4a84-9027-bc557b8843d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.206425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d19d43-dad4-4a84-9027-bc557b8843d2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:29.206852 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d19d43-dad4-4a84-9027-bc557b8843d2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.208057 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING py.warnings [None req-10d19d43-dad4-4a84-9027-bc557b8843d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:35:29.208057 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: warnings.warn(msg) Jan 10 12:35:29.208057 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: Jan 10 12:35:29.209529 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d19d43-dad4-4a84-9027-bc557b8843d2 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.252075 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89bb2f-22a0-49f6-a712-fe90702b3ef1 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.267579 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 249/489] 10.222.0.13 () {56 vars in 1154 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:29.270093 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89bb2f-22a0-49f6-a712-fe90702b3ef1 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.275540 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d187fa4-d27a-4cdc-8459-a0a57e21850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.276401 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d187fa4-d27a-4cdc-8459-a0a57e21850a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.276760 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d187fa4-d27a-4cdc-8459-a0a57e21850a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.277025 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d187fa4-d27a-4cdc-8459-a0a57e21850a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.280539 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d19d43-dad4-4a84-9027-bc557b8843d2 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.288126 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d187fa4-d27a-4cdc-8459-a0a57e21850a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:29.290104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d19d43-dad4-4a84-9027-bc557b8843d2 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.295650 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-5d187fa4-d27a-4cdc-8459-a0a57e21850a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:35:29.297183 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 241/490] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:29.305181 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d187fa4-d27a-4cdc-8459-a0a57e21850a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.307331 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6a5ed-761c-4869-9e19-2eff53d2d6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.308032 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6a5ed-761c-4869-9e19-2eff53d2d6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.308309 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6a5ed-761c-4869-9e19-2eff53d2d6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.308571 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6a5ed-761c-4869-9e19-2eff53d2d6e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.324819 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d187fa4-d27a-4cdc-8459-a0a57e21850a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.326474 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6a5ed-761c-4869-9e19-2eff53d2d6e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.328328 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6a5ed-761c-4869-9e19-2eff53d2d6e1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.338097 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 250/491] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:29.341627 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cef027-ec14-4bd3-baea-fa8a02c42e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.342656 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cef027-ec14-4bd3-baea-fa8a02c42e95 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.343752 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6a5ed-761c-4869-9e19-2eff53d2d6e1 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.345869 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cef027-ec14-4bd3-baea-fa8a02c42e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.346159 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cef027-ec14-4bd3-baea-fa8a02c42e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.347718 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cef027-ec14-4bd3-baea-fa8a02c42e95 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:29.348027 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cef027-ec14-4bd3-baea-fa8a02c42e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.353134 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cef027-ec14-4bd3-baea-fa8a02c42e95 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.358936 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6a5ed-761c-4869-9e19-2eff53d2d6e1 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.370807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad6471-806c-4a12-b579-6e916c752078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.373343 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad6471-806c-4a12-b579-6e916c752078 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.373622 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad6471-806c-4a12-b579-6e916c752078 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.373893 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad6471-806c-4a12-b579-6e916c752078 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.375080 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 242/492] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:29.383341 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d703e87-bbb6-42c1-b60b-e3ec0ba653ed None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.383693 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d703e87-bbb6-42c1-b60b-e3ec0ba653ed None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.384406 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d703e87-bbb6-42c1-b60b-e3ec0ba653ed None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.387095 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 243/493] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:29.388010 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d703e87-bbb6-42c1-b60b-e3ec0ba653ed None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.397291 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad6471-806c-4a12-b579-6e916c752078 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.399233 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad6471-806c-4a12-b579-6e916c752078 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.405210 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d703e87-bbb6-42c1-b60b-e3ec0ba653ed None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.411612 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db216f-0705-45af-97dd-0fb72049572f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.412775 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db216f-0705-45af-97dd-0fb72049572f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.413210 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db216f-0705-45af-97dd-0fb72049572f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.413710 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db216f-0705-45af-97dd-0fb72049572f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.421866 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-31ad6471-806c-4a12-b579-6e916c752078 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:29.427094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 251/494] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:29.427094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161cc3f-d8f4-4226-acb8-8e066b398eef None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.427094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161cc3f-d8f4-4226-acb8-8e066b398eef None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.427094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161cc3f-d8f4-4226-acb8-8e066b398eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.431385 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db216f-0705-45af-97dd-0fb72049572f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.433536 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db216f-0705-45af-97dd-0fb72049572f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.444827 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-7161cc3f-d8f4-4226-acb8-8e066b398eef None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:29.446022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-7161cc3f-d8f4-4226-acb8-8e066b398eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:29.452103 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-69db216f-0705-45af-97dd-0fb72049572f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:29.459551 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 252/495] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:29.459551 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161cc3f-d8f4-4226-acb8-8e066b398eef None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.459784 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 244/496] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:29.462511 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db216f-0705-45af-97dd-0fb72049572f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.473461 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161cc3f-d8f4-4226-acb8-8e066b398eef None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.479098 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db216f-0705-45af-97dd-0fb72049572f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.484661 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7939a53-29c6-488b-a61f-6220806589c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.485359 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7939a53-29c6-488b-a61f-6220806589c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.485638 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7939a53-29c6-488b-a61f-6220806589c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.485916 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7939a53-29c6-488b-a61f-6220806589c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.486663 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7939a53-29c6-488b-a61f-6220806589c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:29.486966 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7939a53-29c6-488b-a61f-6220806589c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.488842 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7939a53-29c6-488b-a61f-6220806589c5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.489851 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5926ab5-8db6-499a-aea2-f369d059836d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.490800 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5926ab5-8db6-499a-aea2-f369d059836d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.491274 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5926ab5-8db6-499a-aea2-f369d059836d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.491852 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5926ab5-8db6-499a-aea2-f369d059836d admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.492912 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5926ab5-8db6-499a-aea2-f369d059836d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:29.493409 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5926ab5-8db6-499a-aea2-f369d059836d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.495597 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5926ab5-8db6-499a-aea2-f369d059836d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.501233 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 253/497] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:29.502208 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7939a53-29c6-488b-a61f-6220806589c5 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.513477 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 245/498] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:29.513639 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7939a53-29c6-488b-a61f-6220806589c5 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.514819 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5926ab5-8db6-499a-aea2-f369d059836d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.516268 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4ba85-60ab-45ce-b515-fc77c9e82ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.517063 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ba85-60ab-45ce-b515-fc77c9e82ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.517344 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ba85-60ab-45ce-b515-fc77c9e82ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.517611 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4ba85-60ab-45ce-b515-fc77c9e82ef3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.526192 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5926ab5-8db6-499a-aea2-f369d059836d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.528969 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4ba85-60ab-45ce-b515-fc77c9e82ef3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:29.531983 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e048653-3bb1-4e9e-8c02-0c6dec3ffdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.533070 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e048653-3bb1-4e9e-8c02-0c6dec3ffdcf admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.533565 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e048653-3bb1-4e9e-8c02-0c6dec3ffdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.534107 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e048653-3bb1-4e9e-8c02-0c6dec3ffdcf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.536483 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-01f4ba85-60ab-45ce-b515-fc77c9e82ef3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:35:29.542637 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 254/499] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:29.542637 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4ba85-60ab-45ce-b515-fc77c9e82ef3 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.547557 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e048653-3bb1-4e9e-8c02-0c6dec3ffdcf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.549071 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4ba85-60ab-45ce-b515-fc77c9e82ef3 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.550189 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e048653-3bb1-4e9e-8c02-0c6dec3ffdcf admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.553620 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1fa5d-1a98-46f7-9e2f-aa33bf0d02a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.554389 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1fa5d-1a98-46f7-9e2f-aa33bf0d02a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.554666 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1fa5d-1a98-46f7-9e2f-aa33bf0d02a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.554935 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1fa5d-1a98-46f7-9e2f-aa33bf0d02a1 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.562629 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1fa5d-1a98-46f7-9e2f-aa33bf0d02a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.564703 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1fa5d-1a98-46f7-9e2f-aa33bf0d02a1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.567133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-7e048653-3bb1-4e9e-8c02-0c6dec3ffdcf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:29.569014 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 246/500] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:29.569982 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e048653-3bb1-4e9e-8c02-0c6dec3ffdcf admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.579293 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-0cb1fa5d-1a98-46f7-9e2f-aa33bf0d02a1 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 10 12:35:29.580498 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e048653-3bb1-4e9e-8c02-0c6dec3ffdcf admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.580632 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 255/501] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:29.581360 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1fa5d-1a98-46f7-9e2f-aa33bf0d02a1 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.585932 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7a7d1-54b4-47f1-8a39-b215f1fa2048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.587028 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7a7d1-54b4-47f1-8a39-b215f1fa2048 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.587504 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7a7d1-54b4-47f1-8a39-b215f1fa2048 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.588112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7a7d1-54b4-47f1-8a39-b215f1fa2048 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.589110 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7a7d1-54b4-47f1-8a39-b215f1fa2048 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:29.589611 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7a7d1-54b4-47f1-8a39-b215f1fa2048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.591594 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7a7d1-54b4-47f1-8a39-b215f1fa2048 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.592508 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1fa5d-1a98-46f7-9e2f-aa33bf0d02a1 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.596888 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3758eca-33b6-49c0-b18c-d1de9034ea6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.597536 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3758eca-33b6-49c0-b18c-d1de9034ea6a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.597822 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3758eca-33b6-49c0-b18c-d1de9034ea6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.598080 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3758eca-33b6-49c0-b18c-d1de9034ea6a admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.598921 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3758eca-33b6-49c0-b18c-d1de9034ea6a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:29.599176 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3758eca-33b6-49c0-b18c-d1de9034ea6a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.600318 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING py.warnings [None req-d3758eca-33b6-49c0-b18c-d1de9034ea6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:35:29.600318 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: warnings.warn(msg) Jan 10 12:35:29.600318 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: Jan 10 12:35:29.601336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3758eca-33b6-49c0-b18c-d1de9034ea6a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.603024 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 247/502] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:29.604223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7a7d1-54b4-47f1-8a39-b215f1fa2048 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.614266 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7a7d1-54b4-47f1-8a39-b215f1fa2048 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.619686 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8d9ae-363e-4d7b-852d-389e01051321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.620880 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8d9ae-363e-4d7b-852d-389e01051321 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.621100 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 256/503] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:29.621568 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8d9ae-363e-4d7b-852d-389e01051321 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.622065 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3758eca-33b6-49c0-b18c-d1de9034ea6a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.622280 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8d9ae-363e-4d7b-852d-389e01051321 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.623415 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8d9ae-363e-4d7b-852d-389e01051321 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:29.623959 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8d9ae-363e-4d7b-852d-389e01051321 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.625244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-77f8d9ae-363e-4d7b-852d-389e01051321 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:35:29.625244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:35:29.625244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:35:29.626837 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8d9ae-363e-4d7b-852d-389e01051321 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.631744 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3758eca-33b6-49c0-b18c-d1de9034ea6a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.636195 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc01af-c634-4192-8cab-1150e99e08ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.636982 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc01af-c634-4192-8cab-1150e99e08ac admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.637258 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc01af-c634-4192-8cab-1150e99e08ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.637526 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc01af-c634-4192-8cab-1150e99e08ac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.648675 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc01af-c634-4192-8cab-1150e99e08ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.650642 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc01af-c634-4192-8cab-1150e99e08ac admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.667739 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-92dc01af-c634-4192-8cab-1150e99e08ac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:29.669321 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 257/504] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:29.670223 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc01af-c634-4192-8cab-1150e99e08ac admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.671144 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 248/505] 10.222.0.13 () {56 vars in 1158 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:29.679716 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8d9ae-363e-4d7b-852d-389e01051321 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.680418 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc01af-c634-4192-8cab-1150e99e08ac admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.685060 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8e62d-85b2-4da7-86b8-6925560c5534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.685707 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8e62d-85b2-4da7-86b8-6925560c5534 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.685984 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8e62d-85b2-4da7-86b8-6925560c5534 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.686257 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8e62d-85b2-4da7-86b8-6925560c5534 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.686519 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8d9ae-363e-4d7b-852d-389e01051321 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.687182 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8e62d-85b2-4da7-86b8-6925560c5534 admin admin] RBAC: Adding query filter params (role.id=3c723eddb93e4ab6b44d5fe4ed5877a7, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=d68fa8e4f3a341a5b74ee32c85e59869) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:29.687504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8e62d-85b2-4da7-86b8-6925560c5534 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.690314 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8e62d-85b2-4da7-86b8-6925560c5534 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.691702 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d893c-f407-4cbc-bde4-587a5c8570a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.692540 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d893c-f407-4cbc-bde4-587a5c8570a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.692909 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d893c-f407-4cbc-bde4-587a5c8570a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.693332 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d893c-f407-4cbc-bde4-587a5c8570a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.694169 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d893c-f407-4cbc-bde4-587a5c8570a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:29.694626 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d893c-f407-4cbc-bde4-587a5c8570a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.696277 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 258/506] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/role_assignments?user.id=d68fa8e4f3a341a5b74ee32c85e59869&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:29.697131 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8e62d-85b2-4da7-86b8-6925560c5534 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.704237 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d893c-f407-4cbc-bde4-587a5c8570a9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.707336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8e62d-85b2-4da7-86b8-6925560c5534 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.715501 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b98fe-03a2-4008-bfa6-94dbceda0250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.716203 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b98fe-03a2-4008-bfa6-94dbceda0250 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.716532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b98fe-03a2-4008-bfa6-94dbceda0250 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.716806 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b98fe-03a2-4008-bfa6-94dbceda0250 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.723203 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 249/507] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:29.725569 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b98fe-03a2-4008-bfa6-94dbceda0250 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.727441 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b98fe-03a2-4008-bfa6-94dbceda0250 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.728697 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d893c-f407-4cbc-bde4-587a5c8570a9 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.738171 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 259/508] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:29.748905 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d893c-f407-4cbc-bde4-587a5c8570a9 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.750307 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b98fe-03a2-4008-bfa6-94dbceda0250 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.762384 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b98fe-03a2-4008-bfa6-94dbceda0250 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.764811 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d8dd5-45e7-49e1-bcd2-8410b250b1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.765944 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d8dd5-45e7-49e1-bcd2-8410b250b1da admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.766388 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d8dd5-45e7-49e1-bcd2-8410b250b1da admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.766796 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d8dd5-45e7-49e1-bcd2-8410b250b1da admin admin] PATH_INFO: `/v3/users/glance` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.779590 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf8dbf-5d4b-4eea-9257-2512ff272288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.780720 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf8dbf-5d4b-4eea-9257-2512ff272288 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.782134 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf8dbf-5d4b-4eea-9257-2512ff272288 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.784091 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf8dbf-5d4b-4eea-9257-2512ff272288 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.789621 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d8dd5-45e7-49e1-bcd2-8410b250b1da admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.794439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d8dd5-45e7-49e1-bcd2-8410b250b1da admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.809897 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf8dbf-5d4b-4eea-9257-2512ff272288 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.812825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf8dbf-5d4b-4eea-9257-2512ff272288 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.820880 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-a43d8dd5-45e7-49e1-bcd2-8410b250b1da admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 10 12:35:29.822496 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 250/509] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:29.828396 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d8dd5-45e7-49e1-bcd2-8410b250b1da admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.844737 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d8dd5-45e7-49e1-bcd2-8410b250b1da admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.848023 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-02bf8dbf-5d4b-4eea-9257-2512ff272288 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:29.850449 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee272448-c827-42f6-b23a-d77a03241fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.851347 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee272448-c827-42f6-b23a-d77a03241fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.851812 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee272448-c827-42f6-b23a-d77a03241fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.852219 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee272448-c827-42f6-b23a-d77a03241fd2 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.853268 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee272448-c827-42f6-b23a-d77a03241fd2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:29.854067 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee272448-c827-42f6-b23a-d77a03241fd2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.854289 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 260/510] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:29.855811 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728701ef-9b39-4fb4-9ca5-70a4ad9c0795 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.856093 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728701ef-9b39-4fb4-9ca5-70a4ad9c0795 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.856361 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728701ef-9b39-4fb4-9ca5-70a4ad9c0795 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.857242 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee272448-c827-42f6-b23a-d77a03241fd2 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.858149 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 261/511] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:29.858852 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728701ef-9b39-4fb4-9ca5-70a4ad9c0795 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.875830 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728701ef-9b39-4fb4-9ca5-70a4ad9c0795 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.880042 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 251/512] 10.222.0.13 () {56 vars in 1158 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:29.880565 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5012d-f47b-41cc-873f-45c4e7aeae9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.881282 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5012d-f47b-41cc-873f-45c4e7aeae9b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.881666 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5012d-f47b-41cc-873f-45c4e7aeae9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.881934 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5012d-f47b-41cc-873f-45c4e7aeae9b admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.882378 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d4931-301d-409e-af55-cbe97e4c3116 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.882726 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5012d-f47b-41cc-873f-45c4e7aeae9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:29.882961 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d4931-301d-409e-af55-cbe97e4c3116 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.883067 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5012d-f47b-41cc-873f-45c4e7aeae9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.883448 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d4931-301d-409e-af55-cbe97e4c3116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.885201 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5012d-f47b-41cc-873f-45c4e7aeae9b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.903665 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 262/513] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:29.904704 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5012d-f47b-41cc-873f-45c4e7aeae9b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.907420 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-620d4931-301d-409e-af55-cbe97e4c3116 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:29.909067 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-620d4931-301d-409e-af55-cbe97e4c3116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:29.919225 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5012d-f47b-41cc-873f-45c4e7aeae9b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.924785 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 252/514] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:29.925969 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d4931-301d-409e-af55-cbe97e4c3116 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.934353 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef31481-54c6-47a9-9d29-9d6f7d6f9d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.935450 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef31481-54c6-47a9-9d29-9d6f7d6f9d9b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.937693 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d4931-301d-409e-af55-cbe97e4c3116 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.938167 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef31481-54c6-47a9-9d29-9d6f7d6f9d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.938578 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef31481-54c6-47a9-9d29-9d6f7d6f9d9b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.951287 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41951e8-3812-4e8c-a127-d5ac179961dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.952492 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41951e8-3812-4e8c-a127-d5ac179961dd admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.952769 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41951e8-3812-4e8c-a127-d5ac179961dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.953032 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41951e8-3812-4e8c-a127-d5ac179961dd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.954781 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef31481-54c6-47a9-9d29-9d6f7d6f9d9b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.956705 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef31481-54c6-47a9-9d29-9d6f7d6f9d9b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.964597 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41951e8-3812-4e8c-a127-d5ac179961dd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:29.966911 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 263/515] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:29.967109 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41951e8-3812-4e8c-a127-d5ac179961dd admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:29.967903 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef31481-54c6-47a9-9d29-9d6f7d6f9d9b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:29.977367 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef31481-54c6-47a9-9d29-9d6f7d6f9d9b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:29.982979 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956b856-9c9f-4a19-b82e-bb704fdaa63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:29.983813 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956b856-9c9f-4a19-b82e-bb704fdaa63f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:29.984092 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956b856-9c9f-4a19-b82e-bb704fdaa63f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:29.984362 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956b856-9c9f-4a19-b82e-bb704fdaa63f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:29.985135 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-f41951e8-3812-4e8c-a127-d5ac179961dd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:29.988142 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 253/516] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:29.989069 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41951e8-3812-4e8c-a127-d5ac179961dd admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:30.003758 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41951e8-3812-4e8c-a127-d5ac179961dd admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:30.004822 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956b856-9c9f-4a19-b82e-bb704fdaa63f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:30.008154 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6aa9c-67e3-43cf-9695-4996472e5d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:30.008939 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6aa9c-67e3-43cf-9695-4996472e5d02 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.009216 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6aa9c-67e3-43cf-9695-4996472e5d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.009484 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6aa9c-67e3-43cf-9695-4996472e5d02 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.015042 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-c956b856-9c9f-4a19-b82e-bb704fdaa63f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:35:30.021809 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 264/517] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:30.021809 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956b856-9c9f-4a19-b82e-bb704fdaa63f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:30.026725 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6aa9c-67e3-43cf-9695-4996472e5d02 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:30.029344 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6aa9c-67e3-43cf-9695-4996472e5d02 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:30.036042 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956b856-9c9f-4a19-b82e-bb704fdaa63f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:30.044684 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25beef-7647-4bd6-9bca-15945aa0e947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:30.045516 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25beef-7647-4bd6-9bca-15945aa0e947 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.045983 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25beef-7647-4bd6-9bca-15945aa0e947 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.046389 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25beef-7647-4bd6-9bca-15945aa0e947 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.047380 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25beef-7647-4bd6-9bca-15945aa0e947 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:30.047905 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25beef-7647-4bd6-9bca-15945aa0e947 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:30.048550 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-e9a6aa9c-67e3-43cf-9695-4996472e5d02 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:30.050165 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 254/518] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:30.050351 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25beef-7647-4bd6-9bca-15945aa0e947 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:30.051010 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6aa9c-67e3-43cf-9695-4996472e5d02 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:30.060971 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6aa9c-67e3-43cf-9695-4996472e5d02 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:30.066189 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 265/519] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:30.067239 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25beef-7647-4bd6-9bca-15945aa0e947 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:30.067751 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a40f2c-1e76-482e-8f5d-222046623a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:30.068535 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a40f2c-1e76-482e-8f5d-222046623a2c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.068814 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a40f2c-1e76-482e-8f5d-222046623a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.069131 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a40f2c-1e76-482e-8f5d-222046623a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.069898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a40f2c-1e76-482e-8f5d-222046623a2c admin admin] RBAC: Adding query filter params (name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:30.070242 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a40f2c-1e76-482e-8f5d-222046623a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:30.072035 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a40f2c-1e76-482e-8f5d-222046623a2c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:30.079257 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25beef-7647-4bd6-9bca-15945aa0e947 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:30.081332 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 255/520] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:35:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:30.085753 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a40f2c-1e76-482e-8f5d-222046623a2c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:30.093846 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bdd60-780b-4d0e-b592-2ce2a99e5bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:30.094710 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bdd60-780b-4d0e-b592-2ce2a99e5bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.095125 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bdd60-780b-4d0e-b592-2ce2a99e5bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.095572 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bdd60-780b-4d0e-b592-2ce2a99e5bc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.095696 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a40f2c-1e76-482e-8f5d-222046623a2c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:30.096661 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bdd60-780b-4d0e-b592-2ce2a99e5bc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:30.097199 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bdd60-780b-4d0e-b592-2ce2a99e5bc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:30.099379 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bdd60-780b-4d0e-b592-2ce2a99e5bc9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:30.100119 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc15fc-7c10-4056-8481-49fe46bd8a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:30.100849 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc15fc-7c10-4056-8481-49fe46bd8a50 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.101124 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc15fc-7c10-4056-8481-49fe46bd8a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.101390 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc15fc-7c10-4056-8481-49fe46bd8a50 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.102283 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc15fc-7c10-4056-8481-49fe46bd8a50 admin admin] RBAC: Adding query filter params (role.id=3c723eddb93e4ab6b44d5fe4ed5877a7, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=dbaa0eb9e5b44a93a357473f8ec1a5fb) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:30.102642 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc15fc-7c10-4056-8481-49fe46bd8a50 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:30.104837 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc15fc-7c10-4056-8481-49fe46bd8a50 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:30.111183 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 256/521] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:30 2022] GET /identity/v3/role_assignments?user.id=dbaa0eb9e5b44a93a357473f8ec1a5fb&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:30.112195 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc15fc-7c10-4056-8481-49fe46bd8a50 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:30.114381 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 266/522] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:30.123383 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bdd60-780b-4d0e-b592-2ce2a99e5bc9 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:30.128477 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc15fc-7c10-4056-8481-49fe46bd8a50 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:30.142297 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191e7ea-061c-4730-a84d-a54ad29f0172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:30.144332 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191e7ea-061c-4730-a84d-a54ad29f0172 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.144677 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191e7ea-061c-4730-a84d-a54ad29f0172 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.144950 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191e7ea-061c-4730-a84d-a54ad29f0172 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.145674 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bdd60-780b-4d0e-b592-2ce2a99e5bc9 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:30.156548 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3942f-81e9-45b2-bf11-36900b89b433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:30.157504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3942f-81e9-45b2-bf11-36900b89b433 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.159329 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3942f-81e9-45b2-bf11-36900b89b433 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.159703 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3942f-81e9-45b2-bf11-36900b89b433 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.172715 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191e7ea-061c-4730-a84d-a54ad29f0172 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:30.174691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191e7ea-061c-4730-a84d-a54ad29f0172 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:30.176589 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3942f-81e9-45b2-bf11-36900b89b433 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:30.181736 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3942f-81e9-45b2-bf11-36900b89b433 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:30.210104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-72c3942f-81e9-45b2-bf11-36900b89b433 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:30.214233 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-0191e7ea-061c-4730-a84d-a54ad29f0172 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:30.215501 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 257/523] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:30.216295 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 267/524] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:30.224708 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191e7ea-061c-4730-a84d-a54ad29f0172 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:30.225939 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3942f-81e9-45b2-bf11-36900b89b433 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:30.241610 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191e7ea-061c-4730-a84d-a54ad29f0172 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:30.249671 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3942f-81e9-45b2-bf11-36900b89b433 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:30.251147 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207f3d5-b7a7-45e7-bfa5-5c93b2360c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:30.252040 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207f3d5-b7a7-45e7-bfa5-5c93b2360c1b admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.252535 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207f3d5-b7a7-45e7-bfa5-5c93b2360c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.252966 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207f3d5-b7a7-45e7-bfa5-5c93b2360c1b admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.253920 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207f3d5-b7a7-45e7-bfa5-5c93b2360c1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:30.254406 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207f3d5-b7a7-45e7-bfa5-5c93b2360c1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:30.256556 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207f3d5-b7a7-45e7-bfa5-5c93b2360c1b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:30.262897 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafa9a9-f037-4d8f-8fb0-859ce451dc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:30.265865 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafa9a9-f037-4d8f-8fb0-859ce451dc24 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.266336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafa9a9-f037-4d8f-8fb0-859ce451dc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.266756 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafa9a9-f037-4d8f-8fb0-859ce451dc24 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.269504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafa9a9-f037-4d8f-8fb0-859ce451dc24 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:30.270011 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafa9a9-f037-4d8f-8fb0-859ce451dc24 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:30.273049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafa9a9-f037-4d8f-8fb0-859ce451dc24 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:30.283999 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 258/525] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:30.298148 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 268/526] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:30.303772 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafa9a9-f037-4d8f-8fb0-859ce451dc24 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:30.304054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207f3d5-b7a7-45e7-bfa5-5c93b2360c1b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:30.319565 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafa9a9-f037-4d8f-8fb0-859ce451dc24 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:30.320855 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207f3d5-b7a7-45e7-bfa5-5c93b2360c1b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:30.327104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bfa22-93b4-46bc-98af-865d473bc88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:30.327821 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bfa22-93b4-46bc-98af-865d473bc88a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.328750 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bfa22-93b4-46bc-98af-865d473bc88a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.329036 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bfa22-93b4-46bc-98af-865d473bc88a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.330462 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bfa22-93b4-46bc-98af-865d473bc88a admin admin] RBAC: Adding query filter params (role.id=3c723eddb93e4ab6b44d5fe4ed5877a7, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=f812f38c242d4530b3fc73013f66c9f6) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:30.332763 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bfa22-93b4-46bc-98af-865d473bc88a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:30.334077 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dad86a-dbe2-4007-b963-7b5b2609bd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:30.334938 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dad86a-dbe2-4007-b963-7b5b2609bd40 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.336217 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dad86a-dbe2-4007-b963-7b5b2609bd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.336507 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dad86a-dbe2-4007-b963-7b5b2609bd40 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.337532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bfa22-93b4-46bc-98af-865d473bc88a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:30.349850 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dad86a-dbe2-4007-b963-7b5b2609bd40 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:30.350097 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 269/527] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:30 2022] GET /identity/v3/role_assignments?user.id=f812f38c242d4530b3fc73013f66c9f6&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:30.360394 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dad86a-dbe2-4007-b963-7b5b2609bd40 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:30.379384 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-75dad86a-dbe2-4007-b963-7b5b2609bd40 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 10 12:35:30.380962 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 259/528] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:30.386651 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bfa22-93b4-46bc-98af-865d473bc88a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:30.402033 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bfa22-93b4-46bc-98af-865d473bc88a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:30.416492 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4161399-cd6e-45bb-a44b-ae4cee77b85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:30.417304 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4161399-cd6e-45bb-a44b-ae4cee77b85d admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.417651 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4161399-cd6e-45bb-a44b-ae4cee77b85d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.417991 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4161399-cd6e-45bb-a44b-ae4cee77b85d admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.418937 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4161399-cd6e-45bb-a44b-ae4cee77b85d admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:30.419315 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4161399-cd6e-45bb-a44b-ae4cee77b85d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:30.421349 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4161399-cd6e-45bb-a44b-ae4cee77b85d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:30.447465 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 270/529] 10.222.0.13 () {56 vars in 1160 bytes} [Mon Jan 10 12:35:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:30.453051 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dad86a-dbe2-4007-b963-7b5b2609bd40 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:30.469587 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dad86a-dbe2-4007-b963-7b5b2609bd40 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:30.484365 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655dc88-3dd2-422b-9eea-83c21922bcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:30.485048 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655dc88-3dd2-422b-9eea-83c21922bcfe admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.485328 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655dc88-3dd2-422b-9eea-83c21922bcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.485600 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655dc88-3dd2-422b-9eea-83c21922bcfe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.499704 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655dc88-3dd2-422b-9eea-83c21922bcfe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:30.501515 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655dc88-3dd2-422b-9eea-83c21922bcfe admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:30.518102 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 260/530] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:30.523695 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4161399-cd6e-45bb-a44b-ae4cee77b85d admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:30.534309 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4161399-cd6e-45bb-a44b-ae4cee77b85d admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:30.544874 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390d0b8-3166-4b60-95b7-cf4e6cd96464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:30.545850 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390d0b8-3166-4b60-95b7-cf4e6cd96464 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.546187 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390d0b8-3166-4b60-95b7-cf4e6cd96464 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.546550 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390d0b8-3166-4b60-95b7-cf4e6cd96464 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.560022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390d0b8-3166-4b60-95b7-cf4e6cd96464 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:30.561966 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390d0b8-3166-4b60-95b7-cf4e6cd96464 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:30.585369 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-9390d0b8-3166-4b60-95b7-cf4e6cd96464 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:30.587160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 271/531] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:30.593083 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655dc88-3dd2-422b-9eea-83c21922bcfe admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:30.609522 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655dc88-3dd2-422b-9eea-83c21922bcfe admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:30.624395 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4939fd-bfa8-40c9-af15-cd6fc1079e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:30.625089 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4939fd-bfa8-40c9-af15-cd6fc1079e32 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.625369 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4939fd-bfa8-40c9-af15-cd6fc1079e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.625639 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4939fd-bfa8-40c9-af15-cd6fc1079e32 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.626397 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4939fd-bfa8-40c9-af15-cd6fc1079e32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:30.626699 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4939fd-bfa8-40c9-af15-cd6fc1079e32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:30.628364 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4939fd-bfa8-40c9-af15-cd6fc1079e32 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:30.645220 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 261/532] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:30.650706 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390d0b8-3166-4b60-95b7-cf4e6cd96464 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:30.661104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390d0b8-3166-4b60-95b7-cf4e6cd96464 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:30.672307 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9461815-b396-4fd5-8216-5e8a64aac67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:30.673251 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9461815-b396-4fd5-8216-5e8a64aac67a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.673644 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9461815-b396-4fd5-8216-5e8a64aac67a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.673983 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9461815-b396-4fd5-8216-5e8a64aac67a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.687620 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9461815-b396-4fd5-8216-5e8a64aac67a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:30.689763 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9461815-b396-4fd5-8216-5e8a64aac67a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:30.706964 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-f9461815-b396-4fd5-8216-5e8a64aac67a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:30.708671 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 272/533] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:30.714211 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4939fd-bfa8-40c9-af15-cd6fc1079e32 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:30.725651 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4939fd-bfa8-40c9-af15-cd6fc1079e32 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:30.734309 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22192d6e-9471-4912-beb6-74b09de6a67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:30.734309 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192d6e-9471-4912-beb6-74b09de6a67e admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.734520 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192d6e-9471-4912-beb6-74b09de6a67e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.734615 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192d6e-9471-4912-beb6-74b09de6a67e admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.735576 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22192d6e-9471-4912-beb6-74b09de6a67e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:30.736022 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22192d6e-9471-4912-beb6-74b09de6a67e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:30.736883 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-22192d6e-9471-4912-beb6-74b09de6a67e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:35:30.736883 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:35:30.736883 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:35:30.738021 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22192d6e-9471-4912-beb6-74b09de6a67e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:30.760975 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 262/534] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:30.768849 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9461815-b396-4fd5-8216-5e8a64aac67a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:30.779375 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9461815-b396-4fd5-8216-5e8a64aac67a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:30.792835 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a5125-681f-40ba-b7dc-372ab30d0bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:30.793509 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a5125-681f-40ba-b7dc-372ab30d0bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.793789 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a5125-681f-40ba-b7dc-372ab30d0bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.794055 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a5125-681f-40ba-b7dc-372ab30d0bf7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.794903 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a5125-681f-40ba-b7dc-372ab30d0bf7 admin admin] RBAC: Adding query filter params (role.id=3c723eddb93e4ab6b44d5fe4ed5877a7, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=fa3a96ff9ab74aeb88465b14de3038eb) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:30.795209 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a5125-681f-40ba-b7dc-372ab30d0bf7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:30.797107 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a5125-681f-40ba-b7dc-372ab30d0bf7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:30.803369 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 273/535] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:30 2022] GET /identity/v3/role_assignments?user.id=fa3a96ff9ab74aeb88465b14de3038eb&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:30.850948 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5050348-2ebe-4e56-9b5b-d28766ee04e1 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.851491 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5050348-2ebe-4e56-9b5b-d28766ee04e1 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.851734 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5050348-2ebe-4e56-9b5b-d28766ee04e1 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.854149 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 263/536] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:30.859826 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060c44f-9c44-409c-be32-5495ac5b8e74 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.860246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060c44f-9c44-409c-be32-5495ac5b8e74 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.860577 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060c44f-9c44-409c-be32-5495ac5b8e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.880895 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-b060c44f-9c44-409c-be32-5495ac5b8e74 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:30.882282 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b060c44f-9c44-409c-be32-5495ac5b8e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:30.890797 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 274/537] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:30.917796 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5050348-2ebe-4e56-9b5b-d28766ee04e1 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:30.931062 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5050348-2ebe-4e56-9b5b-d28766ee04e1 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:30.936124 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf90f1-3bd4-4fdc-8f49-91ed2609ab93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:30.937283 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf90f1-3bd4-4fdc-8f49-91ed2609ab93 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.937678 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf90f1-3bd4-4fdc-8f49-91ed2609ab93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.938077 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf90f1-3bd4-4fdc-8f49-91ed2609ab93 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.951850 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf90f1-3bd4-4fdc-8f49-91ed2609ab93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:30.954010 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf90f1-3bd4-4fdc-8f49-91ed2609ab93 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:30.971727 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-21bf90f1-3bd4-4fdc-8f49-91ed2609ab93 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:30.973361 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 264/538] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:30.979610 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060c44f-9c44-409c-be32-5495ac5b8e74 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:30.989266 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060c44f-9c44-409c-be32-5495ac5b8e74 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:30.994260 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07ce1a-afba-434b-901e-68f462a6f984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:30.995152 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07ce1a-afba-434b-901e-68f462a6f984 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:30.995550 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07ce1a-afba-434b-901e-68f462a6f984 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:30.995924 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07ce1a-afba-434b-901e-68f462a6f984 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:30.996776 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07ce1a-afba-434b-901e-68f462a6f984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:30.997175 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07ce1a-afba-434b-901e-68f462a6f984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:30.999005 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07ce1a-afba-434b-901e-68f462a6f984 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:31.014459 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 275/539] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:31.020427 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf90f1-3bd4-4fdc-8f49-91ed2609ab93 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:31.036994 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf90f1-3bd4-4fdc-8f49-91ed2609ab93 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:31.045691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53690407-edd7-4437-90d2-23439080a24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:31.046394 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53690407-edd7-4437-90d2-23439080a24a admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:31.046670 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53690407-edd7-4437-90d2-23439080a24a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:31.046934 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53690407-edd7-4437-90d2-23439080a24a admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:31.047713 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53690407-edd7-4437-90d2-23439080a24a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:31.049742 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53690407-edd7-4437-90d2-23439080a24a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:31.091649 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 265/540] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Jan 10 12:35:31 2022] POST /identity/v3/users => generated 247 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:35:32.925934 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5419a7-386a-4a2c-8351-987ca9ea86fc None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:32.926668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5419a7-386a-4a2c-8351-987ca9ea86fc None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:32.926668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5419a7-386a-4a2c-8351-987ca9ea86fc None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:32.928592 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 276/541] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:32.934396 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51041d91-5b88-4961-85bf-5f9fb5e8dfcb None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:32.934966 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51041d91-5b88-4961-85bf-5f9fb5e8dfcb None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:32.934966 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51041d91-5b88-4961-85bf-5f9fb5e8dfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:32.955463 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-51041d91-5b88-4961-85bf-5f9fb5e8dfcb None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:32.956699 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-51041d91-5b88-4961-85bf-5f9fb5e8dfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:32.965327 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 266/542] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:35:32.989732 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5419a7-386a-4a2c-8351-987ca9ea86fc None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.002430 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5419a7-386a-4a2c-8351-987ca9ea86fc None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.006824 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6382414-3902-45c8-9a06-e12f3596468a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.007649 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6382414-3902-45c8-9a06-e12f3596468a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.007929 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6382414-3902-45c8-9a06-e12f3596468a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.008196 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6382414-3902-45c8-9a06-e12f3596468a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.024827 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6382414-3902-45c8-9a06-e12f3596468a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:33.031893 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-c6382414-3902-45c8-9a06-e12f3596468a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:35:33.033427 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 277/543] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:33.039790 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c46e08-fb6f-420e-945c-ea8bafa507a2 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.040069 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c46e08-fb6f-420e-945c-ea8bafa507a2 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.040340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c46e08-fb6f-420e-945c-ea8bafa507a2 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.042598 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 267/544] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:33.043634 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6382414-3902-45c8-9a06-e12f3596468a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.047436 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a1264-d015-4942-8517-7fa3fc462759 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.047744 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a1264-d015-4942-8517-7fa3fc462759 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.048010 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a1264-d015-4942-8517-7fa3fc462759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.061337 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6382414-3902-45c8-9a06-e12f3596468a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.066641 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cc56c-4b42-4b90-a97f-ec6b7f1a47c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.067339 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cc56c-4b42-4b90-a97f-ec6b7f1a47c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.067658 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cc56c-4b42-4b90-a97f-ec6b7f1a47c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.067930 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cc56c-4b42-4b90-a97f-ec6b7f1a47c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.068708 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cc56c-4b42-4b90-a97f-ec6b7f1a47c6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:33.069009 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cc56c-4b42-4b90-a97f-ec6b7f1a47c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.070654 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cc56c-4b42-4b90-a97f-ec6b7f1a47c6 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.080286 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 278/545] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:33.081691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-812a1264-d015-4942-8517-7fa3fc462759 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:33.082929 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-812a1264-d015-4942-8517-7fa3fc462759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:33.086131 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cc56c-4b42-4b90-a97f-ec6b7f1a47c6 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.096419 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cc56c-4b42-4b90-a97f-ec6b7f1a47c6 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.101158 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9fd74-0f85-4c5a-ae4d-457df90c5914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.102063 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9fd74-0f85-4c5a-ae4d-457df90c5914 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.102350 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9fd74-0f85-4c5a-ae4d-457df90c5914 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.102621 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9fd74-0f85-4c5a-ae4d-457df90c5914 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.107899 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 268/546] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:33.113732 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9fd74-0f85-4c5a-ae4d-457df90c5914 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.115613 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9fd74-0f85-4c5a-ae4d-457df90c5914 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.132257 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-82a9fd74-0f85-4c5a-ae4d-457df90c5914 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:33.133754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 279/547] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:33.140200 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9fd74-0f85-4c5a-ae4d-457df90c5914 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.140869 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a1264-d015-4942-8517-7fa3fc462759 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.158595 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9fd74-0f85-4c5a-ae4d-457df90c5914 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.161302 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a1264-d015-4942-8517-7fa3fc462759 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.169325 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32417e01-5d62-45c9-bd19-315d5d90c1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.170142 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32417e01-5d62-45c9-bd19-315d5d90c1ef admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.170416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32417e01-5d62-45c9-bd19-315d5d90c1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.170681 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32417e01-5d62-45c9-bd19-315d5d90c1ef admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.171780 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b792d-ebf4-4452-9fde-a41d7c67cabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.172440 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b792d-ebf4-4452-9fde-a41d7c67cabb admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.172705 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b792d-ebf4-4452-9fde-a41d7c67cabb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.172966 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b792d-ebf4-4452-9fde-a41d7c67cabb admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.173704 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b792d-ebf4-4452-9fde-a41d7c67cabb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:33.174001 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b792d-ebf4-4452-9fde-a41d7c67cabb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.175622 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b792d-ebf4-4452-9fde-a41d7c67cabb admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.189468 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 269/548] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:33.195537 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b792d-ebf4-4452-9fde-a41d7c67cabb admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.205773 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b792d-ebf4-4452-9fde-a41d7c67cabb admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.206967 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32417e01-5d62-45c9-bd19-315d5d90c1ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:33.216511 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-32417e01-5d62-45c9-bd19-315d5d90c1ef admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:35:33.217762 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 280/549] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:33.219824 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f00a80-e985-4332-ab4a-c130b96ebcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.220619 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f00a80-e985-4332-ab4a-c130b96ebcd3 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.220892 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f00a80-e985-4332-ab4a-c130b96ebcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.221157 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f00a80-e985-4332-ab4a-c130b96ebcd3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.224108 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32417e01-5d62-45c9-bd19-315d5d90c1ef admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.237230 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f00a80-e985-4332-ab4a-c130b96ebcd3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.239267 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f00a80-e985-4332-ab4a-c130b96ebcd3 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.242052 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32417e01-5d62-45c9-bd19-315d5d90c1ef admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.256681 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7716710-22a5-424f-a905-e9c10e126347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.257387 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7716710-22a5-424f-a905-e9c10e126347 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.257669 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7716710-22a5-424f-a905-e9c10e126347 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.257936 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7716710-22a5-424f-a905-e9c10e126347 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.258706 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7716710-22a5-424f-a905-e9c10e126347 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:33.259007 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7716710-22a5-424f-a905-e9c10e126347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.260734 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7716710-22a5-424f-a905-e9c10e126347 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.266763 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-93f00a80-e985-4332-ab4a-c130b96ebcd3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 12:35:33.278385 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 270/550] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:33.282010 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 281/551] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:33.283835 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f00a80-e985-4332-ab4a-c130b96ebcd3 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.288679 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7716710-22a5-424f-a905-e9c10e126347 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.299420 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7716710-22a5-424f-a905-e9c10e126347 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.305054 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fba02-ccf8-4fc4-a299-3ff508bad0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.305874 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fba02-ccf8-4fc4-a299-3ff508bad0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.306152 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fba02-ccf8-4fc4-a299-3ff508bad0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.306425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fba02-ccf8-4fc4-a299-3ff508bad0a7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.311876 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f00a80-e985-4332-ab4a-c130b96ebcd3 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.318090 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46cfd8-34e9-46a1-9590-1495a103cb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.318781 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46cfd8-34e9-46a1-9590-1495a103cb02 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.319059 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46cfd8-34e9-46a1-9590-1495a103cb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.319323 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46cfd8-34e9-46a1-9590-1495a103cb02 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.320212 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46cfd8-34e9-46a1-9590-1495a103cb02 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:33.320515 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46cfd8-34e9-46a1-9590-1495a103cb02 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.322434 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46cfd8-34e9-46a1-9590-1495a103cb02 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.331587 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fba02-ccf8-4fc4-a299-3ff508bad0a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.333451 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fba02-ccf8-4fc4-a299-3ff508bad0a7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.354313 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 271/552] 10.222.0.13 () {56 vars in 1154 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:33.358283 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46cfd8-34e9-46a1-9590-1495a103cb02 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.362851 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-a75fba02-ccf8-4fc4-a299-3ff508bad0a7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:33.373759 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46cfd8-34e9-46a1-9590-1495a103cb02 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.374645 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 282/553] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:33.375553 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fba02-ccf8-4fc4-a299-3ff508bad0a7 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.386342 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f526ea6-997d-4dc5-96a5-ec86874d7d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.387147 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f526ea6-997d-4dc5-96a5-ec86874d7d2f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.387424 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f526ea6-997d-4dc5-96a5-ec86874d7d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.387716 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f526ea6-997d-4dc5-96a5-ec86874d7d2f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.389917 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fba02-ccf8-4fc4-a299-3ff508bad0a7 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.404647 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f526ea6-997d-4dc5-96a5-ec86874d7d2f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.406499 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f526ea6-997d-4dc5-96a5-ec86874d7d2f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.407500 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2a3f4-163c-4d19-ab58-dcda20b6c7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.408191 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2a3f4-163c-4d19-ab58-dcda20b6c7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.408464 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2a3f4-163c-4d19-ab58-dcda20b6c7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.408808 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2a3f4-163c-4d19-ab58-dcda20b6c7a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.409552 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2a3f4-163c-4d19-ab58-dcda20b6c7a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:33.409851 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2a3f4-163c-4d19-ab58-dcda20b6c7a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.411423 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2a3f4-163c-4d19-ab58-dcda20b6c7a4 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.433851 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 283/554] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:33.437170 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-8f526ea6-997d-4dc5-96a5-ec86874d7d2f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:33.438757 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 272/555] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:33.438892 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2a3f4-163c-4d19-ab58-dcda20b6c7a4 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.444576 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f526ea6-997d-4dc5-96a5-ec86874d7d2f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.458550 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f526ea6-997d-4dc5-96a5-ec86874d7d2f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.459784 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2a3f4-163c-4d19-ab58-dcda20b6c7a4 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.468848 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f089ea-d871-480b-a7de-128ba106629d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.469089 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097e449-1708-482c-9db8-c84e14a6d3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.469697 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097e449-1708-482c-9db8-c84e14a6d3cb admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.469972 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097e449-1708-482c-9db8-c84e14a6d3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.471091 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097e449-1708-482c-9db8-c84e14a6d3cb admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.471864 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097e449-1708-482c-9db8-c84e14a6d3cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:33.472162 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097e449-1708-482c-9db8-c84e14a6d3cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.472479 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f089ea-d871-480b-a7de-128ba106629d admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.472747 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f089ea-d871-480b-a7de-128ba106629d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.473008 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f089ea-d871-480b-a7de-128ba106629d admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.475549 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097e449-1708-482c-9db8-c84e14a6d3cb admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.489224 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f089ea-d871-480b-a7de-128ba106629d admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.491256 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f089ea-d871-480b-a7de-128ba106629d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.505851 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 273/556] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:33.506730 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097e449-1708-482c-9db8-c84e14a6d3cb admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.522074 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-e9f089ea-d871-480b-a7de-128ba106629d admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 10 12:35:33.525723 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097e449-1708-482c-9db8-c84e14a6d3cb admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.528306 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 284/557] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:33.529761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f089ea-d871-480b-a7de-128ba106629d admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.533870 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f004c-b8e1-4300-a005-803be1378f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.536288 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f004c-b8e1-4300-a005-803be1378f39 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.536574 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f004c-b8e1-4300-a005-803be1378f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.536847 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f004c-b8e1-4300-a005-803be1378f39 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.548495 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f089ea-d871-480b-a7de-128ba106629d admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.550799 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f004c-b8e1-4300-a005-803be1378f39 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.555225 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f004c-b8e1-4300-a005-803be1378f39 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.560709 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83389764-1888-43e4-ae30-3dfadd67cefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.561389 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83389764-1888-43e4-ae30-3dfadd67cefb admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.561662 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83389764-1888-43e4-ae30-3dfadd67cefb admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.561923 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83389764-1888-43e4-ae30-3dfadd67cefb admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.562775 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83389764-1888-43e4-ae30-3dfadd67cefb admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:33.563074 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83389764-1888-43e4-ae30-3dfadd67cefb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.565324 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83389764-1888-43e4-ae30-3dfadd67cefb admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.570519 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-706f004c-b8e1-4300-a005-803be1378f39 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:33.572198 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 274/558] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:33.573414 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa191b7-63df-4ec9-9596-4573f9dc5c26 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.573690 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa191b7-63df-4ec9-9596-4573f9dc5c26 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.573955 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa191b7-63df-4ec9-9596-4573f9dc5c26 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.584178 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 275/559] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:33.584178 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa191b7-63df-4ec9-9596-4573f9dc5c26 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.590518 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 285/560] 10.222.0.13 () {56 vars in 1158 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:33.592440 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16b6a4-99f7-4e3d-aa40-4e961852f9d3 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.592924 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16b6a4-99f7-4e3d-aa40-4e961852f9d3 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.593388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16b6a4-99f7-4e3d-aa40-4e961852f9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.593910 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa191b7-63df-4ec9-9596-4573f9dc5c26 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.598863 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f65138-9a5b-4b44-be81-03c88b226a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.599500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f65138-9a5b-4b44-be81-03c88b226a52 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.599797 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f65138-9a5b-4b44-be81-03c88b226a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.600063 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f65138-9a5b-4b44-be81-03c88b226a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.600867 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f65138-9a5b-4b44-be81-03c88b226a52 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:33.601177 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f65138-9a5b-4b44-be81-03c88b226a52 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.603009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f65138-9a5b-4b44-be81-03c88b226a52 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.615457 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 276/561] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:33.615729 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-ae16b6a4-99f7-4e3d-aa40-4e961852f9d3 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:33.616297 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f65138-9a5b-4b44-be81-03c88b226a52 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.617430 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ae16b6a4-99f7-4e3d-aa40-4e961852f9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:33.635545 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 286/562] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:33.635545 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16b6a4-99f7-4e3d-aa40-4e961852f9d3 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.638515 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f65138-9a5b-4b44-be81-03c88b226a52 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.642885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16b6a4-99f7-4e3d-aa40-4e961852f9d3 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.647911 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a62fe0-eb17-458e-b554-b2c2b3af9f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.650054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a62fe0-eb17-458e-b554-b2c2b3af9f39 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.650368 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a62fe0-eb17-458e-b554-b2c2b3af9f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.650633 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a62fe0-eb17-458e-b554-b2c2b3af9f39 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.653350 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5acea-310e-43d1-b1e2-ab563e668157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.655590 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5acea-310e-43d1-b1e2-ab563e668157 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.655868 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5acea-310e-43d1-b1e2-ab563e668157 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.656230 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5acea-310e-43d1-b1e2-ab563e668157 admin admin] PATH_INFO: `/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/d68fa8e4f3a341a5b74ee32c85e59869/roles/3c723eddb93e4ab6b44d5fe4ed5877a7` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.666484 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a62fe0-eb17-458e-b554-b2c2b3af9f39 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.668642 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a62fe0-eb17-458e-b554-b2c2b3af9f39 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.671922 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5acea-310e-43d1-b1e2-ab563e668157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0105f8c08c84f538cd7ba86fcd26b62, user_id=d68fa8e4f3a341a5b74ee32c85e59869, role_id=3c723eddb93e4ab6b44d5fe4ed5877a7)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.674761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5acea-310e-43d1-b1e2-ab563e668157 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.685811 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-e7a62fe0-eb17-458e-b554-b2c2b3af9f39 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:33.687276 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 277/563] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:33.688348 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a62fe0-eb17-458e-b554-b2c2b3af9f39 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.691208 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 287/564] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:35:33 2022] PUT /identity/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/d68fa8e4f3a341a5b74ee32c85e59869/roles/3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:35:33.696637 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5acea-310e-43d1-b1e2-ab563e668157 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.699713 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a62fe0-eb17-458e-b554-b2c2b3af9f39 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.759770 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bd59f-f560-48e7-96e2-7db2764abf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.761027 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bd59f-f560-48e7-96e2-7db2764abf48 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.761542 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bd59f-f560-48e7-96e2-7db2764abf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.762007 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bd59f-f560-48e7-96e2-7db2764abf48 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.781357 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bd59f-f560-48e7-96e2-7db2764abf48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:33.788615 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-658bd59f-f560-48e7-96e2-7db2764abf48 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:35:33.795030 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 278/565] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:33.795030 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427385b-f94e-4dc6-8128-106deaa635fb None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.795030 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427385b-f94e-4dc6-8128-106deaa635fb None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.795030 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427385b-f94e-4dc6-8128-106deaa635fb None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.798193 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 279/566] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:33.800503 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427385b-f94e-4dc6-8128-106deaa635fb None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.811668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5acea-310e-43d1-b1e2-ab563e668157 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.818270 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7780c26-b05f-445f-b9bf-135a055d91b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.819287 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7780c26-b05f-445f-b9bf-135a055d91b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.819774 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7780c26-b05f-445f-b9bf-135a055d91b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.820234 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7780c26-b05f-445f-b9bf-135a055d91b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.821202 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427385b-f94e-4dc6-8128-106deaa635fb None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.821373 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7780c26-b05f-445f-b9bf-135a055d91b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:33.821804 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7780c26-b05f-445f-b9bf-135a055d91b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.823859 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7780c26-b05f-445f-b9bf-135a055d91b2 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.827541 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757961f-05eb-474d-8818-252a4b92033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.828525 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757961f-05eb-474d-8818-252a4b92033d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.828916 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757961f-05eb-474d-8818-252a4b92033d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.829325 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757961f-05eb-474d-8818-252a4b92033d admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.830310 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757961f-05eb-474d-8818-252a4b92033d admin admin] RBAC: Adding query filter params (name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:33.830713 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757961f-05eb-474d-8818-252a4b92033d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.832641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757961f-05eb-474d-8818-252a4b92033d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.839733 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 288/567] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:33.841556 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c8596-d835-419a-9ca9-17874064a1f8 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.842072 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c8596-d835-419a-9ca9-17874064a1f8 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.842558 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c8596-d835-419a-9ca9-17874064a1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.853876 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 280/568] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:33.853876 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757961f-05eb-474d-8818-252a4b92033d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.862291 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757961f-05eb-474d-8818-252a4b92033d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.868210 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308afc5-4ab7-42a0-9306-0aa80a9b6460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.869302 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308afc5-4ab7-42a0-9306-0aa80a9b6460 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.869695 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308afc5-4ab7-42a0-9306-0aa80a9b6460 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.869969 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308afc5-4ab7-42a0-9306-0aa80a9b6460 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.871652 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-f28c8596-d835-419a-9ca9-17874064a1f8 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:33.873778 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f28c8596-d835-419a-9ca9-17874064a1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:33.878316 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308afc5-4ab7-42a0-9306-0aa80a9b6460 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.880539 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308afc5-4ab7-42a0-9306-0aa80a9b6460 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.884000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 289/569] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:33.885439 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c8596-d835-419a-9ca9-17874064a1f8 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.903193 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c8596-d835-419a-9ca9-17874064a1f8 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.910836 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-c308afc5-4ab7-42a0-9306-0aa80a9b6460 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:33.912321 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 281/570] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:33.917774 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edb146-2d98-45b1-b76a-db20e84ea5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.918681 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308afc5-4ab7-42a0-9306-0aa80a9b6460 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.919498 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edb146-2d98-45b1-b76a-db20e84ea5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.919850 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edb146-2d98-45b1-b76a-db20e84ea5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.920077 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edb146-2d98-45b1-b76a-db20e84ea5b0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.935402 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edb146-2d98-45b1-b76a-db20e84ea5b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.937403 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308afc5-4ab7-42a0-9306-0aa80a9b6460 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.937844 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edb146-2d98-45b1-b76a-db20e84ea5b0 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.945726 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7399ee9-8c15-4a33-aaf2-fc90061024b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.948168 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7399ee9-8c15-4a33-aaf2-fc90061024b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.948953 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7399ee9-8c15-4a33-aaf2-fc90061024b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.949528 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7399ee9-8c15-4a33-aaf2-fc90061024b8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.960826 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-f1edb146-2d98-45b1-b76a-db20e84ea5b0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:33.967673 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 290/571] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:33.968880 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7399ee9-8c15-4a33-aaf2-fc90061024b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:33.969010 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edb146-2d98-45b1-b76a-db20e84ea5b0 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.977910 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-a7399ee9-8c15-4a33-aaf2-fc90061024b8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:35:33.979067 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edb146-2d98-45b1-b76a-db20e84ea5b0 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.980112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 282/572] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:33.981669 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7399ee9-8c15-4a33-aaf2-fc90061024b8 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:33.989481 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902af81-1be7-40e1-ab48-b0bb40892616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:33.990178 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902af81-1be7-40e1-ab48-b0bb40892616 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:33.990701 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902af81-1be7-40e1-ab48-b0bb40892616 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:33.990980 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902af81-1be7-40e1-ab48-b0bb40892616 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:33.991840 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902af81-1be7-40e1-ab48-b0bb40892616 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:33.992146 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902af81-1be7-40e1-ab48-b0bb40892616 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:33.993589 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7399ee9-8c15-4a33-aaf2-fc90061024b8 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:33.994166 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902af81-1be7-40e1-ab48-b0bb40892616 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:33.999661 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c239bd-c2aa-44d6-954c-c8006e70e01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.000339 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c239bd-c2aa-44d6-954c-c8006e70e01e admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.000620 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c239bd-c2aa-44d6-954c-c8006e70e01e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.000887 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c239bd-c2aa-44d6-954c-c8006e70e01e admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.001629 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c239bd-c2aa-44d6-954c-c8006e70e01e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:34.002419 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c239bd-c2aa-44d6-954c-c8006e70e01e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.004091 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c239bd-c2aa-44d6-954c-c8006e70e01e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.008593 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 291/573] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:34.009332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902af81-1be7-40e1-ab48-b0bb40892616 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.022264 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 283/574] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:34.022426 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902af81-1be7-40e1-ab48-b0bb40892616 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.022865 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c239bd-c2aa-44d6-954c-c8006e70e01e admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.030064 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e84a3-82a5-4caf-a84c-ab651f897ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.031019 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e84a3-82a5-4caf-a84c-ab651f897ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.031302 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e84a3-82a5-4caf-a84c-ab651f897ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.031605 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e84a3-82a5-4caf-a84c-ab651f897ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.032387 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e84a3-82a5-4caf-a84c-ab651f897ff6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:34.032673 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e84a3-82a5-4caf-a84c-ab651f897ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.032789 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c239bd-c2aa-44d6-954c-c8006e70e01e admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.034293 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e84a3-82a5-4caf-a84c-ab651f897ff6 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.037327 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbd5eb-f5fa-41c9-a335-a8549fcb6f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.038305 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbd5eb-f5fa-41c9-a335-a8549fcb6f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.038581 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbd5eb-f5fa-41c9-a335-a8549fcb6f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.038900 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbd5eb-f5fa-41c9-a335-a8549fcb6f0c admin admin] PATH_INFO: `/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/dbaa0eb9e5b44a93a357473f8ec1a5fb/roles/3c723eddb93e4ab6b44d5fe4ed5877a7` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.051206 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 292/575] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:34.052140 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e84a3-82a5-4caf-a84c-ab651f897ff6 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.067773 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbd5eb-f5fa-41c9-a335-a8549fcb6f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0105f8c08c84f538cd7ba86fcd26b62, user_id=dbaa0eb9e5b44a93a357473f8ec1a5fb, role_id=3c723eddb93e4ab6b44d5fe4ed5877a7)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.069159 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e84a3-82a5-4caf-a84c-ab651f897ff6 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.070771 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbd5eb-f5fa-41c9-a335-a8549fcb6f0c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.074750 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b0183-d366-4a98-87df-1abc59d08d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.075759 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b0183-d366-4a98-87df-1abc59d08d9c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.076083 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b0183-d366-4a98-87df-1abc59d08d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.076355 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b0183-d366-4a98-87df-1abc59d08d9c admin admin] PATH_INFO: `/v3/users/glance` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.084429 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b0183-d366-4a98-87df-1abc59d08d9c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.086385 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 284/576] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:35:34 2022] PUT /identity/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/dbaa0eb9e5b44a93a357473f8ec1a5fb/roles/3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:35:34.086499 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b0183-d366-4a98-87df-1abc59d08d9c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.087880 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbd5eb-f5fa-41c9-a335-a8549fcb6f0c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.101438 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-dc8b0183-d366-4a98-87df-1abc59d08d9c admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 10 12:35:34.102861 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 293/577] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:34.108534 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b0183-d366-4a98-87df-1abc59d08d9c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.118653 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b0183-d366-4a98-87df-1abc59d08d9c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.184402 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fac52-1153-4bfe-8526-b536d55c9e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.187075 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fac52-1153-4bfe-8526-b536d55c9e34 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.187075 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fac52-1153-4bfe-8526-b536d55c9e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.187075 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fac52-1153-4bfe-8526-b536d55c9e34 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.191776 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fac52-1153-4bfe-8526-b536d55c9e34 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:34.192319 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fac52-1153-4bfe-8526-b536d55c9e34 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.194129 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fac52-1153-4bfe-8526-b536d55c9e34 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.205758 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbd5eb-f5fa-41c9-a335-a8549fcb6f0c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.215123 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb96842-0e12-4c83-b047-657c00a52870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.215978 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb96842-0e12-4c83-b047-657c00a52870 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.216253 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb96842-0e12-4c83-b047-657c00a52870 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.216519 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb96842-0e12-4c83-b047-657c00a52870 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.236999 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 294/578] 10.222.0.13 () {56 vars in 1158 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:34.243038 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fac52-1153-4bfe-8526-b536d55c9e34 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.250993 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb96842-0e12-4c83-b047-657c00a52870 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.253241 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb96842-0e12-4c83-b047-657c00a52870 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.266540 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fac52-1153-4bfe-8526-b536d55c9e34 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.274559 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3d067-d0e0-4985-ba3d-7c5e2e74c877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.275477 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3d067-d0e0-4985-ba3d-7c5e2e74c877 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.275936 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3d067-d0e0-4985-ba3d-7c5e2e74c877 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.276447 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3d067-d0e0-4985-ba3d-7c5e2e74c877 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.291832 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-9cb96842-0e12-4c83-b047-657c00a52870 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:34.299267 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 285/579] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:34.302429 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3d067-d0e0-4985-ba3d-7c5e2e74c877 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.304400 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3d067-d0e0-4985-ba3d-7c5e2e74c877 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.316517 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb96842-0e12-4c83-b047-657c00a52870 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.331466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-0aa3d067-d0e0-4985-ba3d-7c5e2e74c877 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:34.337351 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 295/580] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:34.337974 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb96842-0e12-4c83-b047-657c00a52870 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.338771 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3d067-d0e0-4985-ba3d-7c5e2e74c877 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.349943 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3d067-d0e0-4985-ba3d-7c5e2e74c877 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.355157 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bf67d-5687-4650-9e5b-449979b0335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.355690 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c7c2c-b570-46c8-b302-c345a4be9524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.355883 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bf67d-5687-4650-9e5b-449979b0335c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.356131 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bf67d-5687-4650-9e5b-449979b0335c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.356386 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c7c2c-b570-46c8-b302-c345a4be9524 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.356593 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bf67d-5687-4650-9e5b-449979b0335c admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.356739 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c7c2c-b570-46c8-b302-c345a4be9524 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.356919 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c7c2c-b570-46c8-b302-c345a4be9524 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.357240 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016bf67d-5687-4650-9e5b-449979b0335c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:34.357527 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016bf67d-5687-4650-9e5b-449979b0335c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.357687 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c7c2c-b570-46c8-b302-c345a4be9524 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:34.357948 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c7c2c-b570-46c8-b302-c345a4be9524 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.359145 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016bf67d-5687-4650-9e5b-449979b0335c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.359559 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c7c2c-b570-46c8-b302-c345a4be9524 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.376754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 296/581] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:34.378138 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bf67d-5687-4650-9e5b-449979b0335c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.388513 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bf67d-5687-4650-9e5b-449979b0335c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.390142 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 286/582] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:34.394303 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3dd9a-3aab-4b27-9a11-c6c7f307cd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.395131 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3dd9a-3aab-4b27-9a11-c6c7f307cd66 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.395405 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3dd9a-3aab-4b27-9a11-c6c7f307cd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.399035 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3dd9a-3aab-4b27-9a11-c6c7f307cd66 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.407370 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c7c2c-b570-46c8-b302-c345a4be9524 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.407670 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3dd9a-3aab-4b27-9a11-c6c7f307cd66 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.409547 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3dd9a-3aab-4b27-9a11-c6c7f307cd66 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.424328 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-70f3dd9a-3aab-4b27-9a11-c6c7f307cd66 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:34.425319 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c7c2c-b570-46c8-b302-c345a4be9524 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.427955 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 297/583] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:34.429691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67175d4f-d821-4603-8c47-cf5d1fa0065b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.429924 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16169121-a3ea-48bd-b949-fc81bfefbe37 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.430419 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16169121-a3ea-48bd-b949-fc81bfefbe37 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.430522 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67175d4f-d821-4603-8c47-cf5d1fa0065b admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.430792 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67175d4f-d821-4603-8c47-cf5d1fa0065b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.431105 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67175d4f-d821-4603-8c47-cf5d1fa0065b admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.431384 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16169121-a3ea-48bd-b949-fc81bfefbe37 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.433604 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 298/584] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:34.434753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16169121-a3ea-48bd-b949-fc81bfefbe37 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.444502 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67175d4f-d821-4603-8c47-cf5d1fa0065b admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.446634 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67175d4f-d821-4603-8c47-cf5d1fa0065b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.449554 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16169121-a3ea-48bd-b949-fc81bfefbe37 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.454188 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b5d06-bb64-430e-aede-60df56384775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.455014 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b5d06-bb64-430e-aede-60df56384775 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.455435 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b5d06-bb64-430e-aede-60df56384775 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.455877 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b5d06-bb64-430e-aede-60df56384775 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.456820 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b5d06-bb64-430e-aede-60df56384775 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:34.457295 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b5d06-bb64-430e-aede-60df56384775 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.459345 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b5d06-bb64-430e-aede-60df56384775 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.461894 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-67175d4f-d821-4603-8c47-cf5d1fa0065b admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 10 12:35:34.463778 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 287/585] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:34.472421 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 299/586] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:34.473461 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67175d4f-d821-4603-8c47-cf5d1fa0065b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.473715 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0080f66-7527-4d1d-b808-6ebfe1b0169c None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.474117 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0080f66-7527-4d1d-b808-6ebfe1b0169c None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.474388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0080f66-7527-4d1d-b808-6ebfe1b0169c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.485850 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67175d4f-d821-4603-8c47-cf5d1fa0065b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.491296 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc5180-d574-45cc-a486-e30163b0bc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.492366 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc5180-d574-45cc-a486-e30163b0bc95 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.492852 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc5180-d574-45cc-a486-e30163b0bc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.492955 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-f0080f66-7527-4d1d-b808-6ebfe1b0169c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:34.493454 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc5180-d574-45cc-a486-e30163b0bc95 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.494255 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f0080f66-7527-4d1d-b808-6ebfe1b0169c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:34.495033 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc5180-d574-45cc-a486-e30163b0bc95 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:34.495602 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc5180-d574-45cc-a486-e30163b0bc95 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.497872 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc5180-d574-45cc-a486-e30163b0bc95 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.502482 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 300/587] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:34.503412 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0080f66-7527-4d1d-b808-6ebfe1b0169c None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.513209 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0080f66-7527-4d1d-b808-6ebfe1b0169c None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.517893 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70020da7-14e9-483d-82aa-5c297e3b32a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.523782 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70020da7-14e9-483d-82aa-5c297e3b32a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.523782 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70020da7-14e9-483d-82aa-5c297e3b32a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.523782 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70020da7-14e9-483d-82aa-5c297e3b32a5 admin admin] PATH_INFO: `/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/f812f38c242d4530b3fc73013f66c9f6/roles/3c723eddb93e4ab6b44d5fe4ed5877a7` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.536793 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 288/588] 10.222.0.13 () {56 vars in 1160 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:34.543351 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc5180-d574-45cc-a486-e30163b0bc95 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.547667 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70020da7-14e9-483d-82aa-5c297e3b32a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0105f8c08c84f538cd7ba86fcd26b62, user_id=f812f38c242d4530b3fc73013f66c9f6, role_id=3c723eddb93e4ab6b44d5fe4ed5877a7)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.551915 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70020da7-14e9-483d-82aa-5c297e3b32a5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.552938 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc5180-d574-45cc-a486-e30163b0bc95 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.558305 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2927a8-aca9-49fc-9793-60f7c6a8a6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.559248 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2927a8-aca9-49fc-9793-60f7c6a8a6ac admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.559598 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2927a8-aca9-49fc-9793-60f7c6a8a6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.560562 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2927a8-aca9-49fc-9793-60f7c6a8a6ac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.571841 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 301/589] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:35:34 2022] PUT /identity/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/f812f38c242d4530b3fc73013f66c9f6/roles/3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:35:34.572709 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2927a8-aca9-49fc-9793-60f7c6a8a6ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.573532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70020da7-14e9-483d-82aa-5c297e3b32a5 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.574706 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2927a8-aca9-49fc-9793-60f7c6a8a6ac admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.594357 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-df2927a8-aca9-49fc-9793-60f7c6a8a6ac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:34.595693 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 289/590] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:34.604296 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2927a8-aca9-49fc-9793-60f7c6a8a6ac admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.629335 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2927a8-aca9-49fc-9793-60f7c6a8a6ac admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.696589 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70020da7-14e9-483d-82aa-5c297e3b32a5 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.702056 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef43e08-4bdc-4d73-b2d7-6650c350afbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.702872 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef43e08-4bdc-4d73-b2d7-6650c350afbf admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.703149 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef43e08-4bdc-4d73-b2d7-6650c350afbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.703440 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef43e08-4bdc-4d73-b2d7-6650c350afbf admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.714135 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a5aac-0d5a-45fc-877a-a76c01bcbc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.715265 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a5aac-0d5a-45fc-877a-a76c01bcbc1d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.715575 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef43e08-4bdc-4d73-b2d7-6650c350afbf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:34.715977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a5aac-0d5a-45fc-877a-a76c01bcbc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.716433 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a5aac-0d5a-45fc-877a-a76c01bcbc1d admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.717362 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a5aac-0d5a-45fc-877a-a76c01bcbc1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:34.717869 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a5aac-0d5a-45fc-877a-a76c01bcbc1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.719763 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a5aac-0d5a-45fc-877a-a76c01bcbc1d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.722996 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-4ef43e08-4bdc-4d73-b2d7-6650c350afbf admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:35:34.723772 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 302/591] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:34.730752 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef43e08-4bdc-4d73-b2d7-6650c350afbf admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.741423 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef43e08-4bdc-4d73-b2d7-6650c350afbf admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.750942 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 290/592] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:34.756049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3d6a8-a114-469c-970d-6b988796b5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.756633 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a5aac-0d5a-45fc-877a-a76c01bcbc1d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.756946 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3d6a8-a114-469c-970d-6b988796b5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.757317 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3d6a8-a114-469c-970d-6b988796b5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.757728 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3d6a8-a114-469c-970d-6b988796b5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.758598 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3d6a8-a114-469c-970d-6b988796b5b9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:34.759047 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3d6a8-a114-469c-970d-6b988796b5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.764990 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3d6a8-a114-469c-970d-6b988796b5b9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.767777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a5aac-0d5a-45fc-877a-a76c01bcbc1d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.781035 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 303/593] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:34.788708 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3d6a8-a114-469c-970d-6b988796b5b9 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.793331 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797e534-d536-4591-8da8-2b73f73014d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.794532 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797e534-d536-4591-8da8-2b73f73014d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.795060 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797e534-d536-4591-8da8-2b73f73014d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.795541 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797e534-d536-4591-8da8-2b73f73014d1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.803638 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797e534-d536-4591-8da8-2b73f73014d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.805528 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3d6a8-a114-469c-970d-6b988796b5b9 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.806366 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797e534-d536-4591-8da8-2b73f73014d1 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.825380 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d13bf-25bf-419a-a739-1b27e45d7636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.826237 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d13bf-25bf-419a-a739-1b27e45d7636 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.826513 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d13bf-25bf-419a-a739-1b27e45d7636 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.826825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d13bf-25bf-419a-a739-1b27e45d7636 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.832594 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-c797e534-d536-4591-8da8-2b73f73014d1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:34.836287 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 291/594] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:34.846900 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d13bf-25bf-419a-a739-1b27e45d7636 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.848858 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d13bf-25bf-419a-a739-1b27e45d7636 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.857301 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797e534-d536-4591-8da8-2b73f73014d1 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.868517 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797e534-d536-4591-8da8-2b73f73014d1 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.876316 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-7c9d13bf-25bf-419a-a739-1b27e45d7636 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:34.877758 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 304/595] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:34.881460 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9130b1-6cf2-4669-a261-a3e1d2643ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.882192 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9130b1-6cf2-4669-a261-a3e1d2643ede admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.882464 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9130b1-6cf2-4669-a261-a3e1d2643ede admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.882729 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9130b1-6cf2-4669-a261-a3e1d2643ede admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.883701 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9130b1-6cf2-4669-a261-a3e1d2643ede admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:34.884004 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9130b1-6cf2-4669-a261-a3e1d2643ede admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.886118 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9130b1-6cf2-4669-a261-a3e1d2643ede admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.887621 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d13bf-25bf-419a-a739-1b27e45d7636 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.900016 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 292/596] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:34.901416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d13bf-25bf-419a-a739-1b27e45d7636 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.905787 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9130b1-6cf2-4669-a261-a3e1d2643ede admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.906319 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afefc54-6ad8-4516-879a-9d2d3d4e12ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.906996 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afefc54-6ad8-4516-879a-9d2d3d4e12ff admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.907436 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afefc54-6ad8-4516-879a-9d2d3d4e12ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.907748 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afefc54-6ad8-4516-879a-9d2d3d4e12ff admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.908536 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afefc54-6ad8-4516-879a-9d2d3d4e12ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:34.908841 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afefc54-6ad8-4516-879a-9d2d3d4e12ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.910547 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afefc54-6ad8-4516-879a-9d2d3d4e12ff admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.916876 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9130b1-6cf2-4669-a261-a3e1d2643ede admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.925918 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425aea45-d991-4f5e-abbe-ebefed097a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.926431 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 305/597] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:34.926812 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425aea45-d991-4f5e-abbe-ebefed097a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.927085 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425aea45-d991-4f5e-abbe-ebefed097a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.927349 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425aea45-d991-4f5e-abbe-ebefed097a88 admin admin] PATH_INFO: `/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/fa3a96ff9ab74aeb88465b14de3038eb/roles/3c723eddb93e4ab6b44d5fe4ed5877a7` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.932150 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afefc54-6ad8-4516-879a-9d2d3d4e12ff admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:34.946250 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afefc54-6ad8-4516-879a-9d2d3d4e12ff admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:34.947769 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425aea45-d991-4f5e-abbe-ebefed097a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0105f8c08c84f538cd7ba86fcd26b62, user_id=fa3a96ff9ab74aeb88465b14de3038eb, role_id=3c723eddb93e4ab6b44d5fe4ed5877a7)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.950529 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425aea45-d991-4f5e-abbe-ebefed097a88 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.959208 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c9532-e244-4e38-933f-511a15d9e228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:34.960114 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c9532-e244-4e38-933f-511a15d9e228 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:34.960394 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c9532-e244-4e38-933f-511a15d9e228 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:34.960695 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c9532-e244-4e38-933f-511a15d9e228 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:34.975537 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 293/598] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:35:34 2022] PUT /identity/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/fa3a96ff9ab74aeb88465b14de3038eb/roles/3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:35:34.975984 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c9532-e244-4e38-933f-511a15d9e228 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:34.978037 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c9532-e244-4e38-933f-511a15d9e228 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:34.992942 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-972c9532-e244-4e38-933f-511a15d9e228 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 10 12:35:34.994680 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 306/599] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:35.000863 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425aea45-d991-4f5e-abbe-ebefed097a88 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:35.074544 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425aea45-d991-4f5e-abbe-ebefed097a88 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:35.079791 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e325508-ce14-4c11-a6a7-467bf4c27e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:35.080868 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e325508-ce14-4c11-a6a7-467bf4c27e41 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:35.081337 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e325508-ce14-4c11-a6a7-467bf4c27e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:35.081849 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e325508-ce14-4c11-a6a7-467bf4c27e41 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:35.082967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e325508-ce14-4c11-a6a7-467bf4c27e41 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:35.083503 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e325508-ce14-4c11-a6a7-467bf4c27e41 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:35.085638 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e325508-ce14-4c11-a6a7-467bf4c27e41 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:35.108207 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 294/600] 10.222.0.13 () {56 vars in 1156 bytes} [Mon Jan 10 12:35:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:35.114351 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c9532-e244-4e38-933f-511a15d9e228 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:35.126171 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c9532-e244-4e38-933f-511a15d9e228 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:35.131198 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f072c-5bd9-433f-b6f0-03c6696e5868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:35.132150 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f072c-5bd9-433f-b6f0-03c6696e5868 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:35.132701 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f072c-5bd9-433f-b6f0-03c6696e5868 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:35.133223 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f072c-5bd9-433f-b6f0-03c6696e5868 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:35.143087 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f072c-5bd9-433f-b6f0-03c6696e5868 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:35.145219 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f072c-5bd9-433f-b6f0-03c6696e5868 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:35.156846 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 307/601] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:35.162842 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e325508-ce14-4c11-a6a7-467bf4c27e41 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:35.174400 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e325508-ce14-4c11-a6a7-467bf4c27e41 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:35.179165 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d6546-b85d-4e00-967d-83e87b34af6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:35.180310 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d6546-b85d-4e00-967d-83e87b34af6c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:35.180805 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d6546-b85d-4e00-967d-83e87b34af6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:35.181340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d6546-b85d-4e00-967d-83e87b34af6c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:35.194469 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d6546-b85d-4e00-967d-83e87b34af6c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:35.196758 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d6546-b85d-4e00-967d-83e87b34af6c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:35.215674 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-966d6546-b85d-4e00-967d-83e87b34af6c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:35.217275 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 295/602] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:35.223008 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f072c-5bd9-433f-b6f0-03c6696e5868 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:35.232561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f072c-5bd9-433f-b6f0-03c6696e5868 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:35.245214 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7ce79-ab15-4930-9423-809abada9bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:35.245913 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7ce79-ab15-4930-9423-809abada9bff admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:35.246198 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7ce79-ab15-4930-9423-809abada9bff admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:35.246468 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7ce79-ab15-4930-9423-809abada9bff admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:35.247290 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7ce79-ab15-4930-9423-809abada9bff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:35.247620 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7ce79-ab15-4930-9423-809abada9bff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:35.249353 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7ce79-ab15-4930-9423-809abada9bff admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:35.273295 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 308/603] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:35.279715 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d6546-b85d-4e00-967d-83e87b34af6c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:35.295544 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d6546-b85d-4e00-967d-83e87b34af6c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:35.302351 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18fff7-13a4-4fa4-8f7a-3bbd985c2f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:35.303484 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18fff7-13a4-4fa4-8f7a-3bbd985c2f9b admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:35.304046 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18fff7-13a4-4fa4-8f7a-3bbd985c2f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:35.304551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18fff7-13a4-4fa4-8f7a-3bbd985c2f9b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:35.317539 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18fff7-13a4-4fa4-8f7a-3bbd985c2f9b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:35.319991 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18fff7-13a4-4fa4-8f7a-3bbd985c2f9b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:35.337248 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-2e18fff7-13a4-4fa4-8f7a-3bbd985c2f9b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:35.339931 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 296/604] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:35.347850 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7ce79-ab15-4930-9423-809abada9bff admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:35.365223 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7ce79-ab15-4930-9423-809abada9bff admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:35.372314 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303d8b2-af79-48df-9aa1-68aa007857d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:35.373224 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303d8b2-af79-48df-9aa1-68aa007857d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:35.373774 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303d8b2-af79-48df-9aa1-68aa007857d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:35.374261 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303d8b2-af79-48df-9aa1-68aa007857d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:35.375426 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303d8b2-af79-48df-9aa1-68aa007857d4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:35.375943 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303d8b2-af79-48df-9aa1-68aa007857d4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:35.378080 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303d8b2-af79-48df-9aa1-68aa007857d4 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:35.397841 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 309/605] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:35.405944 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18fff7-13a4-4fa4-8f7a-3bbd985c2f9b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:35.419078 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18fff7-13a4-4fa4-8f7a-3bbd985c2f9b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:35.431415 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992857b-5b43-46a4-8ce7-43af69c4e347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:35.433198 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992857b-5b43-46a4-8ce7-43af69c4e347 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:35.433721 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992857b-5b43-46a4-8ce7-43af69c4e347 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:35.434202 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992857b-5b43-46a4-8ce7-43af69c4e347 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:35.435294 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992857b-5b43-46a4-8ce7-43af69c4e347 admin admin] RBAC: Adding query filter params (role.id=3c723eddb93e4ab6b44d5fe4ed5877a7, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=1cd898c7c2974bb38998ebad22fd5a3b) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:35.435818 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992857b-5b43-46a4-8ce7-43af69c4e347 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:35.438068 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992857b-5b43-46a4-8ce7-43af69c4e347 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:35.445576 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 297/606] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:35 2022] GET /identity/v3/role_assignments?user.id=1cd898c7c2974bb38998ebad22fd5a3b&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:36.449003 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463f244-ac4d-4feb-b99f-5e0d74e2e4ee None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:36.449536 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463f244-ac4d-4feb-b99f-5e0d74e2e4ee None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:36.449536 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463f244-ac4d-4feb-b99f-5e0d74e2e4ee None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:36.451625 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 310/607] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:36.457362 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5bd5a-1143-48de-aed6-11c5b7d0793d None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:36.457805 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5bd5a-1143-48de-aed6-11c5b7d0793d None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:36.457878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5bd5a-1143-48de-aed6-11c5b7d0793d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:36.477137 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-36a5bd5a-1143-48de-aed6-11c5b7d0793d None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:36.478617 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-36a5bd5a-1143-48de-aed6-11c5b7d0793d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:36.494121 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 298/608] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:35:36.519711 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463f244-ac4d-4feb-b99f-5e0d74e2e4ee None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:36.532792 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463f244-ac4d-4feb-b99f-5e0d74e2e4ee None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:36.537368 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f299746-bf07-4e90-a79b-3c494e06ff48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:36.538387 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f299746-bf07-4e90-a79b-3c494e06ff48 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:36.538668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f299746-bf07-4e90-a79b-3c494e06ff48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:36.538941 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f299746-bf07-4e90-a79b-3c494e06ff48 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:36.550349 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f299746-bf07-4e90-a79b-3c494e06ff48 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:36.557327 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-9f299746-bf07-4e90-a79b-3c494e06ff48 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:35:36.562646 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 311/609] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:36.564786 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5bd5a-1143-48de-aed6-11c5b7d0793d None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:36.575175 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5bd5a-1143-48de-aed6-11c5b7d0793d None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:36.579645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c16ef-c2f1-4713-a8cf-84875b75e0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:36.580312 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c16ef-c2f1-4713-a8cf-84875b75e0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:36.580586 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c16ef-c2f1-4713-a8cf-84875b75e0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:36.580858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c16ef-c2f1-4713-a8cf-84875b75e0e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:36.581610 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c16ef-c2f1-4713-a8cf-84875b75e0e7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:36.581913 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c16ef-c2f1-4713-a8cf-84875b75e0e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:36.583529 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c16ef-c2f1-4713-a8cf-84875b75e0e7 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:36.596689 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 299/610] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:35:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:36.598083 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f299746-bf07-4e90-a79b-3c494e06ff48 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:36.608740 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f299746-bf07-4e90-a79b-3c494e06ff48 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:36.613208 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cdfb3-5b89-4892-a6b9-5191b98bc895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:36.613992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cdfb3-5b89-4892-a6b9-5191b98bc895 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:36.614276 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cdfb3-5b89-4892-a6b9-5191b98bc895 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:36.614535 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cdfb3-5b89-4892-a6b9-5191b98bc895 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:36.625099 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cdfb3-5b89-4892-a6b9-5191b98bc895 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:36.626955 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cdfb3-5b89-4892-a6b9-5191b98bc895 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:36.643854 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-e16cdfb3-5b89-4892-a6b9-5191b98bc895 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:36.649638 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 312/611] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:36.651042 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c16ef-c2f1-4713-a8cf-84875b75e0e7 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:36.660648 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c16ef-c2f1-4713-a8cf-84875b75e0e7 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:36.665101 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3666c6-2483-423d-bf5c-0c2fc26d9422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:36.665834 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3666c6-2483-423d-bf5c-0c2fc26d9422 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:36.666087 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3666c6-2483-423d-bf5c-0c2fc26d9422 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:36.666732 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3666c6-2483-423d-bf5c-0c2fc26d9422 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:36.667065 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3666c6-2483-423d-bf5c-0c2fc26d9422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:36.667366 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3666c6-2483-423d-bf5c-0c2fc26d9422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:36.669145 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3666c6-2483-423d-bf5c-0c2fc26d9422 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:36.688514 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 300/612] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:36.694487 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cdfb3-5b89-4892-a6b9-5191b98bc895 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:36.707091 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cdfb3-5b89-4892-a6b9-5191b98bc895 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:36.713594 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd8c07-ffa1-402e-ac06-62522ada2a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:36.714441 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd8c07-ffa1-402e-ac06-62522ada2a57 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:36.714719 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd8c07-ffa1-402e-ac06-62522ada2a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:36.714987 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd8c07-ffa1-402e-ac06-62522ada2a57 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:36.724486 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd8c07-ffa1-402e-ac06-62522ada2a57 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:36.726569 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd8c07-ffa1-402e-ac06-62522ada2a57 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:36.748586 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-14fd8c07-ffa1-402e-ac06-62522ada2a57 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 12:35:36.754419 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 313/613] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jan 10 12:35:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:36.755890 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3666c6-2483-423d-bf5c-0c2fc26d9422 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:36.767707 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3666c6-2483-423d-bf5c-0c2fc26d9422 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:36.772195 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974b1db-0551-4fba-829c-8cee529597ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:36.772868 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974b1db-0551-4fba-829c-8cee529597ef admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:36.773148 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974b1db-0551-4fba-829c-8cee529597ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:36.773417 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974b1db-0551-4fba-829c-8cee529597ef admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:36.774334 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974b1db-0551-4fba-829c-8cee529597ef admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:36.774673 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974b1db-0551-4fba-829c-8cee529597ef admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:36.776907 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974b1db-0551-4fba-829c-8cee529597ef admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:36.798853 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 301/614] 10.222.0.13 () {56 vars in 1154 bytes} [Mon Jan 10 12:35:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:36.804544 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd8c07-ffa1-402e-ac06-62522ada2a57 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:36.816528 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd8c07-ffa1-402e-ac06-62522ada2a57 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:36.824928 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d8bfb-e155-4955-9f7b-470584b77b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:36.825617 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d8bfb-e155-4955-9f7b-470584b77b64 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:36.825947 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d8bfb-e155-4955-9f7b-470584b77b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:36.826224 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d8bfb-e155-4955-9f7b-470584b77b64 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:36.837451 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d8bfb-e155-4955-9f7b-470584b77b64 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:36.839599 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d8bfb-e155-4955-9f7b-470584b77b64 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:36.852250 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 314/615] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:36.855579 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974b1db-0551-4fba-829c-8cee529597ef admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:36.865656 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974b1db-0551-4fba-829c-8cee529597ef admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:36.870665 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0eb91-6deb-4a2d-ba23-4e5bc7432752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:36.871531 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0eb91-6deb-4a2d-ba23-4e5bc7432752 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:36.871823 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0eb91-6deb-4a2d-ba23-4e5bc7432752 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:36.872139 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0eb91-6deb-4a2d-ba23-4e5bc7432752 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:36.882957 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0eb91-6deb-4a2d-ba23-4e5bc7432752 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:36.885259 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0eb91-6deb-4a2d-ba23-4e5bc7432752 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:36.903126 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-41d0eb91-6deb-4a2d-ba23-4e5bc7432752 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:36.908929 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 302/616] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:36.910294 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d8bfb-e155-4955-9f7b-470584b77b64 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:36.920330 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d8bfb-e155-4955-9f7b-470584b77b64 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:36.925203 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6266521-4e72-458a-9c60-96e9ef06e0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:36.925867 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6266521-4e72-458a-9c60-96e9ef06e0af admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:36.926151 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6266521-4e72-458a-9c60-96e9ef06e0af admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:36.926467 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6266521-4e72-458a-9c60-96e9ef06e0af admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:36.927148 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6266521-4e72-458a-9c60-96e9ef06e0af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:36.927447 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6266521-4e72-458a-9c60-96e9ef06e0af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:36.929080 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6266521-4e72-458a-9c60-96e9ef06e0af admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:36.946393 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 315/617] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:36.948106 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0eb91-6deb-4a2d-ba23-4e5bc7432752 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:36.957838 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0eb91-6deb-4a2d-ba23-4e5bc7432752 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:36.962165 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532ef88-91c4-43f7-9840-beb11cc64688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:36.963157 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532ef88-91c4-43f7-9840-beb11cc64688 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:36.963434 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532ef88-91c4-43f7-9840-beb11cc64688 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:36.963735 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532ef88-91c4-43f7-9840-beb11cc64688 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:36.970948 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532ef88-91c4-43f7-9840-beb11cc64688 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:36.972950 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532ef88-91c4-43f7-9840-beb11cc64688 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:36.985749 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-a532ef88-91c4-43f7-9840-beb11cc64688 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:36.991706 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 303/618] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:36.993085 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6266521-4e72-458a-9c60-96e9ef06e0af admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:37.006894 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6266521-4e72-458a-9c60-96e9ef06e0af admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:37.016117 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bdf48-b9db-4f55-b291-ea6a2cfb3253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:37.016796 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bdf48-b9db-4f55-b291-ea6a2cfb3253 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:37.017076 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bdf48-b9db-4f55-b291-ea6a2cfb3253 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:37.017346 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bdf48-b9db-4f55-b291-ea6a2cfb3253 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:37.018151 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bdf48-b9db-4f55-b291-ea6a2cfb3253 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:37.018458 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bdf48-b9db-4f55-b291-ea6a2cfb3253 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:37.020352 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bdf48-b9db-4f55-b291-ea6a2cfb3253 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:37.032953 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 316/619] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:37.039026 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532ef88-91c4-43f7-9840-beb11cc64688 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:37.052396 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532ef88-91c4-43f7-9840-beb11cc64688 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:37.061043 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53251d8a-1eb3-4d59-aecd-c5a020fb4177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:37.061699 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53251d8a-1eb3-4d59-aecd-c5a020fb4177 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:37.061977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53251d8a-1eb3-4d59-aecd-c5a020fb4177 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:37.062246 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53251d8a-1eb3-4d59-aecd-c5a020fb4177 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:37.063189 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53251d8a-1eb3-4d59-aecd-c5a020fb4177 admin admin] RBAC: Adding query filter params (role.id=3c723eddb93e4ab6b44d5fe4ed5877a7, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=d68fa8e4f3a341a5b74ee32c85e59869) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:37.063505 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53251d8a-1eb3-4d59-aecd-c5a020fb4177 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:37.065736 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53251d8a-1eb3-4d59-aecd-c5a020fb4177 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:37.073693 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 304/620] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:37 2022] GET /identity/v3/role_assignments?user.id=d68fa8e4f3a341a5b74ee32c85e59869&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:37.122048 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7981580-eacd-4f37-ad87-0f5e36a9c6bc None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:37.122408 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7981580-eacd-4f37-ad87-0f5e36a9c6bc None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:37.122561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7981580-eacd-4f37-ad87-0f5e36a9c6bc None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:37.124393 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 317/621] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:37.130193 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fbcbf-3c1d-40f0-ac74-9da7490744f2 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:37.130475 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fbcbf-3c1d-40f0-ac74-9da7490744f2 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:37.130747 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fbcbf-3c1d-40f0-ac74-9da7490744f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:37.152220 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-f75fbcbf-3c1d-40f0-ac74-9da7490744f2 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:37.153447 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-f75fbcbf-3c1d-40f0-ac74-9da7490744f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:37.167620 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 305/622] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:35:37.187245 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7981580-eacd-4f37-ad87-0f5e36a9c6bc None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:37.201396 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7981580-eacd-4f37-ad87-0f5e36a9c6bc None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:37.206513 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b65665-a579-453f-9a15-a4c8bdb5f386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:37.207342 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b65665-a579-453f-9a15-a4c8bdb5f386 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:37.207651 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b65665-a579-453f-9a15-a4c8bdb5f386 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:37.207967 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b65665-a579-453f-9a15-a4c8bdb5f386 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:37.222019 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b65665-a579-453f-9a15-a4c8bdb5f386 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:37.229644 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-c3b65665-a579-453f-9a15-a4c8bdb5f386 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:35:37.235658 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 318/623] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:37.237216 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fbcbf-3c1d-40f0-ac74-9da7490744f2 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:37.247379 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fbcbf-3c1d-40f0-ac74-9da7490744f2 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:37.251965 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2b376-d733-49cd-891b-6e454e184f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:37.252661 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2b376-d733-49cd-891b-6e454e184f3a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:37.252935 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2b376-d733-49cd-891b-6e454e184f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:37.253197 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2b376-d733-49cd-891b-6e454e184f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:37.253974 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2b376-d733-49cd-891b-6e454e184f3a admin admin] RBAC: Adding query filter params (name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:37.254270 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2b376-d733-49cd-891b-6e454e184f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:37.255940 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2b376-d733-49cd-891b-6e454e184f3a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:37.269109 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 306/624] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:35:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:37.271693 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b65665-a579-453f-9a15-a4c8bdb5f386 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:37.283929 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b65665-a579-453f-9a15-a4c8bdb5f386 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:37.288495 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ed7ea-5dd1-4e2a-9c43-406beab76fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:37.289295 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ed7ea-5dd1-4e2a-9c43-406beab76fea admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:37.289569 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ed7ea-5dd1-4e2a-9c43-406beab76fea admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:37.289836 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ed7ea-5dd1-4e2a-9c43-406beab76fea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:37.301970 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ed7ea-5dd1-4e2a-9c43-406beab76fea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:37.303858 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ed7ea-5dd1-4e2a-9c43-406beab76fea admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:37.326655 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-031ed7ea-5dd1-4e2a-9c43-406beab76fea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:37.332435 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 319/625] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:37.338957 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2b376-d733-49cd-891b-6e454e184f3a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:37.353066 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2b376-d733-49cd-891b-6e454e184f3a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:37.361169 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27883f35-6ee6-4c67-b269-49032e8c9a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:37.361852 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27883f35-6ee6-4c67-b269-49032e8c9a76 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:37.362131 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27883f35-6ee6-4c67-b269-49032e8c9a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:37.362395 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27883f35-6ee6-4c67-b269-49032e8c9a76 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:37.363138 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27883f35-6ee6-4c67-b269-49032e8c9a76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:37.363429 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27883f35-6ee6-4c67-b269-49032e8c9a76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:37.365071 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27883f35-6ee6-4c67-b269-49032e8c9a76 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:37.387054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 307/626] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:37.393748 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ed7ea-5dd1-4e2a-9c43-406beab76fea admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:37.408953 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ed7ea-5dd1-4e2a-9c43-406beab76fea admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:37.418212 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0974b-2ab7-44e9-b8dd-60fbb4887863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:37.419027 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0974b-2ab7-44e9-b8dd-60fbb4887863 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:37.419300 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0974b-2ab7-44e9-b8dd-60fbb4887863 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:37.419588 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0974b-2ab7-44e9-b8dd-60fbb4887863 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:37.433077 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0974b-2ab7-44e9-b8dd-60fbb4887863 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:37.435281 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0974b-2ab7-44e9-b8dd-60fbb4887863 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:37.455941 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-55e0974b-2ab7-44e9-b8dd-60fbb4887863 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 10 12:35:37.458654 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 320/627] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:37.463786 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27883f35-6ee6-4c67-b269-49032e8c9a76 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:37.474494 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27883f35-6ee6-4c67-b269-49032e8c9a76 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:37.479391 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d491fb-a8c9-4bc9-ae24-b43a3fc241da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:37.480150 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d491fb-a8c9-4bc9-ae24-b43a3fc241da admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:37.480421 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d491fb-a8c9-4bc9-ae24-b43a3fc241da admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:37.480685 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d491fb-a8c9-4bc9-ae24-b43a3fc241da admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:37.481641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d491fb-a8c9-4bc9-ae24-b43a3fc241da admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:37.481936 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d491fb-a8c9-4bc9-ae24-b43a3fc241da admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:37.483919 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d491fb-a8c9-4bc9-ae24-b43a3fc241da admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:37.506186 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 308/628] 10.222.0.13 () {56 vars in 1158 bytes} [Mon Jan 10 12:35:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:37.512628 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0974b-2ab7-44e9-b8dd-60fbb4887863 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:37.523372 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0974b-2ab7-44e9-b8dd-60fbb4887863 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:37.528738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ba98c-bd26-448a-b51b-fbe17e527af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:37.529434 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ba98c-bd26-448a-b51b-fbe17e527af9 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:37.529708 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ba98c-bd26-448a-b51b-fbe17e527af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:37.530026 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ba98c-bd26-448a-b51b-fbe17e527af9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:37.538338 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ba98c-bd26-448a-b51b-fbe17e527af9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:37.540222 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ba98c-bd26-448a-b51b-fbe17e527af9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:37.554785 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 321/629] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:37.556236 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d491fb-a8c9-4bc9-ae24-b43a3fc241da admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:37.570698 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d491fb-a8c9-4bc9-ae24-b43a3fc241da admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:37.575883 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c7102-b819-4bc9-ba7d-aa3a032de69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:37.576740 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c7102-b819-4bc9-ba7d-aa3a032de69d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:37.577018 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c7102-b819-4bc9-ba7d-aa3a032de69d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:37.577292 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c7102-b819-4bc9-ba7d-aa3a032de69d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:37.589013 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c7102-b819-4bc9-ba7d-aa3a032de69d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:37.590917 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c7102-b819-4bc9-ba7d-aa3a032de69d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:37.608607 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-901c7102-b819-4bc9-ba7d-aa3a032de69d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:37.614300 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 309/630] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:37.615838 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ba98c-bd26-448a-b51b-fbe17e527af9 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:37.625143 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ba98c-bd26-448a-b51b-fbe17e527af9 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:37.629763 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7100976-527e-47f3-86fb-d5ac6790d147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:37.630424 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7100976-527e-47f3-86fb-d5ac6790d147 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:37.630700 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7100976-527e-47f3-86fb-d5ac6790d147 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:37.630964 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7100976-527e-47f3-86fb-d5ac6790d147 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:37.631743 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7100976-527e-47f3-86fb-d5ac6790d147 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:37.632043 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7100976-527e-47f3-86fb-d5ac6790d147 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:37.633699 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7100976-527e-47f3-86fb-d5ac6790d147 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:37.650975 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 322/631] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:37.652421 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c7102-b819-4bc9-ba7d-aa3a032de69d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:37.662381 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c7102-b819-4bc9-ba7d-aa3a032de69d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:37.666953 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb01ae8-2001-4029-83c9-2d308c1218ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:37.667830 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb01ae8-2001-4029-83c9-2d308c1218ec admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:37.668105 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb01ae8-2001-4029-83c9-2d308c1218ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:37.668373 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb01ae8-2001-4029-83c9-2d308c1218ec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:37.675835 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb01ae8-2001-4029-83c9-2d308c1218ec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:37.677953 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb01ae8-2001-4029-83c9-2d308c1218ec admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:37.691820 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-5fb01ae8-2001-4029-83c9-2d308c1218ec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:37.697800 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 310/632] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:37.699214 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7100976-527e-47f3-86fb-d5ac6790d147 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:37.713947 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7100976-527e-47f3-86fb-d5ac6790d147 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:37.721446 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85138d4-03fe-4102-9973-a8e246edcc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:37.722180 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85138d4-03fe-4102-9973-a8e246edcc6a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:37.722456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85138d4-03fe-4102-9973-a8e246edcc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:37.722728 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85138d4-03fe-4102-9973-a8e246edcc6a admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:37.723661 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85138d4-03fe-4102-9973-a8e246edcc6a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:37.724011 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85138d4-03fe-4102-9973-a8e246edcc6a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:37.725938 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85138d4-03fe-4102-9973-a8e246edcc6a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:37.753570 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 323/633] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:37.754963 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb01ae8-2001-4029-83c9-2d308c1218ec admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:37.765696 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb01ae8-2001-4029-83c9-2d308c1218ec admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:37.770259 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48ad72-0206-498a-a2b9-2cc608b45a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:37.770962 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48ad72-0206-498a-a2b9-2cc608b45a31 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:37.771238 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48ad72-0206-498a-a2b9-2cc608b45a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:37.771534 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48ad72-0206-498a-a2b9-2cc608b45a31 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:37.772461 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48ad72-0206-498a-a2b9-2cc608b45a31 admin admin] RBAC: Adding query filter params (role.id=3c723eddb93e4ab6b44d5fe4ed5877a7, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=dbaa0eb9e5b44a93a357473f8ec1a5fb) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:37.772712 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48ad72-0206-498a-a2b9-2cc608b45a31 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:37.774660 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48ad72-0206-498a-a2b9-2cc608b45a31 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:37.787635 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 311/634] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:37 2022] GET /identity/v3/role_assignments?user.id=dbaa0eb9e5b44a93a357473f8ec1a5fb&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:37.969513 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6796986-e7cf-448a-a258-18f7bb61d6d5 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:37.969881 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6796986-e7cf-448a-a258-18f7bb61d6d5 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:37.970049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6796986-e7cf-448a-a258-18f7bb61d6d5 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:37.972201 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 324/635] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:37.977498 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532ab72-10bb-466f-b6fb-0acf37efed84 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:37.977792 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532ab72-10bb-466f-b6fb-0acf37efed84 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:37.978037 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532ab72-10bb-466f-b6fb-0acf37efed84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.000655 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-f532ab72-10bb-466f-b6fb-0acf37efed84 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:38.001895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-f532ab72-10bb-466f-b6fb-0acf37efed84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:38.011553 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 312/636] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:35:38.061137 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6796986-e7cf-448a-a258-18f7bb61d6d5 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.075379 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6796986-e7cf-448a-a258-18f7bb61d6d5 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.080349 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed791320-4634-48fb-9b63-cd0776c99719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.081214 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed791320-4634-48fb-9b63-cd0776c99719 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.081489 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed791320-4634-48fb-9b63-cd0776c99719 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.081802 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed791320-4634-48fb-9b63-cd0776c99719 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.096242 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed791320-4634-48fb-9b63-cd0776c99719 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:38.103370 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-ed791320-4634-48fb-9b63-cd0776c99719 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:35:38.109515 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 325/637] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:38.110916 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532ab72-10bb-466f-b6fb-0acf37efed84 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.120102 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532ab72-10bb-466f-b6fb-0acf37efed84 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.124723 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09f882-2b73-486d-9fa6-e1bba13dfa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.125437 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09f882-2b73-486d-9fa6-e1bba13dfa5f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.125716 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09f882-2b73-486d-9fa6-e1bba13dfa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.125987 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09f882-2b73-486d-9fa6-e1bba13dfa5f admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.126751 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09f882-2b73-486d-9fa6-e1bba13dfa5f admin admin] RBAC: Adding query filter params (name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:38.127054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09f882-2b73-486d-9fa6-e1bba13dfa5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.128750 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09f882-2b73-486d-9fa6-e1bba13dfa5f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.141932 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 313/638] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:38.144050 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed791320-4634-48fb-9b63-cd0776c99719 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.156171 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed791320-4634-48fb-9b63-cd0776c99719 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.160799 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e42b20-0045-4254-8411-107ef9231a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.161649 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e42b20-0045-4254-8411-107ef9231a5a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.161922 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e42b20-0045-4254-8411-107ef9231a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.162234 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e42b20-0045-4254-8411-107ef9231a5a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.174299 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e42b20-0045-4254-8411-107ef9231a5a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.176246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e42b20-0045-4254-8411-107ef9231a5a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.194200 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-a4e42b20-0045-4254-8411-107ef9231a5a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:38.198820 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 326/639] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:38.201690 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09f882-2b73-486d-9fa6-e1bba13dfa5f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.211537 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09f882-2b73-486d-9fa6-e1bba13dfa5f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.216131 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd1ef2-3801-4785-9180-ad3fbb5577f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.216848 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd1ef2-3801-4785-9180-ad3fbb5577f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.217122 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd1ef2-3801-4785-9180-ad3fbb5577f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.217388 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd1ef2-3801-4785-9180-ad3fbb5577f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.218172 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd1ef2-3801-4785-9180-ad3fbb5577f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:38.218471 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd1ef2-3801-4785-9180-ad3fbb5577f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.220300 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd1ef2-3801-4785-9180-ad3fbb5577f5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.238919 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 314/640] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:38.240331 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e42b20-0045-4254-8411-107ef9231a5a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.250755 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e42b20-0045-4254-8411-107ef9231a5a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.255260 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10220-ff47-406b-bd06-3d49cf5c78d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.256138 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10220-ff47-406b-bd06-3d49cf5c78d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.256416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10220-ff47-406b-bd06-3d49cf5c78d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.256733 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10220-ff47-406b-bd06-3d49cf5c78d9 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.264994 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b10220-ff47-406b-bd06-3d49cf5c78d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.267012 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b10220-ff47-406b-bd06-3d49cf5c78d9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.283925 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-28b10220-ff47-406b-bd06-3d49cf5c78d9 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 10 12:35:38.288796 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 327/641] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:38.291406 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd1ef2-3801-4785-9180-ad3fbb5577f5 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.301777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd1ef2-3801-4785-9180-ad3fbb5577f5 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.306453 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f55c2e-362f-4228-b20c-b602d89ee5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.307171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f55c2e-362f-4228-b20c-b602d89ee5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.307447 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f55c2e-362f-4228-b20c-b602d89ee5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.307744 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f55c2e-362f-4228-b20c-b602d89ee5d5 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.308655 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f55c2e-362f-4228-b20c-b602d89ee5d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:38.308960 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f55c2e-362f-4228-b20c-b602d89ee5d5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.311001 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f55c2e-362f-4228-b20c-b602d89ee5d5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.335082 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 315/642] 10.222.0.13 () {56 vars in 1158 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:38.340930 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10220-ff47-406b-bd06-3d49cf5c78d9 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.351504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10220-ff47-406b-bd06-3d49cf5c78d9 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.358261 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d64ce-6c2e-49f5-9b34-83f97a89fafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.359402 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d64ce-6c2e-49f5-9b34-83f97a89fafa admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.359749 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d64ce-6c2e-49f5-9b34-83f97a89fafa admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.360019 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d64ce-6c2e-49f5-9b34-83f97a89fafa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.368909 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d64ce-6c2e-49f5-9b34-83f97a89fafa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.370940 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d64ce-6c2e-49f5-9b34-83f97a89fafa admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.385178 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 328/643] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:38.386633 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f55c2e-362f-4228-b20c-b602d89ee5d5 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.388839 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347da4e-4fad-4262-892f-19b916650706 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.389126 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347da4e-4fad-4262-892f-19b916650706 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.389383 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347da4e-4fad-4262-892f-19b916650706 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.391125 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 329/644] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:38.392196 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8466b-56eb-413e-be1c-1128218e80ce None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.392467 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8466b-56eb-413e-be1c-1128218e80ce None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.392730 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8466b-56eb-413e-be1c-1128218e80ce None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.395150 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 330/645] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:38.400477 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e0b9a-375b-4e42-9680-b597295d816a None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.400798 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e0b9a-375b-4e42-9680-b597295d816a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.401068 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e0b9a-375b-4e42-9680-b597295d816a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.401513 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f55c2e-362f-4228-b20c-b602d89ee5d5 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.409568 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fae84-f754-4a6a-b997-9a05f6339cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.410361 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fae84-f754-4a6a-b997-9a05f6339cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.410630 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fae84-f754-4a6a-b997-9a05f6339cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.410889 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fae84-f754-4a6a-b997-9a05f6339cd0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.423190 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-da2e0b9a-375b-4e42-9680-b597295d816a None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:38.424678 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-da2e0b9a-375b-4e42-9680-b597295d816a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:38.426159 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fae84-f754-4a6a-b997-9a05f6339cd0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.428544 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fae84-f754-4a6a-b997-9a05f6339cd0 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.434081 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 331/646] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:35:38.435347 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94269a2-d70b-45f7-bc54-c5f092579fa2 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.439707 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94269a2-d70b-45f7-bc54-c5f092579fa2 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.440373 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94269a2-d70b-45f7-bc54-c5f092579fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.463251 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-db0fae84-f754-4a6a-b997-9a05f6339cd0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:38.464647 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 316/647] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:38.465510 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fae84-f754-4a6a-b997-9a05f6339cd0 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.476641 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-c94269a2-d70b-45f7-bc54-c5f092579fa2 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:38.477748 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c94269a2-d70b-45f7-bc54-c5f092579fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:38.478068 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fae84-f754-4a6a-b997-9a05f6339cd0 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.483300 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0313d08-916e-48b3-8fff-019d9c30444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.484251 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0313d08-916e-48b3-8fff-019d9c30444e admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.484679 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0313d08-916e-48b3-8fff-019d9c30444e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.485074 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0313d08-916e-48b3-8fff-019d9c30444e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.486081 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 332/648] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:38.486870 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94269a2-d70b-45f7-bc54-c5f092579fa2 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.496657 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0313d08-916e-48b3-8fff-019d9c30444e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:38.498136 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94269a2-d70b-45f7-bc54-c5f092579fa2 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.502513 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64f24c-9275-4103-8213-02b3dddad023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.503161 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64f24c-9275-4103-8213-02b3dddad023 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.503431 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64f24c-9275-4103-8213-02b3dddad023 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.503723 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64f24c-9275-4103-8213-02b3dddad023 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.504462 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64f24c-9275-4103-8213-02b3dddad023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:38.504633 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-f0313d08-916e-48b3-8fff-019d9c30444e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:35:38.504781 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64f24c-9275-4103-8213-02b3dddad023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.506217 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 317/649] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:38.506388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64f24c-9275-4103-8213-02b3dddad023 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.514006 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0313d08-916e-48b3-8fff-019d9c30444e admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.524182 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 333/650] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:38.529790 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64f24c-9275-4103-8213-02b3dddad023 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.532301 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0313d08-916e-48b3-8fff-019d9c30444e admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.536905 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd090e-2e90-43db-b119-e39570ac0b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.537628 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd090e-2e90-43db-b119-e39570ac0b94 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.537907 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd090e-2e90-43db-b119-e39570ac0b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.538223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd090e-2e90-43db-b119-e39570ac0b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.538994 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd090e-2e90-43db-b119-e39570ac0b94 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:38.539345 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd090e-2e90-43db-b119-e39570ac0b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.539670 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64f24c-9275-4103-8213-02b3dddad023 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.541433 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd090e-2e90-43db-b119-e39570ac0b94 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.545113 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aab69f-08e1-4191-98b4-3df440d2cca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.546003 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aab69f-08e1-4191-98b4-3df440d2cca3 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.546274 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aab69f-08e1-4191-98b4-3df440d2cca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.546537 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aab69f-08e1-4191-98b4-3df440d2cca3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.551894 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 318/651] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:38.552883 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd090e-2e90-43db-b119-e39570ac0b94 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.564695 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd090e-2e90-43db-b119-e39570ac0b94 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.568072 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aab69f-08e1-4191-98b4-3df440d2cca3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:38.569364 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ac5c7-985f-4171-8787-3d650d719ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.570145 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ac5c7-985f-4171-8787-3d650d719ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.570421 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ac5c7-985f-4171-8787-3d650d719ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.570756 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ac5c7-985f-4171-8787-3d650d719ba5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.576070 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-79aab69f-08e1-4191-98b4-3df440d2cca3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:35:38.577718 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ac5c7-985f-4171-8787-3d650d719ba5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.578133 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 334/652] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:38.578990 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aab69f-08e1-4191-98b4-3df440d2cca3 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.581319 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ac5c7-985f-4171-8787-3d650d719ba5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.594688 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aab69f-08e1-4191-98b4-3df440d2cca3 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.599088 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae909b1c-448f-4ce1-8d2c-36f9ad2e2177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.599897 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae909b1c-448f-4ce1-8d2c-36f9ad2e2177 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.600168 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae909b1c-448f-4ce1-8d2c-36f9ad2e2177 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.600405 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-d06ac5c7-985f-4171-8787-3d650d719ba5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:38.600572 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae909b1c-448f-4ce1-8d2c-36f9ad2e2177 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.602189 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 319/653] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:38.603054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ac5c7-985f-4171-8787-3d650d719ba5 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.617466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae909b1c-448f-4ce1-8d2c-36f9ad2e2177 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.618277 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ac5c7-985f-4171-8787-3d650d719ba5 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.619571 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae909b1c-448f-4ce1-8d2c-36f9ad2e2177 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.623924 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb7aec-08b6-45dd-b3ab-f3c3c5a77471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.624582 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb7aec-08b6-45dd-b3ab-f3c3c5a77471 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.624856 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb7aec-08b6-45dd-b3ab-f3c3c5a77471 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.625121 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb7aec-08b6-45dd-b3ab-f3c3c5a77471 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.625878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb7aec-08b6-45dd-b3ab-f3c3c5a77471 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:38.626176 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb7aec-08b6-45dd-b3ab-f3c3c5a77471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.628273 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb7aec-08b6-45dd-b3ab-f3c3c5a77471 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.637890 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 320/654] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:38.638685 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb7aec-08b6-45dd-b3ab-f3c3c5a77471 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.640989 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-ae909b1c-448f-4ce1-8d2c-36f9ad2e2177 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:38.643590 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 335/655] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:38.644502 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae909b1c-448f-4ce1-8d2c-36f9ad2e2177 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.655971 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae909b1c-448f-4ce1-8d2c-36f9ad2e2177 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.657781 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb7aec-08b6-45dd-b3ab-f3c3c5a77471 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.661063 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f5e48-bdd3-4b49-9b86-41fc661a4fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.662055 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f5e48-bdd3-4b49-9b86-41fc661a4fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.662274 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3566ff-477a-4f07-81d8-5cbcff731924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.662446 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f5e48-bdd3-4b49-9b86-41fc661a4fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.662615 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f5e48-bdd3-4b49-9b86-41fc661a4fb5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.662874 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3566ff-477a-4f07-81d8-5cbcff731924 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.663150 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3566ff-477a-4f07-81d8-5cbcff731924 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.667534 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3566ff-477a-4f07-81d8-5cbcff731924 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.667534 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3566ff-477a-4f07-81d8-5cbcff731924 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:38.667534 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3566ff-477a-4f07-81d8-5cbcff731924 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.667534 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3566ff-477a-4f07-81d8-5cbcff731924 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.674409 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f5e48-bdd3-4b49-9b86-41fc661a4fb5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.676882 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f5e48-bdd3-4b49-9b86-41fc661a4fb5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.686562 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 321/656] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:38.687485 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3566ff-477a-4f07-81d8-5cbcff731924 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.698025 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-a50f5e48-bdd3-4b49-9b86-41fc661a4fb5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:38.698367 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3566ff-477a-4f07-81d8-5cbcff731924 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.699566 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 336/657] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:38.704842 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f5e48-bdd3-4b49-9b86-41fc661a4fb5 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.709504 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f23c88-6307-4400-b15a-443f064f4bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.710175 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f23c88-6307-4400-b15a-443f064f4bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.710450 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f23c88-6307-4400-b15a-443f064f4bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.710764 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f23c88-6307-4400-b15a-443f064f4bd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.711530 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f23c88-6307-4400-b15a-443f064f4bd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:38.711883 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f23c88-6307-4400-b15a-443f064f4bd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.713640 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f23c88-6307-4400-b15a-443f064f4bd2 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.715398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f5e48-bdd3-4b49-9b86-41fc661a4fb5 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.720700 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c9d9a-7fad-4c5d-a701-63c8ea4c25d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.721337 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c9d9a-7fad-4c5d-a701-63c8ea4c25d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.721616 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c9d9a-7fad-4c5d-a701-63c8ea4c25d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.722378 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c9d9a-7fad-4c5d-a701-63c8ea4c25d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.723230 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c9d9a-7fad-4c5d-a701-63c8ea4c25d0 admin admin] RBAC: Adding query filter params (role.id=3c723eddb93e4ab6b44d5fe4ed5877a7, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=f812f38c242d4530b3fc73013f66c9f6) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:38.723962 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c9d9a-7fad-4c5d-a701-63c8ea4c25d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.726109 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c9d9a-7fad-4c5d-a701-63c8ea4c25d0 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.727289 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 322/658] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:38.728140 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f23c88-6307-4400-b15a-443f064f4bd2 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.745085 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 337/659] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/role_assignments?user.id=f812f38c242d4530b3fc73013f66c9f6&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:38.745944 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c9d9a-7fad-4c5d-a701-63c8ea4c25d0 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.755243 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f23c88-6307-4400-b15a-443f064f4bd2 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.756321 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c9d9a-7fad-4c5d-a701-63c8ea4c25d0 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.761412 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eec888-66f8-4968-bdc1-1b40f52abef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.762622 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eec888-66f8-4968-bdc1-1b40f52abef4 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.762945 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eec888-66f8-4968-bdc1-1b40f52abef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.763377 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eec888-66f8-4968-bdc1-1b40f52abef4 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.767816 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36afb8-0c30-4b3e-b68d-58eaf890b291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.768572 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36afb8-0c30-4b3e-b68d-58eaf890b291 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.768966 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36afb8-0c30-4b3e-b68d-58eaf890b291 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.769305 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36afb8-0c30-4b3e-b68d-58eaf890b291 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.770168 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36afb8-0c30-4b3e-b68d-58eaf890b291 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:38.770541 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36afb8-0c30-4b3e-b68d-58eaf890b291 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.776787 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36afb8-0c30-4b3e-b68d-58eaf890b291 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.777920 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eec888-66f8-4968-bdc1-1b40f52abef4 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.781884 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eec888-66f8-4968-bdc1-1b40f52abef4 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.807310 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 323/660] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:38.812303 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-e4eec888-66f8-4968-bdc1-1b40f52abef4 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 10 12:35:38.816002 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36afb8-0c30-4b3e-b68d-58eaf890b291 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.816842 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 338/661] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:38.821947 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eec888-66f8-4968-bdc1-1b40f52abef4 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.830905 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36afb8-0c30-4b3e-b68d-58eaf890b291 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.835575 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598157b7-a923-4413-89ac-bab6beaeef03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.836390 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598157b7-a923-4413-89ac-bab6beaeef03 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.836717 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598157b7-a923-4413-89ac-bab6beaeef03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.836988 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598157b7-a923-4413-89ac-bab6beaeef03 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.837833 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eec888-66f8-4968-bdc1-1b40f52abef4 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.850746 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8971fa0-5317-41a7-bdb7-e17344c29a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.852856 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8971fa0-5317-41a7-bdb7-e17344c29a97 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.853136 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8971fa0-5317-41a7-bdb7-e17344c29a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.853490 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8971fa0-5317-41a7-bdb7-e17344c29a97 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.855786 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8971fa0-5317-41a7-bdb7-e17344c29a97 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:38.856165 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8971fa0-5317-41a7-bdb7-e17344c29a97 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.857222 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598157b7-a923-4413-89ac-bab6beaeef03 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.859783 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8971fa0-5317-41a7-bdb7-e17344c29a97 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.861282 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598157b7-a923-4413-89ac-bab6beaeef03 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.891809 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-598157b7-a923-4413-89ac-bab6beaeef03 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 10 12:35:38.899035 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 324/662] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:38.900896 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598157b7-a923-4413-89ac-bab6beaeef03 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.903432 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 339/663] 10.222.0.13 () {56 vars in 1156 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:38.909147 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8971fa0-5317-41a7-bdb7-e17344c29a97 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.922691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598157b7-a923-4413-89ac-bab6beaeef03 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.926281 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8971fa0-5317-41a7-bdb7-e17344c29a97 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:38.932944 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af184188-60c6-4091-a893-ced8383eb0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.934578 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af184188-60c6-4091-a893-ced8383eb0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.936006 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af184188-60c6-4091-a893-ced8383eb0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.936291 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af184188-60c6-4091-a893-ced8383eb0b6 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.937290 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af184188-60c6-4091-a893-ced8383eb0b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:38.937632 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fab0ec-31b1-4d9f-beed-bece53619f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:38.938531 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fab0ec-31b1-4d9f-beed-bece53619f22 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:38.939062 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fab0ec-31b1-4d9f-beed-bece53619f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:38.939330 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fab0ec-31b1-4d9f-beed-bece53619f22 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:38.940333 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af184188-60c6-4091-a893-ced8383eb0b6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.944162 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af184188-60c6-4091-a893-ced8383eb0b6 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.964117 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fab0ec-31b1-4d9f-beed-bece53619f22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:38.966166 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fab0ec-31b1-4d9f-beed-bece53619f22 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:38.978910 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 325/664] 10.222.0.13 () {56 vars in 1160 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:38.990423 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af184188-60c6-4091-a893-ced8383eb0b6 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:38.996942 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-56fab0ec-31b1-4d9f-beed-bece53619f22 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:39.000640 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af184188-60c6-4091-a893-ced8383eb0b6 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:39.002618 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 340/665] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:39.004547 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fab0ec-31b1-4d9f-beed-bece53619f22 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:39.013663 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897aab2-224a-49a3-8b31-372e5e24dbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:39.014429 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897aab2-224a-49a3-8b31-372e5e24dbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:39.014777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897aab2-224a-49a3-8b31-372e5e24dbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:39.015112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897aab2-224a-49a3-8b31-372e5e24dbe1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:39.025761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fab0ec-31b1-4d9f-beed-bece53619f22 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:39.031119 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897aab2-224a-49a3-8b31-372e5e24dbe1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:39.033342 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897aab2-224a-49a3-8b31-372e5e24dbe1 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:39.034619 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eebae4-b51b-4c74-b805-051067265ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:39.035374 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eebae4-b51b-4c74-b805-051067265ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:39.035738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eebae4-b51b-4c74-b805-051067265ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:39.040196 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eebae4-b51b-4c74-b805-051067265ee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:39.041151 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eebae4-b51b-4c74-b805-051067265ee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:39.041535 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eebae4-b51b-4c74-b805-051067265ee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:39.043266 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eebae4-b51b-4c74-b805-051067265ee2 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:39.059055 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 326/666] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 12:35:39.061965 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897aab2-224a-49a3-8b31-372e5e24dbe1 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:39.064096 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 341/667] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:39.076786 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897aab2-224a-49a3-8b31-372e5e24dbe1 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:39.077128 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eebae4-b51b-4c74-b805-051067265ee2 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:39.085097 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6acd69-71e5-402b-bb3b-874f32166778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:39.086023 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6acd69-71e5-402b-bb3b-874f32166778 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:39.086397 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6acd69-71e5-402b-bb3b-874f32166778 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:39.086761 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6acd69-71e5-402b-bb3b-874f32166778 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:39.093313 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eebae4-b51b-4c74-b805-051067265ee2 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:39.098715 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6acd69-71e5-402b-bb3b-874f32166778 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:39.100818 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6acd69-71e5-402b-bb3b-874f32166778 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:39.104201 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179a018-2eb8-440c-8d49-741af85b949a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:39.105211 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a018-2eb8-440c-8d49-741af85b949a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:39.105487 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a018-2eb8-440c-8d49-741af85b949a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:39.105761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a018-2eb8-440c-8d49-741af85b949a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:39.113332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179a018-2eb8-440c-8d49-741af85b949a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:39.115303 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179a018-2eb8-440c-8d49-741af85b949a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:39.119913 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-1b6acd69-71e5-402b-bb3b-874f32166778 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:39.125754 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 327/668] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:39.127053 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6acd69-71e5-402b-bb3b-874f32166778 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:39.130531 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-4179a018-2eb8-440c-8d49-741af85b949a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:39.132849 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 342/669] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:39.140296 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179a018-2eb8-440c-8d49-741af85b949a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:39.141804 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6acd69-71e5-402b-bb3b-874f32166778 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:39.146389 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cb872-2f56-4cd0-bf76-830e922f5ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:39.147164 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cb872-2f56-4cd0-bf76-830e922f5ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:39.147557 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cb872-2f56-4cd0-bf76-830e922f5ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:39.147953 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001cb872-2f56-4cd0-bf76-830e922f5ad2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:39.148800 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cb872-2f56-4cd0-bf76-830e922f5ad2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:39.149201 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cb872-2f56-4cd0-bf76-830e922f5ad2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:39.151331 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001cb872-2f56-4cd0-bf76-830e922f5ad2 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:39.151995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179a018-2eb8-440c-8d49-741af85b949a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:39.157347 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9a64e-1ca6-4dd5-922a-2d3752b9c740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:39.158014 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9a64e-1ca6-4dd5-922a-2d3752b9c740 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:39.158293 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9a64e-1ca6-4dd5-922a-2d3752b9c740 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:39.158562 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9a64e-1ca6-4dd5-922a-2d3752b9c740 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:39.159870 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9a64e-1ca6-4dd5-922a-2d3752b9c740 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:39.160187 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9a64e-1ca6-4dd5-922a-2d3752b9c740 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:39.162862 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9a64e-1ca6-4dd5-922a-2d3752b9c740 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:39.171538 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 328/670] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:39.171538 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cb872-2f56-4cd0-bf76-830e922f5ad2 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:39.179535 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 343/671] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:39.181059 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001cb872-2f56-4cd0-bf76-830e922f5ad2 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:39.185452 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9a64e-1ca6-4dd5-922a-2d3752b9c740 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:39.185964 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30d421-b077-4ce1-bb5b-b08592326e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:39.186907 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30d421-b077-4ce1-bb5b-b08592326e6a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:39.187188 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30d421-b077-4ce1-bb5b-b08592326e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:39.187460 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30d421-b077-4ce1-bb5b-b08592326e6a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:39.195677 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30d421-b077-4ce1-bb5b-b08592326e6a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:39.196345 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9a64e-1ca6-4dd5-922a-2d3752b9c740 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:39.197771 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30d421-b077-4ce1-bb5b-b08592326e6a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:39.204235 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac2046-7d10-4b0b-853e-91564f963f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:39.205404 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac2046-7d10-4b0b-853e-91564f963f2d admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:39.205857 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac2046-7d10-4b0b-853e-91564f963f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:39.206330 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac2046-7d10-4b0b-853e-91564f963f2d admin admin] PATH_INFO: `/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/1cd898c7c2974bb38998ebad22fd5a3b/roles/3c723eddb93e4ab6b44d5fe4ed5877a7` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:39.214352 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-3f30d421-b077-4ce1-bb5b-b08592326e6a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:39.219628 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 329/672] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:39.222148 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30d421-b077-4ce1-bb5b-b08592326e6a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:39.224035 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac2046-7d10-4b0b-853e-91564f963f2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0105f8c08c84f538cd7ba86fcd26b62, user_id=1cd898c7c2974bb38998ebad22fd5a3b, role_id=3c723eddb93e4ab6b44d5fe4ed5877a7)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:39.227272 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac2046-7d10-4b0b-853e-91564f963f2d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:39.232255 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30d421-b077-4ce1-bb5b-b08592326e6a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:39.237794 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254494fe-fdb5-4ddf-a5a1-92e652fb0193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:39.237941 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254494fe-fdb5-4ddf-a5a1-92e652fb0193 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:39.238135 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254494fe-fdb5-4ddf-a5a1-92e652fb0193 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:39.238553 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254494fe-fdb5-4ddf-a5a1-92e652fb0193 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:39.239354 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254494fe-fdb5-4ddf-a5a1-92e652fb0193 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:39.239708 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254494fe-fdb5-4ddf-a5a1-92e652fb0193 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:39.241737 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254494fe-fdb5-4ddf-a5a1-92e652fb0193 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:39.247410 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 344/673] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:35:39 2022] PUT /identity/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/1cd898c7c2974bb38998ebad22fd5a3b/roles/3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:35:39.262626 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 330/674] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:39.268720 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac2046-7d10-4b0b-853e-91564f963f2d admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:39.356153 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac2046-7d10-4b0b-853e-91564f963f2d admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:39.361856 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb930af-8d46-4db5-9174-f9c71f2c0110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:39.362539 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb930af-8d46-4db5-9174-f9c71f2c0110 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:39.362823 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb930af-8d46-4db5-9174-f9c71f2c0110 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:39.363089 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb930af-8d46-4db5-9174-f9c71f2c0110 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:39.363970 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb930af-8d46-4db5-9174-f9c71f2c0110 admin admin] RBAC: Adding query filter params (role.id=3c723eddb93e4ab6b44d5fe4ed5877a7, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=fa3a96ff9ab74aeb88465b14de3038eb) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:39.364270 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb930af-8d46-4db5-9174-f9c71f2c0110 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:39.366354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb930af-8d46-4db5-9174-f9c71f2c0110 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:39.379147 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 345/675] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:39 2022] GET /identity/v3/role_assignments?user.id=fa3a96ff9ab74aeb88465b14de3038eb&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 608 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:40.358708 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efd227-b3c5-456f-81f0-a9926238f546 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:40.359252 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efd227-b3c5-456f-81f0-a9926238f546 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:40.359252 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efd227-b3c5-456f-81f0-a9926238f546 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:40.361474 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 331/676] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:40.367226 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99ca5b-8547-43dd-b03c-7f6d5ff3800a None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:40.367779 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99ca5b-8547-43dd-b03c-7f6d5ff3800a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:40.367851 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99ca5b-8547-43dd-b03c-7f6d5ff3800a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:40.392339 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-6e99ca5b-8547-43dd-b03c-7f6d5ff3800a None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:40.393535 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-6e99ca5b-8547-43dd-b03c-7f6d5ff3800a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:40.405940 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 346/677] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:40.442138 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efd227-b3c5-456f-81f0-a9926238f546 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:40.457176 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efd227-b3c5-456f-81f0-a9926238f546 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:40.462008 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79857f73-cf12-4e20-8c5d-5d27f4b80317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:40.463146 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79857f73-cf12-4e20-8c5d-5d27f4b80317 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:40.463531 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79857f73-cf12-4e20-8c5d-5d27f4b80317 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:40.463910 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79857f73-cf12-4e20-8c5d-5d27f4b80317 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:40.476600 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79857f73-cf12-4e20-8c5d-5d27f4b80317 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:40.485483 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-79857f73-cf12-4e20-8c5d-5d27f4b80317 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:35:40.487073 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 332/678] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:35:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:40.492549 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99ca5b-8547-43dd-b03c-7f6d5ff3800a None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:40.503067 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99ca5b-8547-43dd-b03c-7f6d5ff3800a None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:40.512979 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc98b0-7afd-4118-a272-29b0961981e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:40.513681 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc98b0-7afd-4118-a272-29b0961981e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:40.513952 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc98b0-7afd-4118-a272-29b0961981e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:40.514216 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc98b0-7afd-4118-a272-29b0961981e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:40.514984 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc98b0-7afd-4118-a272-29b0961981e0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:40.515284 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc98b0-7afd-4118-a272-29b0961981e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:40.516941 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc98b0-7afd-4118-a272-29b0961981e0 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:40.530634 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 347/679] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:40.535709 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79857f73-cf12-4e20-8c5d-5d27f4b80317 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:40.546847 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79857f73-cf12-4e20-8c5d-5d27f4b80317 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:40.551141 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad979d8-27d3-4ef6-9f6a-5513bb225feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:40.551954 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad979d8-27d3-4ef6-9f6a-5513bb225feb admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:40.552227 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad979d8-27d3-4ef6-9f6a-5513bb225feb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:40.552493 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad979d8-27d3-4ef6-9f6a-5513bb225feb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:40.563272 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad979d8-27d3-4ef6-9f6a-5513bb225feb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:40.565643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad979d8-27d3-4ef6-9f6a-5513bb225feb admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:40.583293 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-bad979d8-27d3-4ef6-9f6a-5513bb225feb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:40.584950 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 333/680] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:40.596949 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc98b0-7afd-4118-a272-29b0961981e0 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:40.607622 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc98b0-7afd-4118-a272-29b0961981e0 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:40.615183 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf791318-0fbb-42c6-8bcd-12658486dfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:40.615809 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf791318-0fbb-42c6-8bcd-12658486dfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:40.616086 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf791318-0fbb-42c6-8bcd-12658486dfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:40.616354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf791318-0fbb-42c6-8bcd-12658486dfa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:40.617092 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf791318-0fbb-42c6-8bcd-12658486dfa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:40.617389 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf791318-0fbb-42c6-8bcd-12658486dfa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:40.619343 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf791318-0fbb-42c6-8bcd-12658486dfa1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:40.638558 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 348/681] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:40.644135 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad979d8-27d3-4ef6-9f6a-5513bb225feb admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:40.655222 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad979d8-27d3-4ef6-9f6a-5513bb225feb admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:40.664205 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1be8a-d07f-4843-972d-fbcd16d8cf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:40.665098 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1be8a-d07f-4843-972d-fbcd16d8cf70 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:40.665371 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1be8a-d07f-4843-972d-fbcd16d8cf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:40.665677 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1be8a-d07f-4843-972d-fbcd16d8cf70 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:40.675215 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1be8a-d07f-4843-972d-fbcd16d8cf70 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:40.677335 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1be8a-d07f-4843-972d-fbcd16d8cf70 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:40.692960 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-e3a1be8a-d07f-4843-972d-fbcd16d8cf70 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 12:35:40.694548 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 334/682] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jan 10 12:35:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:40.699754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf791318-0fbb-42c6-8bcd-12658486dfa1 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:40.709849 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf791318-0fbb-42c6-8bcd-12658486dfa1 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:40.719297 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ca477-3198-4fbf-845d-9f8faa6bd92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:40.720058 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ca477-3198-4fbf-845d-9f8faa6bd92b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:40.720329 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ca477-3198-4fbf-845d-9f8faa6bd92b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:40.720594 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ca477-3198-4fbf-845d-9f8faa6bd92b admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:40.721505 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ca477-3198-4fbf-845d-9f8faa6bd92b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:40.721805 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ca477-3198-4fbf-845d-9f8faa6bd92b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:40.723854 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ca477-3198-4fbf-845d-9f8faa6bd92b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:40.755605 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 349/683] 10.222.0.13 () {56 vars in 1154 bytes} [Mon Jan 10 12:35:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:40.761536 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1be8a-d07f-4843-972d-fbcd16d8cf70 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:40.782009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1be8a-d07f-4843-972d-fbcd16d8cf70 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:40.797724 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbba060-85ff-45e1-b03e-241217d2ac5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:40.798396 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbba060-85ff-45e1-b03e-241217d2ac5c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:40.798675 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbba060-85ff-45e1-b03e-241217d2ac5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:40.798945 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbba060-85ff-45e1-b03e-241217d2ac5c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:40.815920 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbba060-85ff-45e1-b03e-241217d2ac5c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:40.817697 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbba060-85ff-45e1-b03e-241217d2ac5c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:40.833860 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 335/684] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:40.839458 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ca477-3198-4fbf-845d-9f8faa6bd92b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:40.849217 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ca477-3198-4fbf-845d-9f8faa6bd92b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:40.855782 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ded0f5-84d5-463a-b040-fded89c2f3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:40.856582 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ded0f5-84d5-463a-b040-fded89c2f3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:40.856860 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ded0f5-84d5-463a-b040-fded89c2f3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:40.857127 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ded0f5-84d5-463a-b040-fded89c2f3c8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:40.868237 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ded0f5-84d5-463a-b040-fded89c2f3c8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:40.870314 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ded0f5-84d5-463a-b040-fded89c2f3c8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:40.887720 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-18ded0f5-84d5-463a-b040-fded89c2f3c8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:40.889241 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 350/685] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:40.894715 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbba060-85ff-45e1-b03e-241217d2ac5c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:40.904610 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbba060-85ff-45e1-b03e-241217d2ac5c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:40.909004 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393cfad-cc09-4992-9944-dd2013ecb7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:40.909656 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393cfad-cc09-4992-9944-dd2013ecb7ca admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:40.909931 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393cfad-cc09-4992-9944-dd2013ecb7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:40.910198 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393cfad-cc09-4992-9944-dd2013ecb7ca admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:40.910934 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393cfad-cc09-4992-9944-dd2013ecb7ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:40.911236 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393cfad-cc09-4992-9944-dd2013ecb7ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:40.912877 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393cfad-cc09-4992-9944-dd2013ecb7ca admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:40.925693 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 336/686] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:40.932345 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8b735-f4fd-4e43-91d5-2938f761fc5b None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:40.932629 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8b735-f4fd-4e43-91d5-2938f761fc5b None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:40.932904 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8b735-f4fd-4e43-91d5-2938f761fc5b None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:40.934695 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 351/687] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:40.935880 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393cfad-cc09-4992-9944-dd2013ecb7ca admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:40.942018 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491467d-187f-4793-8748-8c9fbe5c663e None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:40.942297 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491467d-187f-4793-8748-8c9fbe5c663e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:40.942566 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491467d-187f-4793-8748-8c9fbe5c663e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:40.950812 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393cfad-cc09-4992-9944-dd2013ecb7ca admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:40.964052 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f2e4f-4475-4328-a48e-73831f60f8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:40.964860 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f2e4f-4475-4328-a48e-73831f60f8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:40.965134 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f2e4f-4475-4328-a48e-73831f60f8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:40.965397 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f2e4f-4475-4328-a48e-73831f60f8f2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:40.974275 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-5491467d-187f-4793-8748-8c9fbe5c663e None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:40.975457 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-5491467d-187f-4793-8748-8c9fbe5c663e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:40.979678 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f2e4f-4475-4328-a48e-73831f60f8f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:40.982961 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f2e4f-4475-4328-a48e-73831f60f8f2 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:40.996152 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 352/688] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Jan 10 12:35:41.003633 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-004f2e4f-4475-4328-a48e-73831f60f8f2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:41.005073 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 337/689] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:41.011055 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491467d-187f-4793-8748-8c9fbe5c663e None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:41.018389 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f2e4f-4475-4328-a48e-73831f60f8f2 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:41.025760 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491467d-187f-4793-8748-8c9fbe5c663e None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:41.033390 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f2e4f-4475-4328-a48e-73831f60f8f2 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:41.035939 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df060ea-d2d3-4cf7-b645-09a732bf0d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:41.036648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df060ea-d2d3-4cf7-b645-09a732bf0d10 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:41.036929 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df060ea-d2d3-4cf7-b645-09a732bf0d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:41.037194 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df060ea-d2d3-4cf7-b645-09a732bf0d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:41.038041 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df060ea-d2d3-4cf7-b645-09a732bf0d10 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:41.038339 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df060ea-d2d3-4cf7-b645-09a732bf0d10 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:41.043066 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df060ea-d2d3-4cf7-b645-09a732bf0d10 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:41.046601 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d4b88-e235-4c05-bcf5-8aa4f693f486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:41.048506 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d4b88-e235-4c05-bcf5-8aa4f693f486 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:41.049378 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d4b88-e235-4c05-bcf5-8aa4f693f486 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:41.049649 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d4b88-e235-4c05-bcf5-8aa4f693f486 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:41.050318 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d4b88-e235-4c05-bcf5-8aa4f693f486 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:41.054566 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-201d4b88-e235-4c05-bcf5-8aa4f693f486 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:35:41.054566 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:35:41.054566 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:35:41.055433 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d4b88-e235-4c05-bcf5-8aa4f693f486 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:41.066454 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 353/690] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:41.070342 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-201d4b88-e235-4c05-bcf5-8aa4f693f486 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 10 12:35:41.072295 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 338/691] 10.222.0.13 () {56 vars in 1150 bytes} [Mon Jan 10 12:35:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:41.072663 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df060ea-d2d3-4cf7-b645-09a732bf0d10 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:41.078855 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d4b88-e235-4c05-bcf5-8aa4f693f486 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:41.087997 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df060ea-d2d3-4cf7-b645-09a732bf0d10 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:41.091237 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d4b88-e235-4c05-bcf5-8aa4f693f486 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:41.099306 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64b1b0-639e-4742-9247-dd30861e52e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:41.100197 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff4b4a-75fb-4deb-8ee7-3341d1984a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:41.100848 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff4b4a-75fb-4deb-8ee7-3341d1984a6d admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:41.101246 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64b1b0-639e-4742-9247-dd30861e52e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:41.101515 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64b1b0-639e-4742-9247-dd30861e52e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:41.101841 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff4b4a-75fb-4deb-8ee7-3341d1984a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:41.102143 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff4b4a-75fb-4deb-8ee7-3341d1984a6d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:41.102985 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff4b4a-75fb-4deb-8ee7-3341d1984a6d admin admin] RBAC: Adding query filter params (role.id=9d097c033f454263a874fbafe92c9aea, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=d68fa8e4f3a341a5b74ee32c85e59869) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:41.104021 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64b1b0-639e-4742-9247-dd30861e52e5 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:41.105539 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff4b4a-75fb-4deb-8ee7-3341d1984a6d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:41.106306 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64b1b0-639e-4742-9247-dd30861e52e5 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:41.108819 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64b1b0-639e-4742-9247-dd30861e52e5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:41.110500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-3a64b1b0-639e-4742-9247-dd30861e52e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:35:41.110500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:35:41.110500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:35:41.110933 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff4b4a-75fb-4deb-8ee7-3341d1984a6d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:41.112284 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64b1b0-639e-4742-9247-dd30861e52e5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:41.124641 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 354/692] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:41 2022] GET /identity/v3/role_assignments?user.id=d68fa8e4f3a341a5b74ee32c85e59869&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=9d097c033f454263a874fbafe92c9aea => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:41.125580 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 339/693] 10.222.0.13 () {56 vars in 1145 bytes} [Mon Jan 10 12:35:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:41.130994 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff4b4a-75fb-4deb-8ee7-3341d1984a6d admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:41.149802 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff4b4a-75fb-4deb-8ee7-3341d1984a6d admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:41.158870 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a936a-1ac7-4bdf-bc7b-81b1b05c711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:41.159597 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a936a-1ac7-4bdf-bc7b-81b1b05c711a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:41.159928 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a936a-1ac7-4bdf-bc7b-81b1b05c711a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:41.160195 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a936a-1ac7-4bdf-bc7b-81b1b05c711a admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:41.160942 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a936a-1ac7-4bdf-bc7b-81b1b05c711a admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:41.161308 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a936a-1ac7-4bdf-bc7b-81b1b05c711a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:41.162464 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING py.warnings [None req-a44a936a-1ac7-4bdf-bc7b-81b1b05c711a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:35:41.162464 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: warnings.warn(msg) Jan 10 12:35:41.162464 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: Jan 10 12:35:41.163422 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a936a-1ac7-4bdf-bc7b-81b1b05c711a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:41.177825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 355/694] 10.222.0.13 () {56 vars in 1145 bytes} [Mon Jan 10 12:35:41 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:42.061332 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4869d71-bf7d-4d8c-9620-c3f750921699 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:42.061833 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4869d71-bf7d-4d8c-9620-c3f750921699 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:42.061833 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4869d71-bf7d-4d8c-9620-c3f750921699 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:42.063838 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 340/695] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:42.069715 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b720b-0d24-45d2-9433-426a6448937c None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:42.070119 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b720b-0d24-45d2-9433-426a6448937c None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:42.070285 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b720b-0d24-45d2-9433-426a6448937c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:42.091435 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-c42b720b-0d24-45d2-9433-426a6448937c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:42.092666 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c42b720b-0d24-45d2-9433-426a6448937c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:42.101575 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 356/696] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:42.129965 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4869d71-bf7d-4d8c-9620-c3f750921699 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:42.149449 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4869d71-bf7d-4d8c-9620-c3f750921699 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:42.161349 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e1f6e-3b6f-4c86-bc28-40ea1e07607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:42.162284 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e1f6e-3b6f-4c86-bc28-40ea1e07607b admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:42.162654 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e1f6e-3b6f-4c86-bc28-40ea1e07607b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:42.163009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e1f6e-3b6f-4c86-bc28-40ea1e07607b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:42.181234 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e1f6e-3b6f-4c86-bc28-40ea1e07607b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:42.183948 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e1f6e-3b6f-4c86-bc28-40ea1e07607b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:42.205431 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-9b1e1f6e-3b6f-4c86-bc28-40ea1e07607b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:42.211439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 341/697] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:42.213206 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b720b-0d24-45d2-9433-426a6448937c None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:42.223200 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b720b-0d24-45d2-9433-426a6448937c None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:42.230940 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a93be4-1a24-433f-b23e-bafe17b63e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:42.231644 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a93be4-1a24-433f-b23e-bafe17b63e08 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:42.231923 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a93be4-1a24-433f-b23e-bafe17b63e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:42.232190 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a93be4-1a24-433f-b23e-bafe17b63e08 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:42.232937 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a93be4-1a24-433f-b23e-bafe17b63e08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:42.233235 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a93be4-1a24-433f-b23e-bafe17b63e08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:42.234846 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a93be4-1a24-433f-b23e-bafe17b63e08 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:42.257836 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 357/698] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:42.263746 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e1f6e-3b6f-4c86-bc28-40ea1e07607b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:42.274312 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e1f6e-3b6f-4c86-bc28-40ea1e07607b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:42.286026 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78fe60-92be-4268-aef0-38652d522d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:42.286728 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78fe60-92be-4268-aef0-38652d522d3e admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:42.287007 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78fe60-92be-4268-aef0-38652d522d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:42.287332 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78fe60-92be-4268-aef0-38652d522d3e admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:42.288113 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78fe60-92be-4268-aef0-38652d522d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:42.290040 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78fe60-92be-4268-aef0-38652d522d3e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:42.330980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 342/699] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Jan 10 12:35:42 2022] POST /identity/v3/users => generated 254 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:35:42.391263 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c1596-f282-401c-803c-8dcf99346f25 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:42.391614 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c1596-f282-401c-803c-8dcf99346f25 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:42.391838 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c1596-f282-401c-803c-8dcf99346f25 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:42.394016 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 358/700] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:42.399743 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e159edb-304e-42c5-9fb0-7c80e5264bd0 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:42.400156 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e159edb-304e-42c5-9fb0-7c80e5264bd0 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:42.400397 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e159edb-304e-42c5-9fb0-7c80e5264bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:42.422227 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-9e159edb-304e-42c5-9fb0-7c80e5264bd0 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:42.423472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9e159edb-304e-42c5-9fb0-7c80e5264bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:42.440859 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 343/701] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:42.490481 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c1596-f282-401c-803c-8dcf99346f25 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:42.509830 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c1596-f282-401c-803c-8dcf99346f25 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:42.519808 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9e5b8-6649-4f74-bb70-8fd55a2c137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:42.520642 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9e5b8-6649-4f74-bb70-8fd55a2c137c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:42.520922 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9e5b8-6649-4f74-bb70-8fd55a2c137c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:42.521190 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9e5b8-6649-4f74-bb70-8fd55a2c137c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:42.540611 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9e5b8-6649-4f74-bb70-8fd55a2c137c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:42.547742 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-21f9e5b8-6649-4f74-bb70-8fd55a2c137c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:35:42.549354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 359/702] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:42.555168 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e159edb-304e-42c5-9fb0-7c80e5264bd0 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:42.565283 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e159edb-304e-42c5-9fb0-7c80e5264bd0 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:42.579159 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fc175-f864-4d71-a6ee-71b35654f349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:42.579934 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fc175-f864-4d71-a6ee-71b35654f349 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:42.580211 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fc175-f864-4d71-a6ee-71b35654f349 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:42.580482 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fc175-f864-4d71-a6ee-71b35654f349 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:42.581410 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fc175-f864-4d71-a6ee-71b35654f349 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:42.581658 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fc175-f864-4d71-a6ee-71b35654f349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:42.583329 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fc175-f864-4d71-a6ee-71b35654f349 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:42.601672 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 344/703] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:35:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:42.607660 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9e5b8-6649-4f74-bb70-8fd55a2c137c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:42.624967 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9e5b8-6649-4f74-bb70-8fd55a2c137c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:42.640418 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503a2c6-8a68-493b-9603-f750bbebb12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:42.640418 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503a2c6-8a68-493b-9603-f750bbebb12f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:42.640418 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503a2c6-8a68-493b-9603-f750bbebb12f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:42.640418 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503a2c6-8a68-493b-9603-f750bbebb12f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:42.654183 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503a2c6-8a68-493b-9603-f750bbebb12f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:42.656469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503a2c6-8a68-493b-9603-f750bbebb12f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:42.677569 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-f503a2c6-8a68-493b-9603-f750bbebb12f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:42.679440 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 360/704] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:42.685530 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fc175-f864-4d71-a6ee-71b35654f349 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:42.701635 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fc175-f864-4d71-a6ee-71b35654f349 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:42.711117 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bab6ef-0953-432d-b9c3-6d7599009f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:42.711834 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bab6ef-0953-432d-b9c3-6d7599009f31 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:42.712114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bab6ef-0953-432d-b9c3-6d7599009f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:42.712386 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bab6ef-0953-432d-b9c3-6d7599009f31 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:42.713178 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bab6ef-0953-432d-b9c3-6d7599009f31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:42.713484 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bab6ef-0953-432d-b9c3-6d7599009f31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:42.715095 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bab6ef-0953-432d-b9c3-6d7599009f31 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:42.736650 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 345/705] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:42.745622 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503a2c6-8a68-493b-9603-f750bbebb12f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:42.755997 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503a2c6-8a68-493b-9603-f750bbebb12f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:42.764162 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5051256-9317-474a-9523-76e2895ea603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:42.765357 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5051256-9317-474a-9523-76e2895ea603 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:42.765833 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5051256-9317-474a-9523-76e2895ea603 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:42.766292 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5051256-9317-474a-9523-76e2895ea603 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:42.776477 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5051256-9317-474a-9523-76e2895ea603 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:42.778968 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5051256-9317-474a-9523-76e2895ea603 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:42.796804 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-a5051256-9317-474a-9523-76e2895ea603 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 10 12:35:42.798678 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 361/706] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:35:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:42.804525 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bab6ef-0953-432d-b9c3-6d7599009f31 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:42.815416 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bab6ef-0953-432d-b9c3-6d7599009f31 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:42.823989 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebbe75-009f-4764-87eb-b41e956ec13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:42.826173 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c380c94-2a31-4d0f-8ed1-0bcfd2cc3412 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:42.826609 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c380c94-2a31-4d0f-8ed1-0bcfd2cc3412 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:42.827020 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c380c94-2a31-4d0f-8ed1-0bcfd2cc3412 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:42.828971 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 362/707] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:35:42.829442 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebbe75-009f-4764-87eb-b41e956ec13b admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:42.829878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebbe75-009f-4764-87eb-b41e956ec13b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:42.830295 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebbe75-009f-4764-87eb-b41e956ec13b admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:42.831315 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebbe75-009f-4764-87eb-b41e956ec13b admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:42.831858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebbe75-009f-4764-87eb-b41e956ec13b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:42.833871 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebbe75-009f-4764-87eb-b41e956ec13b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:42.837030 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd345eb8-5be4-4954-9544-0c20a6433d15 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:42.837419 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd345eb8-5be4-4954-9544-0c20a6433d15 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:42.837914 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd345eb8-5be4-4954-9544-0c20a6433d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:42.856929 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-fd345eb8-5be4-4954-9544-0c20a6433d15 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:42.858254 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-fd345eb8-5be4-4954-9544-0c20a6433d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:42.864828 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 346/708] 10.222.0.13 () {56 vars in 1156 bytes} [Mon Jan 10 12:35:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:42.865919 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebbe75-009f-4764-87eb-b41e956ec13b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:42.867097 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 363/709] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:35:42.880054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebbe75-009f-4764-87eb-b41e956ec13b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:42.884923 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e0e9f-7230-4c7e-b97c-0fc5ae877f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:42.885804 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e0e9f-7230-4c7e-b97c-0fc5ae877f74 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:42.886223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e0e9f-7230-4c7e-b97c-0fc5ae877f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:42.886632 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e0e9f-7230-4c7e-b97c-0fc5ae877f74 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:42.892202 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd345eb8-5be4-4954-9544-0c20a6433d15 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:42.895674 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e0e9f-7230-4c7e-b97c-0fc5ae877f74 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:42.898396 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e0e9f-7230-4c7e-b97c-0fc5ae877f74 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:42.901269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd345eb8-5be4-4954-9544-0c20a6433d15 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:42.906332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e216d36-1d3b-4ea5-8f78-a41d2e26328b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:42.907158 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e216d36-1d3b-4ea5-8f78-a41d2e26328b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:42.907439 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e216d36-1d3b-4ea5-8f78-a41d2e26328b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:42.907792 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e216d36-1d3b-4ea5-8f78-a41d2e26328b admin admin] PATH_INFO: `/v3/services/network` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:42.908467 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e216d36-1d3b-4ea5-8f78-a41d2e26328b admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:42.914879 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING py.warnings [None req-3e216d36-1d3b-4ea5-8f78-a41d2e26328b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:35:42.914879 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: warnings.warn(msg) Jan 10 12:35:42.914879 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: Jan 10 12:35:42.914879 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e216d36-1d3b-4ea5-8f78-a41d2e26328b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:42.915857 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 347/710] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:35:42.916871 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e0e9f-7230-4c7e-b97c-0fc5ae877f74 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:42.926574 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-3e216d36-1d3b-4ea5-8f78-a41d2e26328b admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 10 12:35:42.926982 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e0e9f-7230-4c7e-b97c-0fc5ae877f74 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:42.931563 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 364/711] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:42 2022] GET /identity/v3/services/network => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:42.935426 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e216d36-1d3b-4ea5-8f78-a41d2e26328b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:42.937459 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449d144-0048-44c2-b415-0da0fa80b61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:42.938475 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449d144-0048-44c2-b415-0da0fa80b61c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:42.938894 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449d144-0048-44c2-b415-0da0fa80b61c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:42.939339 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449d144-0048-44c2-b415-0da0fa80b61c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:42.950491 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e216d36-1d3b-4ea5-8f78-a41d2e26328b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:42.962185 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449d144-0048-44c2-b415-0da0fa80b61c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:42.964151 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb51b7-6fa9-4514-b4db-6c3da3ad4ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:42.965705 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb51b7-6fa9-4514-b4db-6c3da3ad4ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:42.966157 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb51b7-6fa9-4514-b4db-6c3da3ad4ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:42.966717 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb51b7-6fa9-4514-b4db-6c3da3ad4ec6 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:42.968508 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449d144-0048-44c2-b415-0da0fa80b61c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:42.969159 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb51b7-6fa9-4514-b4db-6c3da3ad4ec6 admin admin] RBAC: Adding query filter params (name=network) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:42.969609 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb51b7-6fa9-4514-b4db-6c3da3ad4ec6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:42.972574 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb51b7-6fa9-4514-b4db-6c3da3ad4ec6 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:42.983307 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 365/712] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jan 10 12:35:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:42.990179 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb51b7-6fa9-4514-b4db-6c3da3ad4ec6 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:43.002404 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-2449d144-0048-44c2-b415-0da0fa80b61c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:43.002562 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb51b7-6fa9-4514-b4db-6c3da3ad4ec6 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:43.003684 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 348/713] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:43.007671 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916e8ec-689e-4cb6-9445-10b4c4b591b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:43.008799 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916e8ec-689e-4cb6-9445-10b4c4b591b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:43.009241 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916e8ec-689e-4cb6-9445-10b4c4b591b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:43.009533 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449d144-0048-44c2-b415-0da0fa80b61c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:43.009834 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916e8ec-689e-4cb6-9445-10b4c4b591b2 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:43.010884 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916e8ec-689e-4cb6-9445-10b4c4b591b2 admin admin] RBAC: Adding query filter params (type=network) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:43.011327 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916e8ec-689e-4cb6-9445-10b4c4b591b2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:43.013200 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916e8ec-689e-4cb6-9445-10b4c4b591b2 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:43.018821 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 366/714] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jan 10 12:35:42 2022] GET /identity/v3/services?type=network => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:43.029849 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449d144-0048-44c2-b415-0da0fa80b61c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:43.037711 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac136e6-ac3c-464e-aa8f-f9a0078c108f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:43.038400 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac136e6-ac3c-464e-aa8f-f9a0078c108f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:43.038682 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac136e6-ac3c-464e-aa8f-f9a0078c108f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:43.038956 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac136e6-ac3c-464e-aa8f-f9a0078c108f admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:43.039735 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac136e6-ac3c-464e-aa8f-f9a0078c108f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:43.040044 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac136e6-ac3c-464e-aa8f-f9a0078c108f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:43.041711 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac136e6-ac3c-464e-aa8f-f9a0078c108f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:43.067563 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 349/715] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:43.073426 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916e8ec-689e-4cb6-9445-10b4c4b591b2 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:43.091652 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916e8ec-689e-4cb6-9445-10b4c4b591b2 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:43.098374 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadf990-9acb-4fb0-82c0-cccc99f45dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:43.099505 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadf990-9acb-4fb0-82c0-cccc99f45dec admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:43.099966 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadf990-9acb-4fb0-82c0-cccc99f45dec admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:43.100449 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadf990-9acb-4fb0-82c0-cccc99f45dec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:43.112134 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadf990-9acb-4fb0-82c0-cccc99f45dec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:43.114621 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadf990-9acb-4fb0-82c0-cccc99f45dec admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:43.134110 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-8fadf990-9acb-4fb0-82c0-cccc99f45dec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:43.136125 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 367/716] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:43.143561 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac136e6-ac3c-464e-aa8f-f9a0078c108f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:43.162141 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac136e6-ac3c-464e-aa8f-f9a0078c108f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:43.177196 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed960728-3828-4090-a15c-49de7b4f125d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:43.177886 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed960728-3828-4090-a15c-49de7b4f125d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:43.178169 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed960728-3828-4090-a15c-49de7b4f125d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:43.178439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed960728-3828-4090-a15c-49de7b4f125d admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:43.179259 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed960728-3828-4090-a15c-49de7b4f125d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:43.179589 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed960728-3828-4090-a15c-49de7b4f125d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:43.181774 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed960728-3828-4090-a15c-49de7b4f125d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:43.205057 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 350/717] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:43.211315 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadf990-9acb-4fb0-82c0-cccc99f45dec admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:43.222592 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadf990-9acb-4fb0-82c0-cccc99f45dec admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:43.236162 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746af06-4e1d-4e17-a340-06c6aed8d9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:43.237260 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746af06-4e1d-4e17-a340-06c6aed8d9ce admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:43.237737 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746af06-4e1d-4e17-a340-06c6aed8d9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:43.238235 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746af06-4e1d-4e17-a340-06c6aed8d9ce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:43.239416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746af06-4e1d-4e17-a340-06c6aed8d9ce admin admin] RBAC: Adding query filter params (role.id=3c723eddb93e4ab6b44d5fe4ed5877a7, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=1cd898c7c2974bb38998ebad22fd5a3b) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:43.239979 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746af06-4e1d-4e17-a340-06c6aed8d9ce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:43.242143 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746af06-4e1d-4e17-a340-06c6aed8d9ce admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:43.254103 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 368/718] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:43 2022] GET /identity/v3/role_assignments?user.id=1cd898c7c2974bb38998ebad22fd5a3b&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:43.883187 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139c1a9-03ee-40e6-b1e5-bedd5bce28ea None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:43.883611 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139c1a9-03ee-40e6-b1e5-bedd5bce28ea None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:43.883787 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139c1a9-03ee-40e6-b1e5-bedd5bce28ea None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:43.886059 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 351/719] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:43.892505 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8429f9f-a075-4c67-ae57-e2ef36e24a31 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:43.892505 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8429f9f-a075-4c67-ae57-e2ef36e24a31 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:43.892505 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8429f9f-a075-4c67-ae57-e2ef36e24a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:43.913104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-f8429f9f-a075-4c67-ae57-e2ef36e24a31 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:43.914435 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f8429f9f-a075-4c67-ae57-e2ef36e24a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:43.925327 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 369/720] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 10 12:35:43.950593 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139c1a9-03ee-40e6-b1e5-bedd5bce28ea None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:43.968691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139c1a9-03ee-40e6-b1e5-bedd5bce28ea None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:43.972980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b069216-6ade-40dc-b9e6-947d10987c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:43.973783 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b069216-6ade-40dc-b9e6-947d10987c32 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:43.974062 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b069216-6ade-40dc-b9e6-947d10987c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:43.974331 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b069216-6ade-40dc-b9e6-947d10987c32 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:43.986135 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b069216-6ade-40dc-b9e6-947d10987c32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:43.993099 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-9b069216-6ade-40dc-b9e6-947d10987c32 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:35:43.994869 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 352/721] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:35:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:44.002519 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8429f9f-a075-4c67-ae57-e2ef36e24a31 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:44.012424 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8429f9f-a075-4c67-ae57-e2ef36e24a31 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:44.017471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65891a1d-56de-4b25-9d64-ed2f06a6987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:44.018143 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891a1d-56de-4b25-9d64-ed2f06a6987b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:44.018421 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891a1d-56de-4b25-9d64-ed2f06a6987b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:44.018691 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891a1d-56de-4b25-9d64-ed2f06a6987b admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:44.019454 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65891a1d-56de-4b25-9d64-ed2f06a6987b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:44.019807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65891a1d-56de-4b25-9d64-ed2f06a6987b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:44.021430 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65891a1d-56de-4b25-9d64-ed2f06a6987b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:44.033538 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 370/722] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:44.039071 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b069216-6ade-40dc-b9e6-947d10987c32 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:44.049279 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b069216-6ade-40dc-b9e6-947d10987c32 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:44.053727 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636ee23-d29f-411a-9324-b7805c42c2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:44.054524 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636ee23-d29f-411a-9324-b7805c42c2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:44.054802 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636ee23-d29f-411a-9324-b7805c42c2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:44.055074 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6636ee23-d29f-411a-9324-b7805c42c2e3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:44.068294 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636ee23-d29f-411a-9324-b7805c42c2e3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:44.070163 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6636ee23-d29f-411a-9324-b7805c42c2e3 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:44.088900 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-6636ee23-d29f-411a-9324-b7805c42c2e3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:44.090569 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 353/723] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:44.096065 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65891a1d-56de-4b25-9d64-ed2f06a6987b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:44.108963 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65891a1d-56de-4b25-9d64-ed2f06a6987b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:44.124229 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc52c8-9ddb-40a6-801f-6c157851a9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:44.124917 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc52c8-9ddb-40a6-801f-6c157851a9eb admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:44.125194 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc52c8-9ddb-40a6-801f-6c157851a9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:44.125462 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc52c8-9ddb-40a6-801f-6c157851a9eb admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:44.126218 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc52c8-9ddb-40a6-801f-6c157851a9eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:44.126518 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc52c8-9ddb-40a6-801f-6c157851a9eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:44.128159 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc52c8-9ddb-40a6-801f-6c157851a9eb admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:44.146715 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 371/724] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:44.152396 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636ee23-d29f-411a-9324-b7805c42c2e3 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:44.164222 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6636ee23-d29f-411a-9324-b7805c42c2e3 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:44.169235 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1dd49-46f0-4e8c-9e2b-d47feae2c9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:44.170082 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1dd49-46f0-4e8c-9e2b-d47feae2c9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:44.170416 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1dd49-46f0-4e8c-9e2b-d47feae2c9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:44.170687 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1dd49-46f0-4e8c-9e2b-d47feae2c9d4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:44.181618 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1dd49-46f0-4e8c-9e2b-d47feae2c9d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:44.183899 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1dd49-46f0-4e8c-9e2b-d47feae2c9d4 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:44.198869 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-19c1dd49-46f0-4e8c-9e2b-d47feae2c9d4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 12:35:44.200507 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 354/725] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jan 10 12:35:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:44.206147 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc52c8-9ddb-40a6-801f-6c157851a9eb admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:44.222049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc52c8-9ddb-40a6-801f-6c157851a9eb admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:44.231037 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e1c6e-6cf5-4cad-92aa-e5f7761a762b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:44.231750 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e1c6e-6cf5-4cad-92aa-e5f7761a762b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:44.232029 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e1c6e-6cf5-4cad-92aa-e5f7761a762b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:44.232300 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e1c6e-6cf5-4cad-92aa-e5f7761a762b admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:44.233158 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e1c6e-6cf5-4cad-92aa-e5f7761a762b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:44.233460 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e1c6e-6cf5-4cad-92aa-e5f7761a762b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:44.235311 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e1c6e-6cf5-4cad-92aa-e5f7761a762b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:44.259602 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 372/726] 10.222.0.13 () {56 vars in 1154 bytes} [Mon Jan 10 12:35:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:44.265114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1dd49-46f0-4e8c-9e2b-d47feae2c9d4 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:44.278809 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1dd49-46f0-4e8c-9e2b-d47feae2c9d4 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:44.286151 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ba330-3f43-4077-935a-d09bb179b7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:44.287007 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ba330-3f43-4077-935a-d09bb179b7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:44.287288 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ba330-3f43-4077-935a-d09bb179b7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:44.287646 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ba330-3f43-4077-935a-d09bb179b7f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:44.308716 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ba330-3f43-4077-935a-d09bb179b7f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:44.310583 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ba330-3f43-4077-935a-d09bb179b7f0 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:44.334676 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553089b6-02d3-4c8a-a009-0c1cd283b0d2 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:44.334986 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553089b6-02d3-4c8a-a009-0c1cd283b0d2 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:44.335226 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553089b6-02d3-4c8a-a009-0c1cd283b0d2 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:44.336140 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-ae1ba330-3f43-4077-935a-d09bb179b7f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:44.337574 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 373/727] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:35:44.337684 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 355/728] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:44.344390 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553089b6-02d3-4c8a-a009-0c1cd283b0d2 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:44.347438 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec18f41-9828-4d28-9fbb-160355e73b09 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:44.347759 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec18f41-9828-4d28-9fbb-160355e73b09 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:44.348033 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec18f41-9828-4d28-9fbb-160355e73b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:44.367389 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-aec18f41-9828-4d28-9fbb-160355e73b09 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:44.368732 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-aec18f41-9828-4d28-9fbb-160355e73b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:44.369211 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553089b6-02d3-4c8a-a009-0c1cd283b0d2 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:44.377133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 356/729] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 10 12:35:44.379959 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e910a2a-90a2-460f-a85f-df49984d4102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:44.380622 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e910a2a-90a2-460f-a85f-df49984d4102 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:44.380903 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e910a2a-90a2-460f-a85f-df49984d4102 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:44.381172 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e910a2a-90a2-460f-a85f-df49984d4102 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:44.381909 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e910a2a-90a2-460f-a85f-df49984d4102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:44.382211 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e910a2a-90a2-460f-a85f-df49984d4102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:44.383853 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e910a2a-90a2-460f-a85f-df49984d4102 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:44.403375 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec18f41-9828-4d28-9fbb-160355e73b09 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:44.404644 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 374/730] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:44.410219 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e910a2a-90a2-460f-a85f-df49984d4102 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:44.415721 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec18f41-9828-4d28-9fbb-160355e73b09 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:44.420399 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25290dee-e377-4df5-b2ba-bbc4a7baf2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:44.421110 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25290dee-e377-4df5-b2ba-bbc4a7baf2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:44.421392 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25290dee-e377-4df5-b2ba-bbc4a7baf2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:44.421724 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25290dee-e377-4df5-b2ba-bbc4a7baf2c6 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:44.422459 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25290dee-e377-4df5-b2ba-bbc4a7baf2c6 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:44.423663 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-25290dee-e377-4df5-b2ba-bbc4a7baf2c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:35:44.423663 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:35:44.423663 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:35:44.424653 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25290dee-e377-4df5-b2ba-bbc4a7baf2c6 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:44.424978 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e910a2a-90a2-460f-a85f-df49984d4102 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:44.445230 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 357/731] 10.222.0.13 () {60 vars in 1162 bytes} [Mon Jan 10 12:35:44 2022] POST /identity/v3/services => generated 251 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:35:44.448257 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c07bbb-cd60-42be-834e-94defd5bbbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:44.449076 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c07bbb-cd60-42be-834e-94defd5bbbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:44.449350 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c07bbb-cd60-42be-834e-94defd5bbbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:44.449614 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c07bbb-cd60-42be-834e-94defd5bbbc6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:44.472978 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c07bbb-cd60-42be-834e-94defd5bbbc6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:44.475030 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c07bbb-cd60-42be-834e-94defd5bbbc6 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:44.500714 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-e2c07bbb-cd60-42be-834e-94defd5bbbc6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:44.502115 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 375/732] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:44.508113 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25290dee-e377-4df5-b2ba-bbc4a7baf2c6 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:44.556370 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25290dee-e377-4df5-b2ba-bbc4a7baf2c6 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:44.563417 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453449ab-ee86-4c40-888b-5c9251a8e1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:44.564254 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453449ab-ee86-4c40-888b-5c9251a8e1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:44.564539 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453449ab-ee86-4c40-888b-5c9251a8e1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:44.564811 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453449ab-ee86-4c40-888b-5c9251a8e1b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:44.566003 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453449ab-ee86-4c40-888b-5c9251a8e1b8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:44.566366 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453449ab-ee86-4c40-888b-5c9251a8e1b8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:44.568489 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453449ab-ee86-4c40-888b-5c9251a8e1b8 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:44.589481 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 358/733] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:44.595486 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c07bbb-cd60-42be-834e-94defd5bbbc6 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:44.618359 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c07bbb-cd60-42be-834e-94defd5bbbc6 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:44.633365 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c71977-8b2f-4be3-9e67-f72a8a33bb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:44.634316 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c71977-8b2f-4be3-9e67-f72a8a33bb7e admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:44.634599 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c71977-8b2f-4be3-9e67-f72a8a33bb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:44.634872 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c71977-8b2f-4be3-9e67-f72a8a33bb7e admin admin] PATH_INFO: `/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/d68fa8e4f3a341a5b74ee32c85e59869/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:44.641200 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c71977-8b2f-4be3-9e67-f72a8a33bb7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0105f8c08c84f538cd7ba86fcd26b62, user_id=d68fa8e4f3a341a5b74ee32c85e59869, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:44.644009 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c71977-8b2f-4be3-9e67-f72a8a33bb7e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:44.674952 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 376/734] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:35:44 2022] PUT /identity/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/d68fa8e4f3a341a5b74ee32c85e59869/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:35:45.370707 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf131b-b9c7-4389-82d2-3c00cc63e796 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:45.371262 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf131b-b9c7-4389-82d2-3c00cc63e796 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:45.371262 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf131b-b9c7-4389-82d2-3c00cc63e796 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:45.373319 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 359/735] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:45.378701 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4363cc9-32fd-4bee-820a-8314a453611e None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:45.379121 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4363cc9-32fd-4bee-820a-8314a453611e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:45.379293 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4363cc9-32fd-4bee-820a-8314a453611e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:45.404496 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-f4363cc9-32fd-4bee-820a-8314a453611e None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:45.405699 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f4363cc9-32fd-4bee-820a-8314a453611e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:45.480153 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 377/736] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:45 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:35:45.519813 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf131b-b9c7-4389-82d2-3c00cc63e796 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:45.541450 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf131b-b9c7-4389-82d2-3c00cc63e796 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:45.548949 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30614174-82f7-425b-8bd6-4dd6e8c3e7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:45.549979 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30614174-82f7-425b-8bd6-4dd6e8c3e7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:45.550455 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30614174-82f7-425b-8bd6-4dd6e8c3e7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:45.550939 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30614174-82f7-425b-8bd6-4dd6e8c3e7c9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:45.562151 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30614174-82f7-425b-8bd6-4dd6e8c3e7c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:45.573630 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-30614174-82f7-425b-8bd6-4dd6e8c3e7c9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:35:45.576174 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 360/737] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:45.580995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4363cc9-32fd-4bee-820a-8314a453611e None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:45.590273 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4363cc9-32fd-4bee-820a-8314a453611e None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:45.599768 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f61bd-a413-4421-9054-cf866dc7ce71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:45.600451 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f61bd-a413-4421-9054-cf866dc7ce71 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:45.600734 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f61bd-a413-4421-9054-cf866dc7ce71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:45.601050 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f61bd-a413-4421-9054-cf866dc7ce71 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:45.601832 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f61bd-a413-4421-9054-cf866dc7ce71 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:45.602134 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f61bd-a413-4421-9054-cf866dc7ce71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:45.604039 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f61bd-a413-4421-9054-cf866dc7ce71 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:45.619714 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 378/738] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:35:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:45.625021 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30614174-82f7-425b-8bd6-4dd6e8c3e7c9 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:45.641293 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30614174-82f7-425b-8bd6-4dd6e8c3e7c9 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:45.649002 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206854cd-acf7-4c7c-96f7-ce28ca41e2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:45.650408 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206854cd-acf7-4c7c-96f7-ce28ca41e2bc admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:45.650976 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206854cd-acf7-4c7c-96f7-ce28ca41e2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:45.651440 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206854cd-acf7-4c7c-96f7-ce28ca41e2bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:45.664247 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206854cd-acf7-4c7c-96f7-ce28ca41e2bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:45.666659 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206854cd-acf7-4c7c-96f7-ce28ca41e2bc admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:45.685314 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-206854cd-acf7-4c7c-96f7-ce28ca41e2bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:45.687242 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 361/739] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:45.692843 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f61bd-a413-4421-9054-cf866dc7ce71 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:45.704709 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f61bd-a413-4421-9054-cf866dc7ce71 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:45.717853 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087d8f8-481f-4800-9652-99205c1a5b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:45.718531 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087d8f8-481f-4800-9652-99205c1a5b5b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:45.718810 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087d8f8-481f-4800-9652-99205c1a5b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:45.719081 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087d8f8-481f-4800-9652-99205c1a5b5b admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:45.719913 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087d8f8-481f-4800-9652-99205c1a5b5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:45.720217 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087d8f8-481f-4800-9652-99205c1a5b5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:45.721883 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087d8f8-481f-4800-9652-99205c1a5b5b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:45.743368 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 379/740] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:45.749097 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206854cd-acf7-4c7c-96f7-ce28ca41e2bc admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:45.765820 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206854cd-acf7-4c7c-96f7-ce28ca41e2bc admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:45.776109 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a61f3b-f5af-4a62-8dd5-0998483a4b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:45.776934 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a61f3b-f5af-4a62-8dd5-0998483a4b04 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:45.777213 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a61f3b-f5af-4a62-8dd5-0998483a4b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:45.777480 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a61f3b-f5af-4a62-8dd5-0998483a4b04 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:45.796635 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a61f3b-f5af-4a62-8dd5-0998483a4b04 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:45.798674 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a61f3b-f5af-4a62-8dd5-0998483a4b04 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:45.823634 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-d5a61f3b-f5af-4a62-8dd5-0998483a4b04 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 10 12:35:45.824859 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 362/741] 10.222.0.13 () {56 vars in 1138 bytes} [Mon Jan 10 12:35:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:45.830468 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087d8f8-481f-4800-9652-99205c1a5b5b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:45.845282 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087d8f8-481f-4800-9652-99205c1a5b5b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:45.852483 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5ae20-1cf8-48b9-8f13-b99f7490a683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:45.853348 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5ae20-1cf8-48b9-8f13-b99f7490a683 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:45.853627 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5ae20-1cf8-48b9-8f13-b99f7490a683 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:45.853894 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5ae20-1cf8-48b9-8f13-b99f7490a683 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:45.854812 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5ae20-1cf8-48b9-8f13-b99f7490a683 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:45.855119 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5ae20-1cf8-48b9-8f13-b99f7490a683 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:45.857042 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5ae20-1cf8-48b9-8f13-b99f7490a683 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:45.885386 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 380/742] 10.222.0.13 () {56 vars in 1170 bytes} [Mon Jan 10 12:35:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:45.890428 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a61f3b-f5af-4a62-8dd5-0998483a4b04 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:45.908585 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a61f3b-f5af-4a62-8dd5-0998483a4b04 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:45.920244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeb519-0ee5-48ab-b1f2-6f67e733ac2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:45.920918 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeb519-0ee5-48ab-b1f2-6f67e733ac2c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:45.921196 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeb519-0ee5-48ab-b1f2-6f67e733ac2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:45.921466 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeb519-0ee5-48ab-b1f2-6f67e733ac2c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:45.939306 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eeb519-0ee5-48ab-b1f2-6f67e733ac2c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:45.941475 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eeb519-0ee5-48ab-b1f2-6f67e733ac2c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:45.953357 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 363/743] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:45 2022] GET /identity/v3/auth/tokens => generated 1018 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:35:45.958840 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5ae20-1cf8-48b9-8f13-b99f7490a683 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:45.969008 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5ae20-1cf8-48b9-8f13-b99f7490a683 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:45.980944 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793de006-6f7e-45f5-a854-bf15fbbd2e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:45.981820 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793de006-6f7e-45f5-a854-bf15fbbd2e78 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:45.982094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793de006-6f7e-45f5-a854-bf15fbbd2e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:45.982376 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793de006-6f7e-45f5-a854-bf15fbbd2e78 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:45.998099 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793de006-6f7e-45f5-a854-bf15fbbd2e78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:46.000079 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793de006-6f7e-45f5-a854-bf15fbbd2e78 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:46.018084 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-793de006-6f7e-45f5-a854-bf15fbbd2e78 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:46.023870 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 381/744] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:46.025595 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeb519-0ee5-48ab-b1f2-6f67e733ac2c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:46.046050 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeb519-0ee5-48ab-b1f2-6f67e733ac2c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:46.061509 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0da9fb-76da-4fb7-8aa8-316f090636b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:46.062184 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0da9fb-76da-4fb7-8aa8-316f090636b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:46.062462 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0da9fb-76da-4fb7-8aa8-316f090636b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:46.062734 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0da9fb-76da-4fb7-8aa8-316f090636b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:46.063477 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0da9fb-76da-4fb7-8aa8-316f090636b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:46.063803 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0da9fb-76da-4fb7-8aa8-316f090636b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:46.065764 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0da9fb-76da-4fb7-8aa8-316f090636b2 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:46.088563 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 364/745] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:46.094092 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793de006-6f7e-45f5-a854-bf15fbbd2e78 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:46.104478 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793de006-6f7e-45f5-a854-bf15fbbd2e78 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:46.115902 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b680a-29d6-48fe-8ebc-aa55388f79ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:46.116715 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b680a-29d6-48fe-8ebc-aa55388f79ee admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:46.116994 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b680a-29d6-48fe-8ebc-aa55388f79ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:46.117267 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b680a-29d6-48fe-8ebc-aa55388f79ee admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:46.131884 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b680a-29d6-48fe-8ebc-aa55388f79ee admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:46.133918 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b680a-29d6-48fe-8ebc-aa55388f79ee admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:46.147854 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-1a8b680a-29d6-48fe-8ebc-aa55388f79ee admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:46.149380 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 382/746] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:46.155766 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0da9fb-76da-4fb7-8aa8-316f090636b2 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:46.173151 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0da9fb-76da-4fb7-8aa8-316f090636b2 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:46.189091 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70dfce7-d8f5-4370-9a2b-6c7244ab925f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:46.189781 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dfce7-d8f5-4370-9a2b-6c7244ab925f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:46.190420 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dfce7-d8f5-4370-9a2b-6c7244ab925f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:46.190687 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70dfce7-d8f5-4370-9a2b-6c7244ab925f admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:46.191533 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dfce7-d8f5-4370-9a2b-6c7244ab925f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:46.191834 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dfce7-d8f5-4370-9a2b-6c7244ab925f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:46.193743 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70dfce7-d8f5-4370-9a2b-6c7244ab925f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:46.207799 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8ed11-8d55-47f2-8d38-939fa581a1c7 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:46.208135 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8ed11-8d55-47f2-8d38-939fa581a1c7 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:46.208347 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8ed11-8d55-47f2-8d38-939fa581a1c7 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:46.210447 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 383/747] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:46.215122 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 365/748] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:46.220958 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8ed11-8d55-47f2-8d38-939fa581a1c7 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:46.238051 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0cfef-07d3-401d-864a-5d027c38ac6d None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:46.238371 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0cfef-07d3-401d-864a-5d027c38ac6d None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:46.238643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0cfef-07d3-401d-864a-5d027c38ac6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:46.247027 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8ed11-8d55-47f2-8d38-939fa581a1c7 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:46.257786 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6370c-9faf-4fb0-ad33-a8b02d67250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:46.266129 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6370c-9faf-4fb0-ad33-a8b02d67250f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:46.266129 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6370c-9faf-4fb0-ad33-a8b02d67250f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:46.266129 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6370c-9faf-4fb0-ad33-a8b02d67250f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:46.266129 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6370c-9faf-4fb0-ad33-a8b02d67250f admin admin] RBAC: Adding query filter params (role.id=3c723eddb93e4ab6b44d5fe4ed5877a7, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=44e5602fd019411aa8f0e091ed533ae8) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:46.266129 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6370c-9faf-4fb0-ad33-a8b02d67250f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:46.267056 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6370c-9faf-4fb0-ad33-a8b02d67250f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:46.272506 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 384/749] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:46 2022] GET /identity/v3/role_assignments?user.id=44e5602fd019411aa8f0e091ed533ae8&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:46.279430 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-daf0cfef-07d3-401d-864a-5d027c38ac6d None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:46.280694 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-daf0cfef-07d3-401d-864a-5d027c38ac6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:46.299682 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 366/750] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:46 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:35:46.339830 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6370c-9faf-4fb0-ad33-a8b02d67250f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:46.350806 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6370c-9faf-4fb0-ad33-a8b02d67250f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:46.363016 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79732b85-e6b8-4686-9322-2db82e7cd680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:46.364226 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79732b85-e6b8-4686-9322-2db82e7cd680 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:46.364704 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79732b85-e6b8-4686-9322-2db82e7cd680 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:46.365242 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79732b85-e6b8-4686-9322-2db82e7cd680 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:46.366217 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79732b85-e6b8-4686-9322-2db82e7cd680 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:46.367504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING py.warnings [None req-79732b85-e6b8-4686-9322-2db82e7cd680 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:35:46.367504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: warnings.warn(msg) Jan 10 12:35:46.367504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: Jan 10 12:35:46.368969 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79732b85-e6b8-4686-9322-2db82e7cd680 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:46.393573 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 385/751] 10.222.0.13 () {60 vars in 1162 bytes} [Mon Jan 10 12:35:46 2022] POST /identity/v3/services => generated 240 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:35:46.728640 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55598a49-783a-482e-8902-74b67919ee58 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:46.729193 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55598a49-783a-482e-8902-74b67919ee58 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:46.729487 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55598a49-783a-482e-8902-74b67919ee58 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:46.731436 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 367/752] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:46.737255 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf39c7-a0cd-416c-8c6a-f46ddf615e8c None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:46.737547 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf39c7-a0cd-416c-8c6a-f46ddf615e8c None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:46.737821 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf39c7-a0cd-416c-8c6a-f46ddf615e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:46.765276 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-11cf39c7-a0cd-416c-8c6a-f46ddf615e8c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:46.766545 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-11cf39c7-a0cd-416c-8c6a-f46ddf615e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:46.792602 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 386/753] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:46 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:35:46.818334 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55598a49-783a-482e-8902-74b67919ee58 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:46.831207 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55598a49-783a-482e-8902-74b67919ee58 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:46.835656 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b3533-b668-4693-8670-2eacf03b6cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:46.836502 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b3533-b668-4693-8670-2eacf03b6cbc admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:46.836787 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b3533-b668-4693-8670-2eacf03b6cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:46.837059 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b3533-b668-4693-8670-2eacf03b6cbc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:46.848841 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b3533-b668-4693-8670-2eacf03b6cbc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:46.855726 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-7e3b3533-b668-4693-8670-2eacf03b6cbc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:35:46.857285 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 368/754] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:35:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:46.863155 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf39c7-a0cd-416c-8c6a-f46ddf615e8c None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:46.872498 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf39c7-a0cd-416c-8c6a-f46ddf615e8c None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:46.877173 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616cb7a-c0a3-4e13-bddb-12352d73d7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:46.877852 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616cb7a-c0a3-4e13-bddb-12352d73d7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:46.878130 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616cb7a-c0a3-4e13-bddb-12352d73d7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:46.878402 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616cb7a-c0a3-4e13-bddb-12352d73d7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:46.879242 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616cb7a-c0a3-4e13-bddb-12352d73d7f7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:46.879567 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616cb7a-c0a3-4e13-bddb-12352d73d7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:46.881238 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616cb7a-c0a3-4e13-bddb-12352d73d7f7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:46.891779 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 387/755] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:46.897334 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b3533-b668-4693-8670-2eacf03b6cbc admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:46.908921 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b3533-b668-4693-8670-2eacf03b6cbc admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:46.916719 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae4440-61af-4104-93e9-d7e2f25b22a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:46.917911 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae4440-61af-4104-93e9-d7e2f25b22a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:46.918448 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae4440-61af-4104-93e9-d7e2f25b22a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:46.918897 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae4440-61af-4104-93e9-d7e2f25b22a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:46.938707 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae4440-61af-4104-93e9-d7e2f25b22a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:46.941473 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae4440-61af-4104-93e9-d7e2f25b22a9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:46.962266 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-aaae4440-61af-4104-93e9-d7e2f25b22a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:46.964216 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 369/756] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:46.970230 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616cb7a-c0a3-4e13-bddb-12352d73d7f7 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:46.980628 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616cb7a-c0a3-4e13-bddb-12352d73d7f7 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:46.987612 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379da842-cfd8-40bb-a745-460fa981ec47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:46.988556 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379da842-cfd8-40bb-a745-460fa981ec47 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:46.989036 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379da842-cfd8-40bb-a745-460fa981ec47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:46.989517 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379da842-cfd8-40bb-a745-460fa981ec47 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:46.990483 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379da842-cfd8-40bb-a745-460fa981ec47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:46.990963 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379da842-cfd8-40bb-a745-460fa981ec47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:46.992884 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379da842-cfd8-40bb-a745-460fa981ec47 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:47.009974 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 388/757] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:47.015772 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae4440-61af-4104-93e9-d7e2f25b22a9 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:47.026356 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae4440-61af-4104-93e9-d7e2f25b22a9 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:47.033224 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c283bc8-0cb6-43d8-ad41-b3eaf4077829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:47.034329 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c283bc8-0cb6-43d8-ad41-b3eaf4077829 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.034822 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c283bc8-0cb6-43d8-ad41-b3eaf4077829 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.035306 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c283bc8-0cb6-43d8-ad41-b3eaf4077829 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.044609 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c283bc8-0cb6-43d8-ad41-b3eaf4077829 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:47.046996 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c283bc8-0cb6-43d8-ad41-b3eaf4077829 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:47.071541 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-4c283bc8-0cb6-43d8-ad41-b3eaf4077829 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 10 12:35:47.073243 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 370/758] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:35:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:47.079052 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379da842-cfd8-40bb-a745-460fa981ec47 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:47.093440 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379da842-cfd8-40bb-a745-460fa981ec47 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:47.107114 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c1505-b3fe-418b-b689-c9ce0ec23111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:47.107917 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c1505-b3fe-418b-b689-c9ce0ec23111 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.108211 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c1505-b3fe-418b-b689-c9ce0ec23111 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.108484 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c1505-b3fe-418b-b689-c9ce0ec23111 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.109371 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c1505-b3fe-418b-b689-c9ce0ec23111 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:47.109675 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c1505-b3fe-418b-b689-c9ce0ec23111 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:47.111825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c1505-b3fe-418b-b689-c9ce0ec23111 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:47.146947 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 389/759] 10.222.0.13 () {56 vars in 1156 bytes} [Mon Jan 10 12:35:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:47.152691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c283bc8-0cb6-43d8-ad41-b3eaf4077829 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:47.162991 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c283bc8-0cb6-43d8-ad41-b3eaf4077829 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:47.168026 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da0da9-5bbd-47b5-880b-2080f1dda28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:47.168991 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da0da9-5bbd-47b5-880b-2080f1dda28d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.169491 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da0da9-5bbd-47b5-880b-2080f1dda28d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.170049 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da0da9-5bbd-47b5-880b-2080f1dda28d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.178982 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da0da9-5bbd-47b5-880b-2080f1dda28d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:47.181075 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da0da9-5bbd-47b5-880b-2080f1dda28d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:47.191212 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 371/760] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:47 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:35:47.196545 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c1505-b3fe-418b-b689-c9ce0ec23111 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:47.206902 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c1505-b3fe-418b-b689-c9ce0ec23111 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:47.211811 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934e613-74f4-4afb-9d9f-4f2e6d3fd029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:47.212941 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934e613-74f4-4afb-9d9f-4f2e6d3fd029 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.213467 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934e613-74f4-4afb-9d9f-4f2e6d3fd029 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.213945 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934e613-74f4-4afb-9d9f-4f2e6d3fd029 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.225087 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934e613-74f4-4afb-9d9f-4f2e6d3fd029 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:47.227224 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934e613-74f4-4afb-9d9f-4f2e6d3fd029 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:47.244993 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-6934e613-74f4-4afb-9d9f-4f2e6d3fd029 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:47.246897 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 390/761] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:47.256615 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da0da9-5bbd-47b5-880b-2080f1dda28d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:47.266415 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da0da9-5bbd-47b5-880b-2080f1dda28d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:47.275498 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b4c59-13d3-4f56-a2d6-9595fc650e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:47.276697 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b4c59-13d3-4f56-a2d6-9595fc650e9d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.277191 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b4c59-13d3-4f56-a2d6-9595fc650e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.277673 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b4c59-13d3-4f56-a2d6-9595fc650e9d admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.278620 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b4c59-13d3-4f56-a2d6-9595fc650e9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:47.279121 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b4c59-13d3-4f56-a2d6-9595fc650e9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:47.280998 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b4c59-13d3-4f56-a2d6-9595fc650e9d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:47.294738 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 372/762] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:47.299995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934e613-74f4-4afb-9d9f-4f2e6d3fd029 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:47.313159 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934e613-74f4-4afb-9d9f-4f2e6d3fd029 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:47.318873 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0e95e-8e8d-4634-8c9e-3f8e0daf1d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:47.319984 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0e95e-8e8d-4634-8c9e-3f8e0daf1d86 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.320476 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0e95e-8e8d-4634-8c9e-3f8e0daf1d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.321002 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0e95e-8e8d-4634-8c9e-3f8e0daf1d86 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.333409 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0e95e-8e8d-4634-8c9e-3f8e0daf1d86 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:47.335762 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0e95e-8e8d-4634-8c9e-3f8e0daf1d86 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:47.355886 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-87c0e95e-8e8d-4634-8c9e-3f8e0daf1d86 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:47.357516 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 391/763] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:47.365156 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b4c59-13d3-4f56-a2d6-9595fc650e9d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:47.375624 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b4c59-13d3-4f56-a2d6-9595fc650e9d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:47.386044 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7beb4-5a2f-4916-b3b0-d05a9a541307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:47.386965 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7beb4-5a2f-4916-b3b0-d05a9a541307 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.387457 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7beb4-5a2f-4916-b3b0-d05a9a541307 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.388039 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7beb4-5a2f-4916-b3b0-d05a9a541307 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.389056 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7beb4-5a2f-4916-b3b0-d05a9a541307 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:47.389587 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7beb4-5a2f-4916-b3b0-d05a9a541307 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:47.391666 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7beb4-5a2f-4916-b3b0-d05a9a541307 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:47.404532 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 373/764] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:47.410111 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0e95e-8e8d-4634-8c9e-3f8e0daf1d86 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:47.424911 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0e95e-8e8d-4634-8c9e-3f8e0daf1d86 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:47.433109 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc521c1-f341-4753-929d-55d37121d90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:47.434059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc521c1-f341-4753-929d-55d37121d90d admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.434565 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc521c1-f341-4753-929d-55d37121d90d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.435050 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc521c1-f341-4753-929d-55d37121d90d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.436129 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc521c1-f341-4753-929d-55d37121d90d admin admin] RBAC: Adding query filter params (role.id=9d097c033f454263a874fbafe92c9aea, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=1cd898c7c2974bb38998ebad22fd5a3b) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:47.436636 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc521c1-f341-4753-929d-55d37121d90d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:47.438682 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc521c1-f341-4753-929d-55d37121d90d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:47.447761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 392/765] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:47 2022] GET /identity/v3/role_assignments?user.id=1cd898c7c2974bb38998ebad22fd5a3b&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=9d097c033f454263a874fbafe92c9aea => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:47.553717 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e1be9-118c-4e18-ab7d-e19f07dc9956 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.554346 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e1be9-118c-4e18-ab7d-e19f07dc9956 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.554816 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e1be9-118c-4e18-ab7d-e19f07dc9956 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.557645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 374/766] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:47.563855 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e804e-7c9e-4e9e-af99-3e01ced735f3 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.564522 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e804e-7c9e-4e9e-af99-3e01ced735f3 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.565368 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e804e-7c9e-4e9e-af99-3e01ced735f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.576447 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6442f55-de77-432c-866c-1cc2d6afa5cc None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.576783 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6442f55-de77-432c-866c-1cc2d6afa5cc None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.577002 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6442f55-de77-432c-866c-1cc2d6afa5cc None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.578986 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 375/767] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:35:47.589387 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc89743-1d6c-467e-bf99-f1a69bbc68ba None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.590157 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc89743-1d6c-467e-bf99-f1a69bbc68ba None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.590648 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc89743-1d6c-467e-bf99-f1a69bbc68ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.590897 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-fb5e804e-7c9e-4e9e-af99-3e01ced735f3 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:47.592158 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-fb5e804e-7c9e-4e9e-af99-3e01ced735f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:47.609602 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 393/768] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:47 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:35:47.615136 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-4bc89743-1d6c-467e-bf99-f1a69bbc68ba None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:47.616358 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-4bc89743-1d6c-467e-bf99-f1a69bbc68ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:47.624891 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 376/769] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:47 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:35:47.648643 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e804e-7c9e-4e9e-af99-3e01ced735f3 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:47.658381 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e804e-7c9e-4e9e-af99-3e01ced735f3 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:47.661775 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc89743-1d6c-467e-bf99-f1a69bbc68ba None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:47.672368 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d85c1-2461-4eed-a12c-41a264094b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:47.673286 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d85c1-2461-4eed-a12c-41a264094b85 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.673561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d85c1-2461-4eed-a12c-41a264094b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.673874 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d85c1-2461-4eed-a12c-41a264094b85 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.674565 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d85c1-2461-4eed-a12c-41a264094b85 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:47.676928 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d85c1-2461-4eed-a12c-41a264094b85 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:47.677491 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc89743-1d6c-467e-bf99-f1a69bbc68ba None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:47.683650 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575517a-c107-4c97-91c4-6b7fe63b9048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:47.684521 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575517a-c107-4c97-91c4-6b7fe63b9048 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.684793 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575517a-c107-4c97-91c4-6b7fe63b9048 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.685057 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575517a-c107-4c97-91c4-6b7fe63b9048 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.692051 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-558d85c1-2461-4eed-a12c-41a264094b85 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 10 12:35:47.697485 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 394/770] 10.222.0.13 () {56 vars in 1150 bytes} [Mon Jan 10 12:35:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:47.704448 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d85c1-2461-4eed-a12c-41a264094b85 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:47.705097 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2575517a-c107-4c97-91c4-6b7fe63b9048 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:47.719537 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-2575517a-c107-4c97-91c4-6b7fe63b9048 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:35:47.720815 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 377/771] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:35:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:47.723095 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d85c1-2461-4eed-a12c-41a264094b85 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:47.734700 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c918aa-0d9c-4020-bfb4-8cff4c744ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:47.735150 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c918aa-0d9c-4020-bfb4-8cff4c744ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.735479 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c918aa-0d9c-4020-bfb4-8cff4c744ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.735798 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c918aa-0d9c-4020-bfb4-8cff4c744ea0 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.736583 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c918aa-0d9c-4020-bfb4-8cff4c744ea0 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:47.736889 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c918aa-0d9c-4020-bfb4-8cff4c744ea0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:47.736991 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575517a-c107-4c97-91c4-6b7fe63b9048 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:47.738598 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c918aa-0d9c-4020-bfb4-8cff4c744ea0 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:47.745616 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 395/772] 10.222.0.13 () {56 vars in 1145 bytes} [Mon Jan 10 12:35:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:47.750780 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575517a-c107-4c97-91c4-6b7fe63b9048 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:47.752137 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c918aa-0d9c-4020-bfb4-8cff4c744ea0 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:47.755392 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd8435-f923-41e0-9dc3-3f02e491a61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:47.756198 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd8435-f923-41e0-9dc3-3f02e491a61a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.756541 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd8435-f923-41e0-9dc3-3f02e491a61a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.756878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd8435-f923-41e0-9dc3-3f02e491a61a admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.757713 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd8435-f923-41e0-9dc3-3f02e491a61a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:47.758081 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd8435-f923-41e0-9dc3-3f02e491a61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:47.760212 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd8435-f923-41e0-9dc3-3f02e491a61a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:47.764802 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c918aa-0d9c-4020-bfb4-8cff4c744ea0 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:47.771010 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64158ef8-e912-41d4-a929-80344f9eb733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:47.772031 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64158ef8-e912-41d4-a929-80344f9eb733 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.772570 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64158ef8-e912-41d4-a929-80344f9eb733 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.773088 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64158ef8-e912-41d4-a929-80344f9eb733 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.774067 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64158ef8-e912-41d4-a929-80344f9eb733 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:47.774654 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64158ef8-e912-41d4-a929-80344f9eb733 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:47.776403 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 378/773] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:47.777384 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd8435-f923-41e0-9dc3-3f02e491a61a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:47.777643 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64158ef8-e912-41d4-a929-80344f9eb733 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:47.783600 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 396/774] 10.222.0.13 () {56 vars in 1145 bytes} [Mon Jan 10 12:35:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:47.786972 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd8435-f923-41e0-9dc3-3f02e491a61a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:47.789505 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64158ef8-e912-41d4-a929-80344f9eb733 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:47.792908 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87bdc3-ec25-4a07-8d32-1ad4750448af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:47.793704 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87bdc3-ec25-4a07-8d32-1ad4750448af admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.793980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87bdc3-ec25-4a07-8d32-1ad4750448af admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.794245 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87bdc3-ec25-4a07-8d32-1ad4750448af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.801788 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64158ef8-e912-41d4-a929-80344f9eb733 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:47.805556 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87bdc3-ec25-4a07-8d32-1ad4750448af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:47.807009 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cab57-cb89-47b1-9524-a818167c9637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:47.807714 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87bdc3-ec25-4a07-8d32-1ad4750448af admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:47.808177 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cab57-cb89-47b1-9524-a818167c9637 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.808668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cab57-cb89-47b1-9524-a818167c9637 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.809212 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cab57-cb89-47b1-9524-a818167c9637 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.810242 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cab57-cb89-47b1-9524-a818167c9637 admin admin] RBAC: Adding query filter params (interface=public, service_id=fd06b2ca409f4eafb93531c9b337512b, region_id=RegionOne) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:47.810757 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cab57-cb89-47b1-9524-a818167c9637 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:47.811922 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING py.warnings [None req-8d8cab57-cb89-47b1-9524-a818167c9637 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:35:47.811922 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: warnings.warn(msg) Jan 10 12:35:47.811922 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: Jan 10 12:35:47.813124 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cab57-cb89-47b1-9524-a818167c9637 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:47.825738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 397/775] 10.222.0.13 () {56 vars in 1272 bytes} [Mon Jan 10 12:35:47 2022] GET /identity/v3/endpoints?service_id=fd06b2ca409f4eafb93531c9b337512b&interface=public®ion_id=RegionOne => generated 194 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:47.829511 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-1d87bdc3-ec25-4a07-8d32-1ad4750448af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:47.831075 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cab57-cb89-47b1-9524-a818167c9637 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:47.837006 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 379/776] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:47.843424 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87bdc3-ec25-4a07-8d32-1ad4750448af admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:47.846823 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cab57-cb89-47b1-9524-a818167c9637 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:47.852008 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04c1bb-af2a-4645-b9fd-05e42006cf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:47.853466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04c1bb-af2a-4645-b9fd-05e42006cf84 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.854019 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04c1bb-af2a-4645-b9fd-05e42006cf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.854486 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04c1bb-af2a-4645-b9fd-05e42006cf84 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.855501 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04c1bb-af2a-4645-b9fd-05e42006cf84 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:47.857506 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04c1bb-af2a-4645-b9fd-05e42006cf84 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:47.864216 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 398/777] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jan 10 12:35:47 2022] GET /identity/v3/services => generated 772 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:47.866307 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87bdc3-ec25-4a07-8d32-1ad4750448af admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:47.881512 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf5c0c-49a8-47fd-b5d6-84fae19458c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:47.882201 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf5c0c-49a8-47fd-b5d6-84fae19458c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.882470 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf5c0c-49a8-47fd-b5d6-84fae19458c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.882740 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf5c0c-49a8-47fd-b5d6-84fae19458c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.883487 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf5c0c-49a8-47fd-b5d6-84fae19458c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:47.883815 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf5c0c-49a8-47fd-b5d6-84fae19458c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:47.885505 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf5c0c-49a8-47fd-b5d6-84fae19458c4 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:47.907186 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 380/778] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:47.918202 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04c1bb-af2a-4645-b9fd-05e42006cf84 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:47.937051 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04c1bb-af2a-4645-b9fd-05e42006cf84 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:47.954963 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf42d5-2a32-4e85-88c3-d92b371c64db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:47.955910 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf42d5-2a32-4e85-88c3-d92b371c64db admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:47.956195 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf42d5-2a32-4e85-88c3-d92b371c64db admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:47.956469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf42d5-2a32-4e85-88c3-d92b371c64db admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:47.968108 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf42d5-2a32-4e85-88c3-d92b371c64db admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:47.970150 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf42d5-2a32-4e85-88c3-d92b371c64db admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:47.989969 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-2ebf42d5-2a32-4e85-88c3-d92b371c64db admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 12:35:47.995745 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 399/779] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jan 10 12:35:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:48.001586 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf5c0c-49a8-47fd-b5d6-84fae19458c4 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:48.021958 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf5c0c-49a8-47fd-b5d6-84fae19458c4 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:48.032001 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfbbad-4c87-4090-83a3-9743ff1e0634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:48.032706 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfbbad-4c87-4090-83a3-9743ff1e0634 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:48.032988 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfbbad-4c87-4090-83a3-9743ff1e0634 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:48.033261 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfbbad-4c87-4090-83a3-9743ff1e0634 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:48.034136 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfbbad-4c87-4090-83a3-9743ff1e0634 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:48.034441 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfbbad-4c87-4090-83a3-9743ff1e0634 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:48.036348 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfbbad-4c87-4090-83a3-9743ff1e0634 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:48.066542 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 381/780] 10.222.0.13 () {56 vars in 1154 bytes} [Mon Jan 10 12:35:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:48.072331 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf42d5-2a32-4e85-88c3-d92b371c64db admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:48.090046 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf42d5-2a32-4e85-88c3-d92b371c64db admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:48.100521 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf5455-adc3-4d02-9120-87bd761c2bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:48.101697 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf5455-adc3-4d02-9120-87bd761c2bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:48.102171 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf5455-adc3-4d02-9120-87bd761c2bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:48.102639 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf5455-adc3-4d02-9120-87bd761c2bd0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:48.120573 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf5455-adc3-4d02-9120-87bd761c2bd0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:48.122795 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf5455-adc3-4d02-9120-87bd761c2bd0 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:48.139030 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 400/781] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:48 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:35:48.144869 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfbbad-4c87-4090-83a3-9743ff1e0634 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:48.161299 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfbbad-4c87-4090-83a3-9743ff1e0634 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:48.168370 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7a6a5-9f34-4f24-acf3-b8260f3e3be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:48.169173 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7a6a5-9f34-4f24-acf3-b8260f3e3be0 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:48.169456 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7a6a5-9f34-4f24-acf3-b8260f3e3be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:48.169726 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7a6a5-9f34-4f24-acf3-b8260f3e3be0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:48.182862 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7a6a5-9f34-4f24-acf3-b8260f3e3be0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:48.186155 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7a6a5-9f34-4f24-acf3-b8260f3e3be0 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:48.205663 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-b7a7a6a5-9f34-4f24-acf3-b8260f3e3be0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:48.206900 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 382/782] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:48.212506 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf5455-adc3-4d02-9120-87bd761c2bd0 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:48.221812 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf5455-adc3-4d02-9120-87bd761c2bd0 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:48.226458 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9154df4-f7ac-4f2c-8dac-eccf1ec925f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:48.227124 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9154df4-f7ac-4f2c-8dac-eccf1ec925f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:48.227403 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9154df4-f7ac-4f2c-8dac-eccf1ec925f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:48.227885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9154df4-f7ac-4f2c-8dac-eccf1ec925f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:48.229013 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9154df4-f7ac-4f2c-8dac-eccf1ec925f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:48.229273 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9154df4-f7ac-4f2c-8dac-eccf1ec925f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:48.230941 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9154df4-f7ac-4f2c-8dac-eccf1ec925f1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:48.243184 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 401/783] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:48.248913 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7a6a5-9f34-4f24-acf3-b8260f3e3be0 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:48.259445 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7a6a5-9f34-4f24-acf3-b8260f3e3be0 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:48.264339 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e2115-d035-4303-af7f-a1ebe8bfb807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:48.265241 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e2115-d035-4303-af7f-a1ebe8bfb807 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:48.265522 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e2115-d035-4303-af7f-a1ebe8bfb807 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:48.265792 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e2115-d035-4303-af7f-a1ebe8bfb807 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:48.273433 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e2115-d035-4303-af7f-a1ebe8bfb807 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:48.275795 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e2115-d035-4303-af7f-a1ebe8bfb807 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:48.288950 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-7c3e2115-d035-4303-af7f-a1ebe8bfb807 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:48.290674 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 383/784] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:48.296651 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9154df4-f7ac-4f2c-8dac-eccf1ec925f1 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:48.307340 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9154df4-f7ac-4f2c-8dac-eccf1ec925f1 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:48.311750 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dd2448-c731-4805-a194-c038374de3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:48.312449 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd2448-c731-4805-a194-c038374de3fb admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:48.312730 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd2448-c731-4805-a194-c038374de3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:48.313043 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dd2448-c731-4805-a194-c038374de3fb admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:48.313959 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd2448-c731-4805-a194-c038374de3fb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:48.314265 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd2448-c731-4805-a194-c038374de3fb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:48.316610 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dd2448-c731-4805-a194-c038374de3fb admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:48.331576 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 402/785] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:48.337877 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e2115-d035-4303-af7f-a1ebe8bfb807 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:48.349694 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e2115-d035-4303-af7f-a1ebe8bfb807 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:48.354919 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c114fba-8fff-4ca8-ad18-2a2351184a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:48.355589 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c114fba-8fff-4ca8-ad18-2a2351184a7c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:48.355870 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c114fba-8fff-4ca8-ad18-2a2351184a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:48.356195 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c114fba-8fff-4ca8-ad18-2a2351184a7c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:48.357043 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c114fba-8fff-4ca8-ad18-2a2351184a7c admin admin] RBAC: Adding query filter params (role.id=9d097c033f454263a874fbafe92c9aea, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=d68fa8e4f3a341a5b74ee32c85e59869) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:48.357402 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c114fba-8fff-4ca8-ad18-2a2351184a7c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:48.359320 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c114fba-8fff-4ca8-ad18-2a2351184a7c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:48.365986 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 384/786] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:48 2022] GET /identity/v3/role_assignments?user.id=d68fa8e4f3a341a5b74ee32c85e59869&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=9d097c033f454263a874fbafe92c9aea => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:49.409800 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bd787-42e7-4d6d-a037-74ffe213d620 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:49.410514 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bd787-42e7-4d6d-a037-74ffe213d620 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:49.410514 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bd787-42e7-4d6d-a037-74ffe213d620 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:49.412417 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 403/787] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:49.417709 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1a6a0-6022-4202-8d4e-de9a6f35fc9f None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:49.418199 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1a6a0-6022-4202-8d4e-de9a6f35fc9f None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:49.418347 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1a6a0-6022-4202-8d4e-de9a6f35fc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:49.443647 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-1fd1a6a0-6022-4202-8d4e-de9a6f35fc9f None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:49.445028 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-1fd1a6a0-6022-4202-8d4e-de9a6f35fc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:49.457859 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 385/788] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:49 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:35:49.483186 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bd787-42e7-4d6d-a037-74ffe213d620 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:49.501175 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bd787-42e7-4d6d-a037-74ffe213d620 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:49.510263 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb9f33-9b7e-460c-9606-772e87ceef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:49.511079 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb9f33-9b7e-460c-9606-772e87ceef27 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:49.511358 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb9f33-9b7e-460c-9606-772e87ceef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:49.511661 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb9f33-9b7e-460c-9606-772e87ceef27 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:49.536725 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb9f33-9b7e-460c-9606-772e87ceef27 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:49.544057 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-6dfb9f33-9b7e-460c-9606-772e87ceef27 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:35:49.545570 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 404/789] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:49.551526 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1a6a0-6022-4202-8d4e-de9a6f35fc9f None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:49.560810 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1a6a0-6022-4202-8d4e-de9a6f35fc9f None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:49.571778 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46ef05-bdd5-4d61-9059-79f7a67fb913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:49.572556 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46ef05-bdd5-4d61-9059-79f7a67fb913 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:49.572744 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46ef05-bdd5-4d61-9059-79f7a67fb913 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:49.572977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46ef05-bdd5-4d61-9059-79f7a67fb913 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:49.573756 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46ef05-bdd5-4d61-9059-79f7a67fb913 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:49.574054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46ef05-bdd5-4d61-9059-79f7a67fb913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:49.575771 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46ef05-bdd5-4d61-9059-79f7a67fb913 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:49.593142 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 386/790] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:35:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:49.598633 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb9f33-9b7e-460c-9606-772e87ceef27 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:49.609316 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb9f33-9b7e-460c-9606-772e87ceef27 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:49.614133 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96188c25-117e-4c5d-b684-708d8c4c5d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:49.615179 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96188c25-117e-4c5d-b684-708d8c4c5d9f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:49.615679 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96188c25-117e-4c5d-b684-708d8c4c5d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:49.616137 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96188c25-117e-4c5d-b684-708d8c4c5d9f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:49.628026 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96188c25-117e-4c5d-b684-708d8c4c5d9f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:49.630310 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96188c25-117e-4c5d-b684-708d8c4c5d9f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:49.647340 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-96188c25-117e-4c5d-b684-708d8c4c5d9f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:49.649156 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 405/791] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:49.655455 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46ef05-bdd5-4d61-9059-79f7a67fb913 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:49.669138 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46ef05-bdd5-4d61-9059-79f7a67fb913 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:49.684174 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24172c4a-5248-46e7-b5e8-d6f5c831d215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:49.684859 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24172c4a-5248-46e7-b5e8-d6f5c831d215 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:49.685142 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24172c4a-5248-46e7-b5e8-d6f5c831d215 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:49.685407 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24172c4a-5248-46e7-b5e8-d6f5c831d215 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:49.686163 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24172c4a-5248-46e7-b5e8-d6f5c831d215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:49.686475 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24172c4a-5248-46e7-b5e8-d6f5c831d215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:49.688129 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24172c4a-5248-46e7-b5e8-d6f5c831d215 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:49.701516 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 387/792] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:49.707251 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96188c25-117e-4c5d-b684-708d8c4c5d9f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:49.723144 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96188c25-117e-4c5d-b684-708d8c4c5d9f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:49.731549 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ce5f0-b86c-4be5-9122-fca83370f684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:49.732904 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ce5f0-b86c-4be5-9122-fca83370f684 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:49.733110 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ce5f0-b86c-4be5-9122-fca83370f684 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:49.733301 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ce5f0-b86c-4be5-9122-fca83370f684 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:49.752982 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ce5f0-b86c-4be5-9122-fca83370f684 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:49.755168 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ce5f0-b86c-4be5-9122-fca83370f684 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:49.776582 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-e09ce5f0-b86c-4be5-9122-fca83370f684 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 10 12:35:49.778251 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 406/793] 10.222.0.13 () {56 vars in 1138 bytes} [Mon Jan 10 12:35:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:49.784074 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24172c4a-5248-46e7-b5e8-d6f5c831d215 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:49.797772 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24172c4a-5248-46e7-b5e8-d6f5c831d215 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:49.814220 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfc7bc-ed9e-4538-a077-eb468ddea8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:49.815285 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfc7bc-ed9e-4538-a077-eb468ddea8ea admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:49.815485 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6bca3-b257-4934-a045-017ce5531abe None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:49.815606 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfc7bc-ed9e-4538-a077-eb468ddea8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:49.815789 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6bca3-b257-4934-a045-017ce5531abe None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:49.815905 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfc7bc-ed9e-4538-a077-eb468ddea8ea admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:49.816062 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6bca3-b257-4934-a045-017ce5531abe None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:49.816692 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfc7bc-ed9e-4538-a077-eb468ddea8ea admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:49.816999 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfc7bc-ed9e-4538-a077-eb468ddea8ea admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:49.818201 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 407/794] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:35:49.818857 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfc7bc-ed9e-4538-a077-eb468ddea8ea admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:49.833069 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3a414-a3b9-4542-8d5a-14a8fef07144 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:49.833386 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3a414-a3b9-4542-8d5a-14a8fef07144 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:49.833659 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3a414-a3b9-4542-8d5a-14a8fef07144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:49.842144 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 388/795] 10.222.0.13 () {56 vars in 1170 bytes} [Mon Jan 10 12:35:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:49.847467 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfc7bc-ed9e-4538-a077-eb468ddea8ea admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:49.857404 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfc7bc-ed9e-4538-a077-eb468ddea8ea admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:49.858659 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-3fb3a414-a3b9-4542-8d5a-14a8fef07144 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:49.860103 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-3fb3a414-a3b9-4542-8d5a-14a8fef07144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:49.869348 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be8e55-9073-4127-95d7-9f5f267a0a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:49.870542 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be8e55-9073-4127-95d7-9f5f267a0a0d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:49.871351 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be8e55-9073-4127-95d7-9f5f267a0a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:49.872347 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be8e55-9073-4127-95d7-9f5f267a0a0d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:49.874337 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 408/796] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:49 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:35:49.884900 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be8e55-9073-4127-95d7-9f5f267a0a0d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:49.887026 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be8e55-9073-4127-95d7-9f5f267a0a0d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:49.902104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3a414-a3b9-4542-8d5a-14a8fef07144 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:49.911040 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3a414-a3b9-4542-8d5a-14a8fef07144 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:49.918535 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-13be8e55-9073-4127-95d7-9f5f267a0a0d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:49.921628 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 389/797] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:49.925138 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5b379-13e5-47f7-a731-25179786bace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:49.925948 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5b379-13e5-47f7-a731-25179786bace admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:49.926223 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5b379-13e5-47f7-a731-25179786bace admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:49.926490 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5b379-13e5-47f7-a731-25179786bace admin admin] PATH_INFO: `/v3/services/network` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:49.927160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5b379-13e5-47f7-a731-25179786bace admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:49.928807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5b379-13e5-47f7-a731-25179786bace admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:49.930002 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be8e55-9073-4127-95d7-9f5f267a0a0d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:49.946215 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-2df5b379-13e5-47f7-a731-25179786bace admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 10 12:35:49.947655 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 409/798] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:49 2022] GET /identity/v3/services/network => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:49.952818 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be8e55-9073-4127-95d7-9f5f267a0a0d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:49.954752 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5b379-13e5-47f7-a731-25179786bace admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:49.962967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07876e01-a987-4403-a617-d2960e74bf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:49.963668 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07876e01-a987-4403-a617-d2960e74bf34 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:49.963944 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07876e01-a987-4403-a617-d2960e74bf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:49.964209 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07876e01-a987-4403-a617-d2960e74bf34 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:49.964950 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07876e01-a987-4403-a617-d2960e74bf34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:49.965249 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07876e01-a987-4403-a617-d2960e74bf34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:49.966840 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07876e01-a987-4403-a617-d2960e74bf34 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:49.977696 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5b379-13e5-47f7-a731-25179786bace admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:49.980183 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 390/799] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:49.987662 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07876e01-a987-4403-a617-d2960e74bf34 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:49.989271 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb4803-68cb-4f19-a5c4-b334da156bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:49.990512 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb4803-68cb-4f19-a5c4-b334da156bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:49.995108 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb4803-68cb-4f19-a5c4-b334da156bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:49.995677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb4803-68cb-4f19-a5c4-b334da156bf6 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:49.996637 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb4803-68cb-4f19-a5c4-b334da156bf6 admin admin] RBAC: Adding query filter params (name=network) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:49.997140 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb4803-68cb-4f19-a5c4-b334da156bf6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:49.998936 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb4803-68cb-4f19-a5c4-b334da156bf6 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:50.006580 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07876e01-a987-4403-a617-d2960e74bf34 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:50.009581 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 410/800] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jan 10 12:35:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:50.015577 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb4803-68cb-4f19-a5c4-b334da156bf6 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:50.018909 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603a113-c118-41d3-aed5-c7680dcd4232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:50.019748 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603a113-c118-41d3-aed5-c7680dcd4232 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:50.020026 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603a113-c118-41d3-aed5-c7680dcd4232 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:50.020297 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603a113-c118-41d3-aed5-c7680dcd4232 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:50.031539 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603a113-c118-41d3-aed5-c7680dcd4232 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:50.035397 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603a113-c118-41d3-aed5-c7680dcd4232 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:50.037121 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb4803-68cb-4f19-a5c4-b334da156bf6 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:50.053777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-2603a113-c118-41d3-aed5-c7680dcd4232 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:50.056833 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 391/801] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:50.057586 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dba6d-8e16-489f-8929-5be54c75ca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:50.058333 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dba6d-8e16-489f-8929-5be54c75ca66 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:50.058678 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dba6d-8e16-489f-8929-5be54c75ca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:50.059013 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3dba6d-8e16-489f-8929-5be54c75ca66 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:50.059864 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dba6d-8e16-489f-8929-5be54c75ca66 admin admin] RBAC: Adding query filter params (type=network) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:50.060235 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dba6d-8e16-489f-8929-5be54c75ca66 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:50.062184 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3dba6d-8e16-489f-8929-5be54c75ca66 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:50.065356 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603a113-c118-41d3-aed5-c7680dcd4232 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:50.074883 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 411/802] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jan 10 12:35:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:50.079688 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603a113-c118-41d3-aed5-c7680dcd4232 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:50.080755 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dba6d-8e16-489f-8929-5be54c75ca66 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:50.091153 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3dba6d-8e16-489f-8929-5be54c75ca66 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:50.097102 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392a27f-060c-45a2-9b2b-0f4c6c1049dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:50.098635 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392a27f-060c-45a2-9b2b-0f4c6c1049dc admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:50.098920 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392a27f-060c-45a2-9b2b-0f4c6c1049dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:50.099194 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392a27f-060c-45a2-9b2b-0f4c6c1049dc admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:50.100028 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392a27f-060c-45a2-9b2b-0f4c6c1049dc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:50.100334 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392a27f-060c-45a2-9b2b-0f4c6c1049dc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:50.102192 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392a27f-060c-45a2-9b2b-0f4c6c1049dc admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:50.104776 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a6dd5-8001-4934-b2c3-191745de6656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:50.105442 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a6dd5-8001-4934-b2c3-191745de6656 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:50.105716 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a6dd5-8001-4934-b2c3-191745de6656 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:50.105979 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a6dd5-8001-4934-b2c3-191745de6656 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:50.106780 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a6dd5-8001-4934-b2c3-191745de6656 admin admin] RBAC: Adding query filter params (interface=public, service_id=0a846dd31d0445f38a11b1b57d40c5dd, region_id=RegionOne) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:50.107082 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a6dd5-8001-4934-b2c3-191745de6656 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:50.108690 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a6dd5-8001-4934-b2c3-191745de6656 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:50.115594 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 412/803] 10.222.0.13 () {56 vars in 1272 bytes} [Mon Jan 10 12:35:50 2022] GET /identity/v3/endpoints?service_id=0a846dd31d0445f38a11b1b57d40c5dd&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:50.121242 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a6dd5-8001-4934-b2c3-191745de6656 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:50.130489 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 392/804] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:50.132170 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a6dd5-8001-4934-b2c3-191745de6656 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:50.136642 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392a27f-060c-45a2-9b2b-0f4c6c1049dc admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:50.137354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d271a-a9fc-40a9-bcff-ff41aad92689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:50.138227 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d271a-a9fc-40a9-bcff-ff41aad92689 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:50.138640 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d271a-a9fc-40a9-bcff-ff41aad92689 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:50.139098 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d271a-a9fc-40a9-bcff-ff41aad92689 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:50.140224 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d271a-a9fc-40a9-bcff-ff41aad92689 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:50.142363 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d271a-a9fc-40a9-bcff-ff41aad92689 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:50.149428 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 413/805] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jan 10 12:35:50 2022] GET /identity/v3/services => generated 772 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:50.153818 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392a27f-060c-45a2-9b2b-0f4c6c1049dc admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:50.164517 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba643e90-97d6-4a98-b19b-fa3029e2d951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:50.166114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba643e90-97d6-4a98-b19b-fa3029e2d951 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:50.166761 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba643e90-97d6-4a98-b19b-fa3029e2d951 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:50.167258 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba643e90-97d6-4a98-b19b-fa3029e2d951 admin admin] PATH_INFO: `/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/44e5602fd019411aa8f0e091ed533ae8/roles/3c723eddb93e4ab6b44d5fe4ed5877a7` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:50.191394 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba643e90-97d6-4a98-b19b-fa3029e2d951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0105f8c08c84f538cd7ba86fcd26b62, user_id=44e5602fd019411aa8f0e091ed533ae8, role_id=3c723eddb93e4ab6b44d5fe4ed5877a7)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:50.200938 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba643e90-97d6-4a98-b19b-fa3029e2d951 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:50.230562 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 393/806] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:35:50 2022] PUT /identity/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/44e5602fd019411aa8f0e091ed533ae8/roles/3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:35:50.273835 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e40a8-e195-47d4-bee2-7e3602ec950b None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:50.274503 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e40a8-e195-47d4-bee2-7e3602ec950b None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:50.275072 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e40a8-e195-47d4-bee2-7e3602ec950b None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:50.277275 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 414/807] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:50.283341 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e2ed0-e4bd-40b5-9711-af51843e2837 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:50.284088 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e2ed0-e4bd-40b5-9711-af51843e2837 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:50.284550 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e2ed0-e4bd-40b5-9711-af51843e2837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:50.311416 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-766e2ed0-e4bd-40b5-9711-af51843e2837 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:50.313162 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-766e2ed0-e4bd-40b5-9711-af51843e2837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:50.387866 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 394/808] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:50 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:35:50.443413 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e40a8-e195-47d4-bee2-7e3602ec950b None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:50.460359 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e40a8-e195-47d4-bee2-7e3602ec950b None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:50.466350 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb435d8-9a0e-4ed0-8136-7076bd7332fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:50.467599 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb435d8-9a0e-4ed0-8136-7076bd7332fc admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:50.468072 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb435d8-9a0e-4ed0-8136-7076bd7332fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:50.468541 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb435d8-9a0e-4ed0-8136-7076bd7332fc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:50.485537 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb435d8-9a0e-4ed0-8136-7076bd7332fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:50.492852 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-5fb435d8-9a0e-4ed0-8136-7076bd7332fc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:35:50.495610 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 415/809] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:35:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:50.501167 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e2ed0-e4bd-40b5-9711-af51843e2837 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:50.511686 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e2ed0-e4bd-40b5-9711-af51843e2837 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:50.520252 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2a9fe-ff8d-4894-be43-fbd7e6586752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:50.521363 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2a9fe-ff8d-4894-be43-fbd7e6586752 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:50.521858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2a9fe-ff8d-4894-be43-fbd7e6586752 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:50.522316 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2a9fe-ff8d-4894-be43-fbd7e6586752 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:50.523304 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2a9fe-ff8d-4894-be43-fbd7e6586752 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:50.523827 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2a9fe-ff8d-4894-be43-fbd7e6586752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:50.525931 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2a9fe-ff8d-4894-be43-fbd7e6586752 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:50.537332 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 395/810] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:50.544562 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb435d8-9a0e-4ed0-8136-7076bd7332fc admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:50.556450 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb435d8-9a0e-4ed0-8136-7076bd7332fc admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:50.562729 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33b3fd-6b6c-446c-b028-8e67408f6432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:50.564051 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33b3fd-6b6c-446c-b028-8e67408f6432 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:50.564543 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33b3fd-6b6c-446c-b028-8e67408f6432 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:50.565383 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33b3fd-6b6c-446c-b028-8e67408f6432 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:50.577768 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33b3fd-6b6c-446c-b028-8e67408f6432 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:50.579884 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33b3fd-6b6c-446c-b028-8e67408f6432 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:50.597234 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-8f33b3fd-6b6c-446c-b028-8e67408f6432 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:50.598698 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 416/811] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:50.604551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2a9fe-ff8d-4894-be43-fbd7e6586752 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:50.614897 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2a9fe-ff8d-4894-be43-fbd7e6586752 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:50.623142 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee8b9e-2e6a-4898-8b13-b3581befb044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:50.624066 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee8b9e-2e6a-4898-8b13-b3581befb044 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:50.624537 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee8b9e-2e6a-4898-8b13-b3581befb044 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:50.624980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee8b9e-2e6a-4898-8b13-b3581befb044 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:50.625892 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee8b9e-2e6a-4898-8b13-b3581befb044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:50.626362 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee8b9e-2e6a-4898-8b13-b3581befb044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:50.628169 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee8b9e-2e6a-4898-8b13-b3581befb044 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:50.641266 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 396/812] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:50.646916 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33b3fd-6b6c-446c-b028-8e67408f6432 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:50.656972 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33b3fd-6b6c-446c-b028-8e67408f6432 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:50.667132 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb3977-a1bf-402a-8fc3-e1bb067f729b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:50.668177 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb3977-a1bf-402a-8fc3-e1bb067f729b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:50.668648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb3977-a1bf-402a-8fc3-e1bb067f729b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:50.669083 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb3977-a1bf-402a-8fc3-e1bb067f729b admin admin] PATH_INFO: `/v3/users/swift` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:50.677850 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb3977-a1bf-402a-8fc3-e1bb067f729b admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:50.680107 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb3977-a1bf-402a-8fc3-e1bb067f729b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:50.698481 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-2dfb3977-a1bf-402a-8fc3-e1bb067f729b admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 10 12:35:50.700025 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 417/813] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:35:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:50.705903 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee8b9e-2e6a-4898-8b13-b3581befb044 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:50.716407 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee8b9e-2e6a-4898-8b13-b3581befb044 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:50.727494 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426da6db-5eb1-46ae-9e21-662d7cc9e934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:50.728490 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426da6db-5eb1-46ae-9e21-662d7cc9e934 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:50.728964 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426da6db-5eb1-46ae-9e21-662d7cc9e934 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:50.729403 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426da6db-5eb1-46ae-9e21-662d7cc9e934 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:50.730428 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426da6db-5eb1-46ae-9e21-662d7cc9e934 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:50.730906 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426da6db-5eb1-46ae-9e21-662d7cc9e934 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:50.733631 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426da6db-5eb1-46ae-9e21-662d7cc9e934 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:50.752500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 397/814] 10.222.0.13 () {56 vars in 1156 bytes} [Mon Jan 10 12:35:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:50.757756 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb3977-a1bf-402a-8fc3-e1bb067f729b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:50.770140 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb3977-a1bf-402a-8fc3-e1bb067f729b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:50.777421 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27d1bb-a183-438b-ac75-7dc989360c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:50.778462 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27d1bb-a183-438b-ac75-7dc989360c96 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:50.778912 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27d1bb-a183-438b-ac75-7dc989360c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:50.779343 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27d1bb-a183-438b-ac75-7dc989360c96 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:50.795358 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27d1bb-a183-438b-ac75-7dc989360c96 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:50.797515 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27d1bb-a183-438b-ac75-7dc989360c96 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:50.817783 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-3c27d1bb-a183-438b-ac75-7dc989360c96 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:50.819314 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 418/815] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:50.825253 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426da6db-5eb1-46ae-9e21-662d7cc9e934 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:50.835272 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426da6db-5eb1-46ae-9e21-662d7cc9e934 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:50.843404 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3c714-58e4-4df4-ba4d-04737b297f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:50.844302 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3c714-58e4-4df4-ba4d-04737b297f4e admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:50.844746 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3c714-58e4-4df4-ba4d-04737b297f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:50.845178 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3c714-58e4-4df4-ba4d-04737b297f4e admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:50.846079 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3c714-58e4-4df4-ba4d-04737b297f4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:50.846547 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3c714-58e4-4df4-ba4d-04737b297f4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:50.848429 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3c714-58e4-4df4-ba4d-04737b297f4e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:50.860419 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 398/816] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:50.866147 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27d1bb-a183-438b-ac75-7dc989360c96 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:50.880325 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27d1bb-a183-438b-ac75-7dc989360c96 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:50.891154 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75184a9-4a42-4955-902f-972addc85b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:50.892209 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75184a9-4a42-4955-902f-972addc85b58 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:50.892661 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75184a9-4a42-4955-902f-972addc85b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:50.893121 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75184a9-4a42-4955-902f-972addc85b58 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:50.908647 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75184a9-4a42-4955-902f-972addc85b58 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:50.910812 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75184a9-4a42-4955-902f-972addc85b58 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:50.930335 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-c75184a9-4a42-4955-902f-972addc85b58 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:50.936444 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 419/817] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:50.942690 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3c714-58e4-4df4-ba4d-04737b297f4e admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:50.957180 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3c714-58e4-4df4-ba4d-04737b297f4e admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:50.972682 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22ff35-3434-4005-b23b-022ac7ead0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:50.973344 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22ff35-3434-4005-b23b-022ac7ead0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:50.973620 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22ff35-3434-4005-b23b-022ac7ead0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:50.973887 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22ff35-3434-4005-b23b-022ac7ead0e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:50.974695 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22ff35-3434-4005-b23b-022ac7ead0e3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:50.974998 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22ff35-3434-4005-b23b-022ac7ead0e3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:50.976980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22ff35-3434-4005-b23b-022ac7ead0e3 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:50.996681 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 399/818] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:51.002713 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75184a9-4a42-4955-902f-972addc85b58 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:51.016562 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75184a9-4a42-4955-902f-972addc85b58 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:51.027756 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2b611-e274-4d0e-95b5-d0364a96c0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:51.028910 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2b611-e274-4d0e-95b5-d0364a96c0a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:51.029398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2b611-e274-4d0e-95b5-d0364a96c0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:51.029855 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2b611-e274-4d0e-95b5-d0364a96c0a3 admin admin] PATH_INFO: `/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/1cd898c7c2974bb38998ebad22fd5a3b/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:51.036796 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2b611-e274-4d0e-95b5-d0364a96c0a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0105f8c08c84f538cd7ba86fcd26b62, user_id=1cd898c7c2974bb38998ebad22fd5a3b, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:51.039693 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2b611-e274-4d0e-95b5-d0364a96c0a3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:51.040721 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1441283-684b-4acf-a23a-84763db859d5 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:51.041004 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1441283-684b-4acf-a23a-84763db859d5 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:51.041364 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1441283-684b-4acf-a23a-84763db859d5 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:51.043425 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 400/819] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:51.048914 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9cd41-b718-49ca-9b8f-88d88b941c09 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:51.049201 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9cd41-b718-49ca-9b8f-88d88b941c09 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:51.049480 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9cd41-b718-49ca-9b8f-88d88b941c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:51.064689 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 420/820] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:35:51 2022] PUT /identity/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/1cd898c7c2974bb38998ebad22fd5a3b/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:35:51.076881 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-77d9cd41-b718-49ca-9b8f-88d88b941c09 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:51.078168 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-77d9cd41-b718-49ca-9b8f-88d88b941c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:51.141206 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 401/821] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:51 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:35:51.166714 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2b611-e274-4d0e-95b5-d0364a96c0a3 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:51.177398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2b611-e274-4d0e-95b5-d0364a96c0a3 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:51.182875 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd1158-5d16-4100-ae4c-e8c1c8fee97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:51.183885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd1158-5d16-4100-ae4c-e8c1c8fee97b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:51.184168 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd1158-5d16-4100-ae4c-e8c1c8fee97b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:51.184440 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd1158-5d16-4100-ae4c-e8c1c8fee97b admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:51.185201 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd1158-5d16-4100-ae4c-e8c1c8fee97b admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:51.187025 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd1158-5d16-4100-ae4c-e8c1c8fee97b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:51.200174 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-bbbd1158-5d16-4100-ae4c-e8c1c8fee97b admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 10 12:35:51.201504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 421/822] 10.222.0.13 () {56 vars in 1150 bytes} [Mon Jan 10 12:35:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:51.207573 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9cd41-b718-49ca-9b8f-88d88b941c09 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:51.217171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9cd41-b718-49ca-9b8f-88d88b941c09 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:51.221906 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746143e-f4b9-4ae5-9208-81a8c35b20f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:51.222593 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746143e-f4b9-4ae5-9208-81a8c35b20f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:51.222882 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746143e-f4b9-4ae5-9208-81a8c35b20f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:51.223213 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746143e-f4b9-4ae5-9208-81a8c35b20f8 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:51.224047 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746143e-f4b9-4ae5-9208-81a8c35b20f8 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:51.224400 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746143e-f4b9-4ae5-9208-81a8c35b20f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:51.226127 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746143e-f4b9-4ae5-9208-81a8c35b20f8 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:51.231912 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 402/823] 10.222.0.13 () {56 vars in 1145 bytes} [Mon Jan 10 12:35:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:51.237647 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd1158-5d16-4100-ae4c-e8c1c8fee97b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:51.248481 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd1158-5d16-4100-ae4c-e8c1c8fee97b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:51.253251 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99958783-eb38-41b7-9526-60bc4378f6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:51.253989 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99958783-eb38-41b7-9526-60bc4378f6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:51.254268 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99958783-eb38-41b7-9526-60bc4378f6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:51.254542 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99958783-eb38-41b7-9526-60bc4378f6a9 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:51.255322 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99958783-eb38-41b7-9526-60bc4378f6a9 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:51.255660 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99958783-eb38-41b7-9526-60bc4378f6a9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:51.257466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99958783-eb38-41b7-9526-60bc4378f6a9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:51.263938 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 422/824] 10.222.0.13 () {56 vars in 1145 bytes} [Mon Jan 10 12:35:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:51.269787 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746143e-f4b9-4ae5-9208-81a8c35b20f8 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:51.281894 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746143e-f4b9-4ae5-9208-81a8c35b20f8 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:51.291546 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe4f47-dd77-4010-98a7-b58b192b4e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:51.291546 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe4f47-dd77-4010-98a7-b58b192b4e5c admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:51.291546 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe4f47-dd77-4010-98a7-b58b192b4e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:51.291546 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe4f47-dd77-4010-98a7-b58b192b4e5c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:51.291962 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe4f47-dd77-4010-98a7-b58b192b4e5c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:51.291962 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-92fe4f47-dd77-4010-98a7-b58b192b4e5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:35:51.291962 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:35:51.291962 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:35:51.293273 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe4f47-dd77-4010-98a7-b58b192b4e5c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:51.341748 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 403/825] 10.222.0.13 () {60 vars in 1165 bytes} [Mon Jan 10 12:35:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:35:52.005167 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a8562-b27e-469f-9f41-8889f60f71bb None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:52.005716 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a8562-b27e-469f-9f41-8889f60f71bb None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:52.005716 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a8562-b27e-469f-9f41-8889f60f71bb None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:52.007376 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 423/826] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:52.014383 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c897e39-5183-4ef9-b49e-21de75dc7154 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:52.014826 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c897e39-5183-4ef9-b49e-21de75dc7154 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:52.014899 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c897e39-5183-4ef9-b49e-21de75dc7154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:52.033655 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-2c897e39-5183-4ef9-b49e-21de75dc7154 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:52.034836 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-2c897e39-5183-4ef9-b49e-21de75dc7154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:52.063885 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 404/827] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:52 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:35:52.082604 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a8562-b27e-469f-9f41-8889f60f71bb None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:52.095816 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a8562-b27e-469f-9f41-8889f60f71bb None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:52.107157 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9c43a-dc95-4ee1-adb1-7bcb03e2906d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:52.107999 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9c43a-dc95-4ee1-adb1-7bcb03e2906d admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:52.108272 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9c43a-dc95-4ee1-adb1-7bcb03e2906d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:52.108539 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9c43a-dc95-4ee1-adb1-7bcb03e2906d admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:52.109214 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9c43a-dc95-4ee1-adb1-7bcb03e2906d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:52.110800 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9c43a-dc95-4ee1-adb1-7bcb03e2906d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:52.128086 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-48c9c43a-dc95-4ee1-adb1-7bcb03e2906d admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 10 12:35:52.129544 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 424/828] 10.222.0.13 () {56 vars in 1153 bytes} [Mon Jan 10 12:35:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:52.135558 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c897e39-5183-4ef9-b49e-21de75dc7154 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:52.144458 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c897e39-5183-4ef9-b49e-21de75dc7154 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:52.148879 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844e8bb-d2fd-45c2-9b02-6e8b499e8702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:52.149533 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844e8bb-d2fd-45c2-9b02-6e8b499e8702 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:52.149912 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844e8bb-d2fd-45c2-9b02-6e8b499e8702 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:52.150302 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844e8bb-d2fd-45c2-9b02-6e8b499e8702 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:52.151030 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844e8bb-d2fd-45c2-9b02-6e8b499e8702 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:52.151332 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844e8bb-d2fd-45c2-9b02-6e8b499e8702 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:52.152953 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844e8bb-d2fd-45c2-9b02-6e8b499e8702 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:52.157777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 405/829] 10.222.0.13 () {56 vars in 1147 bytes} [Mon Jan 10 12:35:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:52.163071 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9c43a-dc95-4ee1-adb1-7bcb03e2906d admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:52.172784 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9c43a-dc95-4ee1-adb1-7bcb03e2906d admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:52.183143 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97743491-bd5e-4b6c-90ee-1fcb3bf69c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:52.183842 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97743491-bd5e-4b6c-90ee-1fcb3bf69c22 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:52.184119 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97743491-bd5e-4b6c-90ee-1fcb3bf69c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:52.184387 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97743491-bd5e-4b6c-90ee-1fcb3bf69c22 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:52.185120 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97743491-bd5e-4b6c-90ee-1fcb3bf69c22 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:52.185415 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97743491-bd5e-4b6c-90ee-1fcb3bf69c22 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:52.187009 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97743491-bd5e-4b6c-90ee-1fcb3bf69c22 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:52.192438 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 425/830] 10.222.0.13 () {56 vars in 1147 bytes} [Mon Jan 10 12:35:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:53.116146 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c9a67-6804-4fc7-9880-37ae44f3f2c0 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:53.116845 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c9a67-6804-4fc7-9880-37ae44f3f2c0 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:53.116845 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c9a67-6804-4fc7-9880-37ae44f3f2c0 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:53.118714 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 406/831] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:53.124233 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c27922-2527-4d4c-9f57-688bdefcea2a None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:53.124723 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c27922-2527-4d4c-9f57-688bdefcea2a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:53.124891 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c27922-2527-4d4c-9f57-688bdefcea2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:53.156579 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-27c27922-2527-4d4c-9f57-688bdefcea2a None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:53.157799 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-27c27922-2527-4d4c-9f57-688bdefcea2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:53.166074 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 426/832] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:53 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:35:53.190849 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c9a67-6804-4fc7-9880-37ae44f3f2c0 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:53.199088 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf0167-6b88-456c-9bdf-f0d278464346 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:53.199356 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf0167-6b88-456c-9bdf-f0d278464346 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:53.199647 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf0167-6b88-456c-9bdf-f0d278464346 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:53.202742 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 427/833] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:53.207046 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564830a-da06-4823-947d-e0642f2954de None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:53.207324 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564830a-da06-4823-947d-e0642f2954de None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:53.207628 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564830a-da06-4823-947d-e0642f2954de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:53.209195 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c9a67-6804-4fc7-9880-37ae44f3f2c0 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:53.215542 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43431a9c-17ea-411b-919d-a92125ccc700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:53.216342 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43431a9c-17ea-411b-919d-a92125ccc700 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:53.216613 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43431a9c-17ea-411b-919d-a92125ccc700 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:53.216871 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43431a9c-17ea-411b-919d-a92125ccc700 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:53.227019 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-8564830a-da06-4823-947d-e0642f2954de None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:53.228578 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-8564830a-da06-4823-947d-e0642f2954de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:53.240525 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43431a9c-17ea-411b-919d-a92125ccc700 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:53.249885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 428/834] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:53 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:35:53.251945 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-43431a9c-17ea-411b-919d-a92125ccc700 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:35:53.253377 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 407/835] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:35:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:53.260535 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564830a-da06-4823-947d-e0642f2954de None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:53.273125 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8564830a-da06-4823-947d-e0642f2954de None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:53.275268 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43431a9c-17ea-411b-919d-a92125ccc700 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:53.287823 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43431a9c-17ea-411b-919d-a92125ccc700 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:53.289336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a366b5-ad5a-4cc1-a231-49f6cd1d0bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:53.290253 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a366b5-ad5a-4cc1-a231-49f6cd1d0bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:53.290861 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a366b5-ad5a-4cc1-a231-49f6cd1d0bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:53.291415 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a366b5-ad5a-4cc1-a231-49f6cd1d0bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:53.292417 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a366b5-ad5a-4cc1-a231-49f6cd1d0bc0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:53.292935 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a366b5-ad5a-4cc1-a231-49f6cd1d0bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:53.294790 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a366b5-ad5a-4cc1-a231-49f6cd1d0bc0 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:53.304915 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 429/836] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:35:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:53.307789 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c5a8c-a351-48fe-813a-c4400ee2e60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:53.308709 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c5a8c-a351-48fe-813a-c4400ee2e60f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:53.309083 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c5a8c-a351-48fe-813a-c4400ee2e60f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:53.309446 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c5a8c-a351-48fe-813a-c4400ee2e60f admin admin] PATH_INFO: `/v3/services/network` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:53.311121 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a366b5-ad5a-4cc1-a231-49f6cd1d0bc0 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:53.312090 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c5a8c-a351-48fe-813a-c4400ee2e60f admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:53.318381 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c5a8c-a351-48fe-813a-c4400ee2e60f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:53.325759 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a366b5-ad5a-4cc1-a231-49f6cd1d0bc0 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:53.337146 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22794c-d796-4037-b620-c8fdee6e552c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:53.337980 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22794c-d796-4037-b620-c8fdee6e552c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:53.338233 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22794c-d796-4037-b620-c8fdee6e552c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:53.338494 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22794c-d796-4037-b620-c8fdee6e552c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:53.339091 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-313c5a8c-a351-48fe-813a-c4400ee2e60f admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 10 12:35:53.347479 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 408/837] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:53 2022] GET /identity/v3/services/network => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:53.350702 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c5a8c-a351-48fe-813a-c4400ee2e60f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:53.363531 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22794c-d796-4037-b620-c8fdee6e552c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:53.365384 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22794c-d796-4037-b620-c8fdee6e552c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:53.367994 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c5a8c-a351-48fe-813a-c4400ee2e60f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:53.380399 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764da6a-ff7a-4a5c-b1b6-dbce49416b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:53.381069 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764da6a-ff7a-4a5c-b1b6-dbce49416b79 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:53.381348 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764da6a-ff7a-4a5c-b1b6-dbce49416b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:53.381617 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764da6a-ff7a-4a5c-b1b6-dbce49416b79 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:53.382344 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764da6a-ff7a-4a5c-b1b6-dbce49416b79 admin admin] RBAC: Adding query filter params (name=network) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:53.382645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764da6a-ff7a-4a5c-b1b6-dbce49416b79 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:53.384490 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764da6a-ff7a-4a5c-b1b6-dbce49416b79 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:53.395168 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 409/838] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jan 10 12:35:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:53.397205 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-be22794c-d796-4037-b620-c8fdee6e552c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:53.398696 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 430/839] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:53.401191 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764da6a-ff7a-4a5c-b1b6-dbce49416b79 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:53.404063 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22794c-d796-4037-b620-c8fdee6e552c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:53.421323 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764da6a-ff7a-4a5c-b1b6-dbce49416b79 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:53.424225 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22794c-d796-4037-b620-c8fdee6e552c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:53.431442 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef366f-d213-47bd-bde3-bac0393d8976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:53.432282 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef366f-d213-47bd-bde3-bac0393d8976 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:53.432558 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef366f-d213-47bd-bde3-bac0393d8976 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:53.433150 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c8db6-ac50-430a-8ae0-8b40562e37d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:53.433961 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef366f-d213-47bd-bde3-bac0393d8976 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:53.434360 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c8db6-ac50-430a-8ae0-8b40562e37d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:53.435133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef366f-d213-47bd-bde3-bac0393d8976 admin admin] RBAC: Adding query filter params (type=network) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:53.435435 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef366f-d213-47bd-bde3-bac0393d8976 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:53.437055 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef366f-d213-47bd-bde3-bac0393d8976 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:53.437367 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c8db6-ac50-430a-8ae0-8b40562e37d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:53.437645 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c8db6-ac50-430a-8ae0-8b40562e37d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:53.438386 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c8db6-ac50-430a-8ae0-8b40562e37d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:53.438689 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c8db6-ac50-430a-8ae0-8b40562e37d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:53.441952 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c8db6-ac50-430a-8ae0-8b40562e37d1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:53.459655 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 410/840] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jan 10 12:35:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:53.465817 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 431/841] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:53.470281 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef366f-d213-47bd-bde3-bac0393d8976 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:53.470535 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c8db6-ac50-430a-8ae0-8b40562e37d1 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:53.480591 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c8db6-ac50-430a-8ae0-8b40562e37d1 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:53.485068 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef366f-d213-47bd-bde3-bac0393d8976 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:53.489378 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd97f6a-98b2-4a15-be25-4725922ae6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:53.490198 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd97f6a-98b2-4a15-be25-4725922ae6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:53.490471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd97f6a-98b2-4a15-be25-4725922ae6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:53.490738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd97f6a-98b2-4a15-be25-4725922ae6d8 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:53.497047 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c97952-9100-4713-a9e3-0a6db30ac5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:53.497713 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c97952-9100-4713-a9e3-0a6db30ac5bc admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:53.497996 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c97952-9100-4713-a9e3-0a6db30ac5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:53.498275 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c97952-9100-4713-a9e3-0a6db30ac5bc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:53.499047 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c97952-9100-4713-a9e3-0a6db30ac5bc admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:53.500680 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c97952-9100-4713-a9e3-0a6db30ac5bc admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:53.506260 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd97f6a-98b2-4a15-be25-4725922ae6d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:53.508329 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd97f6a-98b2-4a15-be25-4725922ae6d8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:53.529483 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-6cd97f6a-98b2-4a15-be25-4725922ae6d8 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 10 12:35:53.531754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 432/842] 10.222.0.13 () {56 vars in 1138 bytes} [Mon Jan 10 12:35:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:53.537912 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd97f6a-98b2-4a15-be25-4725922ae6d8 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:53.549546 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 411/843] 10.222.0.13 () {60 vars in 1165 bytes} [Mon Jan 10 12:35:53 2022] POST /identity/v3/endpoints => generated 327 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:35:53.562620 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd97f6a-98b2-4a15-be25-4725922ae6d8 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:53.586424 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e73fc1-e0f9-4b28-9651-87ce898c7e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:53.587542 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e73fc1-e0f9-4b28-9651-87ce898c7e93 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:53.588007 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e73fc1-e0f9-4b28-9651-87ce898c7e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:53.588341 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e73fc1-e0f9-4b28-9651-87ce898c7e93 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:53.589322 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e73fc1-e0f9-4b28-9651-87ce898c7e93 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:53.589633 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e73fc1-e0f9-4b28-9651-87ce898c7e93 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:53.591609 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e73fc1-e0f9-4b28-9651-87ce898c7e93 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:53.619920 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 433/844] 10.222.0.13 () {56 vars in 1170 bytes} [Mon Jan 10 12:35:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:53.625640 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c97952-9100-4713-a9e3-0a6db30ac5bc admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:53.640702 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c97952-9100-4713-a9e3-0a6db30ac5bc admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:53.645643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c43b5-2786-40bf-9b3d-a7ea83408f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:53.646888 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c43b5-2786-40bf-9b3d-a7ea83408f20 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:53.646888 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c43b5-2786-40bf-9b3d-a7ea83408f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:53.646888 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c43b5-2786-40bf-9b3d-a7ea83408f20 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:53.660956 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c43b5-2786-40bf-9b3d-a7ea83408f20 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:53.662842 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c43b5-2786-40bf-9b3d-a7ea83408f20 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:53.677763 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 412/845] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:53 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:35:53.683463 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e73fc1-e0f9-4b28-9651-87ce898c7e93 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:53.697094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e73fc1-e0f9-4b28-9651-87ce898c7e93 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:53.707122 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f757b-0c54-4664-ab60-11dc324bbd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:53.707999 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f757b-0c54-4664-ab60-11dc324bbd8a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:53.708281 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f757b-0c54-4664-ab60-11dc324bbd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:53.708551 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f757b-0c54-4664-ab60-11dc324bbd8a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:53.722824 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f757b-0c54-4664-ab60-11dc324bbd8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:53.724850 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f757b-0c54-4664-ab60-11dc324bbd8a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:53.752575 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-854f757b-0c54-4664-ab60-11dc324bbd8a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:53.753868 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 434/846] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:53.759661 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c43b5-2786-40bf-9b3d-a7ea83408f20 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:53.773110 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c43b5-2786-40bf-9b3d-a7ea83408f20 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:53.783122 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e548f9e-179f-4981-ae03-2c3d575d3ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:53.783841 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e548f9e-179f-4981-ae03-2c3d575d3ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:53.784120 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e548f9e-179f-4981-ae03-2c3d575d3ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:53.784391 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e548f9e-179f-4981-ae03-2c3d575d3ef4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:53.785152 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e548f9e-179f-4981-ae03-2c3d575d3ef4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:53.785459 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e548f9e-179f-4981-ae03-2c3d575d3ef4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:53.787082 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e548f9e-179f-4981-ae03-2c3d575d3ef4 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:53.805987 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 413/847] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:53.811430 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f757b-0c54-4664-ab60-11dc324bbd8a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:53.822788 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f757b-0c54-4664-ab60-11dc324bbd8a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:53.830485 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c05abe-95a6-409a-b762-828375f19d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:53.831291 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05abe-95a6-409a-b762-828375f19d9e admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:53.831593 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05abe-95a6-409a-b762-828375f19d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:53.831862 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05abe-95a6-409a-b762-828375f19d9e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:53.842140 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c05abe-95a6-409a-b762-828375f19d9e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:53.844218 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c05abe-95a6-409a-b762-828375f19d9e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:53.861874 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-13c05abe-95a6-409a-b762-828375f19d9e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:53.863493 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 435/848] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:53.869576 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e548f9e-179f-4981-ae03-2c3d575d3ef4 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:53.880239 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e548f9e-179f-4981-ae03-2c3d575d3ef4 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:53.889526 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058806c-69c2-47e6-9a2f-7682b30a4034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:53.890198 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058806c-69c2-47e6-9a2f-7682b30a4034 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:53.890470 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058806c-69c2-47e6-9a2f-7682b30a4034 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:53.890737 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058806c-69c2-47e6-9a2f-7682b30a4034 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:53.891567 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058806c-69c2-47e6-9a2f-7682b30a4034 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:53.891874 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058806c-69c2-47e6-9a2f-7682b30a4034 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:53.893724 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058806c-69c2-47e6-9a2f-7682b30a4034 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:53.911832 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 414/849] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:53.917553 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c05abe-95a6-409a-b762-828375f19d9e admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:53.933425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c05abe-95a6-409a-b762-828375f19d9e admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:53.938833 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c4c06-58a1-4d53-afaf-a0a73a5f979e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:53.939488 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c4c06-58a1-4d53-afaf-a0a73a5f979e admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:53.939790 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c4c06-58a1-4d53-afaf-a0a73a5f979e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:53.940416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c4c06-58a1-4d53-afaf-a0a73a5f979e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:53.941263 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c4c06-58a1-4d53-afaf-a0a73a5f979e admin admin] RBAC: Adding query filter params (role.id=3c723eddb93e4ab6b44d5fe4ed5877a7, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=44e5602fd019411aa8f0e091ed533ae8) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:53.941563 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c4c06-58a1-4d53-afaf-a0a73a5f979e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:53.943398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c4c06-58a1-4d53-afaf-a0a73a5f979e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:53.953143 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 436/850] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:53 2022] GET /identity/v3/role_assignments?user.id=44e5602fd019411aa8f0e091ed533ae8&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:54.098888 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728b4c1-6e51-4151-8fc9-7167ec9aaa99 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:54.099262 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728b4c1-6e51-4151-8fc9-7167ec9aaa99 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:54.099444 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728b4c1-6e51-4151-8fc9-7167ec9aaa99 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:54.101665 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 415/851] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:54.110269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0950871-8417-4cf1-b798-2d965e284b07 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:54.110269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0950871-8417-4cf1-b798-2d965e284b07 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:54.110269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0950871-8417-4cf1-b798-2d965e284b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:54.130998 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-f0950871-8417-4cf1-b798-2d965e284b07 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:54.133072 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f0950871-8417-4cf1-b798-2d965e284b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:54.141960 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 437/852] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:54 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:35:54.168408 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728b4c1-6e51-4151-8fc9-7167ec9aaa99 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:54.180999 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728b4c1-6e51-4151-8fc9-7167ec9aaa99 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:54.186154 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfa7fe-8fb6-4798-9a54-92428894008d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:54.186959 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa7fe-8fb6-4798-9a54-92428894008d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:54.187236 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa7fe-8fb6-4798-9a54-92428894008d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:54.187502 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa7fe-8fb6-4798-9a54-92428894008d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:54.200147 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfa7fe-8fb6-4798-9a54-92428894008d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:54.207368 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-6abfa7fe-8fb6-4798-9a54-92428894008d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:35:54.208483 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 416/853] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:35:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:54.214965 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0950871-8417-4cf1-b798-2d965e284b07 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:54.225189 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0950871-8417-4cf1-b798-2d965e284b07 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:54.229869 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63063dd7-b76d-49ed-8afa-fc142cfbef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:54.230548 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63063dd7-b76d-49ed-8afa-fc142cfbef19 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:54.230826 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63063dd7-b76d-49ed-8afa-fc142cfbef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:54.231095 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63063dd7-b76d-49ed-8afa-fc142cfbef19 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:54.231940 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63063dd7-b76d-49ed-8afa-fc142cfbef19 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:54.232242 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63063dd7-b76d-49ed-8afa-fc142cfbef19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:54.233883 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63063dd7-b76d-49ed-8afa-fc142cfbef19 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:54.243247 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 438/854] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:35:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:54.249412 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfa7fe-8fb6-4798-9a54-92428894008d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:54.260986 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfa7fe-8fb6-4798-9a54-92428894008d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:54.267182 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d26945-57cb-4177-9841-5fb33be5b086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:54.268455 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d26945-57cb-4177-9841-5fb33be5b086 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:54.268738 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d26945-57cb-4177-9841-5fb33be5b086 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:54.269010 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d26945-57cb-4177-9841-5fb33be5b086 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:54.280443 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d26945-57cb-4177-9841-5fb33be5b086 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:54.282304 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d26945-57cb-4177-9841-5fb33be5b086 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:54.300584 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-61d26945-57cb-4177-9841-5fb33be5b086 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:54.302223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 417/855] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:54.308885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63063dd7-b76d-49ed-8afa-fc142cfbef19 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:54.320029 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63063dd7-b76d-49ed-8afa-fc142cfbef19 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:54.325607 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3769a87-45aa-48d9-9b99-23d214377852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:54.326641 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3769a87-45aa-48d9-9b99-23d214377852 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:54.327125 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3769a87-45aa-48d9-9b99-23d214377852 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:54.327610 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3769a87-45aa-48d9-9b99-23d214377852 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:54.328591 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3769a87-45aa-48d9-9b99-23d214377852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:54.329096 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3769a87-45aa-48d9-9b99-23d214377852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:54.330982 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3769a87-45aa-48d9-9b99-23d214377852 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:54.344775 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 439/856] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:54.350573 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d26945-57cb-4177-9841-5fb33be5b086 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:54.361532 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d26945-57cb-4177-9841-5fb33be5b086 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:54.366431 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095a265-67b1-40d5-831b-e2876615ae3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:54.367574 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095a265-67b1-40d5-831b-e2876615ae3b admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:54.368078 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095a265-67b1-40d5-831b-e2876615ae3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:54.369202 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095a265-67b1-40d5-831b-e2876615ae3b admin admin] PATH_INFO: `/v3/users/swift` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:54.377110 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095a265-67b1-40d5-831b-e2876615ae3b admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:54.379500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095a265-67b1-40d5-831b-e2876615ae3b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:54.394679 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-0095a265-67b1-40d5-831b-e2876615ae3b admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 10 12:35:54.396493 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 418/857] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:35:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:35:54.403043 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3769a87-45aa-48d9-9b99-23d214377852 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:54.413226 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3769a87-45aa-48d9-9b99-23d214377852 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:54.418852 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a64c41-1b63-4ee6-90ba-02c54e6d28b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:54.419873 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a64c41-1b63-4ee6-90ba-02c54e6d28b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:54.420389 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a64c41-1b63-4ee6-90ba-02c54e6d28b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:54.420851 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a64c41-1b63-4ee6-90ba-02c54e6d28b3 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:54.421936 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a64c41-1b63-4ee6-90ba-02c54e6d28b3 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:54.422444 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a64c41-1b63-4ee6-90ba-02c54e6d28b3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:54.424641 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a64c41-1b63-4ee6-90ba-02c54e6d28b3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:54.449786 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 440/858] 10.222.0.13 () {56 vars in 1156 bytes} [Mon Jan 10 12:35:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:54.455658 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095a265-67b1-40d5-831b-e2876615ae3b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:54.472787 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095a265-67b1-40d5-831b-e2876615ae3b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:54.478783 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7dd12c-d337-4111-87b9-2a6b3b84fe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:54.479867 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dd12c-d337-4111-87b9-2a6b3b84fe3b admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:54.480354 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dd12c-d337-4111-87b9-2a6b3b84fe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:54.480823 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dd12c-d337-4111-87b9-2a6b3b84fe3b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:54.495550 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7dd12c-d337-4111-87b9-2a6b3b84fe3b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:54.495550 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7dd12c-d337-4111-87b9-2a6b3b84fe3b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:54.503189 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 419/859] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:54 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:35:54.509620 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a64c41-1b63-4ee6-90ba-02c54e6d28b3 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:54.520234 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a64c41-1b63-4ee6-90ba-02c54e6d28b3 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:54.525992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9455b25-256e-4734-ac11-f4abf3ecc892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:54.527147 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9455b25-256e-4734-ac11-f4abf3ecc892 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:54.527668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9455b25-256e-4734-ac11-f4abf3ecc892 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:54.528157 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9455b25-256e-4734-ac11-f4abf3ecc892 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:54.539579 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9455b25-256e-4734-ac11-f4abf3ecc892 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:54.542049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9455b25-256e-4734-ac11-f4abf3ecc892 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:54.559650 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-d9455b25-256e-4734-ac11-f4abf3ecc892 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:54.561509 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 441/860] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:54.567884 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7dd12c-d337-4111-87b9-2a6b3b84fe3b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:54.577239 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7dd12c-d337-4111-87b9-2a6b3b84fe3b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:54.582066 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96555ce7-7d24-4a00-9866-5517f9994ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:54.583023 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96555ce7-7d24-4a00-9866-5517f9994ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:54.583499 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96555ce7-7d24-4a00-9866-5517f9994ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:54.584056 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96555ce7-7d24-4a00-9866-5517f9994ad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:54.585047 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96555ce7-7d24-4a00-9866-5517f9994ad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:54.585557 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96555ce7-7d24-4a00-9866-5517f9994ad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:54.587499 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96555ce7-7d24-4a00-9866-5517f9994ad0 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:54.600468 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 420/861] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:54.606397 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9455b25-256e-4734-ac11-f4abf3ecc892 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:54.618077 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9455b25-256e-4734-ac11-f4abf3ecc892 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:54.623117 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36bad7-b342-482b-b38f-a90c9d784aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:54.624260 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36bad7-b342-482b-b38f-a90c9d784aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:54.624808 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36bad7-b342-482b-b38f-a90c9d784aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:54.625457 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36bad7-b342-482b-b38f-a90c9d784aa2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:54.633390 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36bad7-b342-482b-b38f-a90c9d784aa2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:54.636037 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36bad7-b342-482b-b38f-a90c9d784aa2 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:54.650060 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-ef36bad7-b342-482b-b38f-a90c9d784aa2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:54.651899 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 442/862] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:54.657892 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96555ce7-7d24-4a00-9866-5517f9994ad0 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:54.668510 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96555ce7-7d24-4a00-9866-5517f9994ad0 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:54.673713 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1a272-b591-4c64-8ddc-ffb4927af621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:54.674654 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1a272-b591-4c64-8ddc-ffb4927af621 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:54.675133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1a272-b591-4c64-8ddc-ffb4927af621 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:54.675644 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1a272-b591-4c64-8ddc-ffb4927af621 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:54.676687 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1a272-b591-4c64-8ddc-ffb4927af621 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:54.677259 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1a272-b591-4c64-8ddc-ffb4927af621 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:54.679476 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1a272-b591-4c64-8ddc-ffb4927af621 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:54.694711 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 421/863] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:54.701265 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36bad7-b342-482b-b38f-a90c9d784aa2 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:54.713771 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36bad7-b342-482b-b38f-a90c9d784aa2 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:54.718892 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2702c94-8465-4faa-95ba-38e913bf87d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:54.719935 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2702c94-8465-4faa-95ba-38e913bf87d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:54.720427 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2702c94-8465-4faa-95ba-38e913bf87d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:54.720938 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2702c94-8465-4faa-95ba-38e913bf87d8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:54.722024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2702c94-8465-4faa-95ba-38e913bf87d8 admin admin] RBAC: Adding query filter params (role.id=9d097c033f454263a874fbafe92c9aea, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=1cd898c7c2974bb38998ebad22fd5a3b) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:54.722561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2702c94-8465-4faa-95ba-38e913bf87d8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:54.724736 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2702c94-8465-4faa-95ba-38e913bf87d8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:54.732246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 443/864] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:54 2022] GET /identity/v3/role_assignments?user.id=1cd898c7c2974bb38998ebad22fd5a3b&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=9d097c033f454263a874fbafe92c9aea => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:54.786632 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e59abc-70c7-4cc0-ba77-7a0495057ac2 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:54.787262 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e59abc-70c7-4cc0-ba77-7a0495057ac2 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:54.787786 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e59abc-70c7-4cc0-ba77-7a0495057ac2 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:54.790176 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 422/865] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:54.797833 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9cde4-a315-4caf-94f0-c0744895b88f None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:54.798480 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9cde4-a315-4caf-94f0-c0744895b88f None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:54.798945 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9cde4-a315-4caf-94f0-c0744895b88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:54.820962 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-d5e9cde4-a315-4caf-94f0-c0744895b88f None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:54.823203 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d5e9cde4-a315-4caf-94f0-c0744895b88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:54.839656 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 444/866] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:54 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:35:54.857030 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e59abc-70c7-4cc0-ba77-7a0495057ac2 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:54.871266 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e59abc-70c7-4cc0-ba77-7a0495057ac2 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:54.876598 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cb070-36ca-4323-bcf4-8aad5341e5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:54.878137 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cb070-36ca-4323-bcf4-8aad5341e5fa admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:54.878750 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cb070-36ca-4323-bcf4-8aad5341e5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:54.879217 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cb070-36ca-4323-bcf4-8aad5341e5fa admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:54.880457 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cb070-36ca-4323-bcf4-8aad5341e5fa admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:54.882433 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cb070-36ca-4323-bcf4-8aad5341e5fa admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:54.897047 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-a66cb070-36ca-4323-bcf4-8aad5341e5fa admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 10 12:35:54.903784 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 423/867] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:35:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:54.906138 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9cde4-a315-4caf-94f0-c0744895b88f None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:54.916263 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9cde4-a315-4caf-94f0-c0744895b88f None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:54.922455 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa4882-2c73-4add-9d8b-edfe0a925f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:54.923728 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa4882-2c73-4add-9d8b-edfe0a925f19 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:54.924269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa4882-2c73-4add-9d8b-edfe0a925f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:54.924760 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa4882-2c73-4add-9d8b-edfe0a925f19 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:54.925794 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa4882-2c73-4add-9d8b-edfe0a925f19 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:54.926384 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa4882-2c73-4add-9d8b-edfe0a925f19 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:54.928489 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa4882-2c73-4add-9d8b-edfe0a925f19 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:54.935848 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 445/868] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:35:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:54.941580 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cb070-36ca-4323-bcf4-8aad5341e5fa admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:54.952561 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cb070-36ca-4323-bcf4-8aad5341e5fa admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:54.957693 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b71f10-cff4-4f0b-ae02-4774c328b5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:54.958519 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b71f10-cff4-4f0b-ae02-4774c328b5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:54.958925 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b71f10-cff4-4f0b-ae02-4774c328b5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:54.959290 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b71f10-cff4-4f0b-ae02-4774c328b5b3 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:54.960231 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b71f10-cff4-4f0b-ae02-4774c328b5b3 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:54.960633 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b71f10-cff4-4f0b-ae02-4774c328b5b3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:54.962606 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b71f10-cff4-4f0b-ae02-4774c328b5b3 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:54.975730 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 424/869] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:35:54 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:55.279241 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a41a01-5667-41c4-8c71-fe6d87561d3e None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:55.279795 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a41a01-5667-41c4-8c71-fe6d87561d3e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:55.279898 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a41a01-5667-41c4-8c71-fe6d87561d3e None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:55.282227 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 446/870] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:55.288641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975175c-c881-4ddf-9999-159db0a3f4e9 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:55.289129 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975175c-c881-4ddf-9999-159db0a3f4e9 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:55.289620 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975175c-c881-4ddf-9999-159db0a3f4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:55.311770 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-f975175c-c881-4ddf-9999-159db0a3f4e9 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:55.312971 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-f975175c-c881-4ddf-9999-159db0a3f4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:55.321658 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 425/871] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:55 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:35:55.351734 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a41a01-5667-41c4-8c71-fe6d87561d3e None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:55.366958 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a41a01-5667-41c4-8c71-fe6d87561d3e None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:55.371648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76101421-55da-4bfb-8526-be2111500738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:55.372316 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76101421-55da-4bfb-8526-be2111500738 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:55.372591 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76101421-55da-4bfb-8526-be2111500738 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:55.372862 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76101421-55da-4bfb-8526-be2111500738 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:55.373607 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76101421-55da-4bfb-8526-be2111500738 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:55.375217 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76101421-55da-4bfb-8526-be2111500738 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:55.391469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 447/872] 10.222.0.13 () {60 vars in 1162 bytes} [Mon Jan 10 12:35:55 2022] POST /identity/v3/services => generated 269 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:35:56.555465 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0d434-464d-4ee3-8276-9092d208d17d None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:56.556107 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0d434-464d-4ee3-8276-9092d208d17d None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:56.556260 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0d434-464d-4ee3-8276-9092d208d17d None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:56.558332 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 426/873] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:56.563709 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c737e-e191-42b7-abff-ecc63f7d7be8 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:56.564528 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c737e-e191-42b7-abff-ecc63f7d7be8 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:56.565366 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c737e-e191-42b7-abff-ecc63f7d7be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:56.583935 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-fe5c737e-e191-42b7-abff-ecc63f7d7be8 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:56.585473 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-fe5c737e-e191-42b7-abff-ecc63f7d7be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:56.603464 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 448/874] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:56 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:35:56.628634 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0d434-464d-4ee3-8276-9092d208d17d None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:56.641310 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0d434-464d-4ee3-8276-9092d208d17d None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:56.645660 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652ee27-312b-4f45-b9ae-ce22237efffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:56.646463 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652ee27-312b-4f45-b9ae-ce22237efffb admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:56.646738 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652ee27-312b-4f45-b9ae-ce22237efffb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:56.647005 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652ee27-312b-4f45-b9ae-ce22237efffb admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:56.657653 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652ee27-312b-4f45-b9ae-ce22237efffb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:56.664910 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-f652ee27-312b-4f45-b9ae-ce22237efffb admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 10 12:35:56.666543 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 427/875] 10.222.0.13 () {56 vars in 1141 bytes} [Mon Jan 10 12:35:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:56.672445 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c737e-e191-42b7-abff-ecc63f7d7be8 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:56.682121 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c737e-e191-42b7-abff-ecc63f7d7be8 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:56.686741 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff706b-416e-4c67-ba41-16ce3c019d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:56.687409 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff706b-416e-4c67-ba41-16ce3c019d25 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:56.687714 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff706b-416e-4c67-ba41-16ce3c019d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:56.687985 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff706b-416e-4c67-ba41-16ce3c019d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:56.688754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff706b-416e-4c67-ba41-16ce3c019d25 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:56.689056 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff706b-416e-4c67-ba41-16ce3c019d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:56.691032 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff706b-416e-4c67-ba41-16ce3c019d25 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:56.700237 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 449/876] 10.222.0.13 () {56 vars in 1136 bytes} [Mon Jan 10 12:35:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:56.705905 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652ee27-312b-4f45-b9ae-ce22237efffb admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:56.715900 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652ee27-312b-4f45-b9ae-ce22237efffb admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:56.720431 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c5b1a-b242-46be-9daf-1bbf60d6bfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:56.721216 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c5b1a-b242-46be-9daf-1bbf60d6bfc9 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:56.721488 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c5b1a-b242-46be-9daf-1bbf60d6bfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:56.721751 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c5b1a-b242-46be-9daf-1bbf60d6bfc9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:56.733180 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c5b1a-b242-46be-9daf-1bbf60d6bfc9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:56.735049 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c5b1a-b242-46be-9daf-1bbf60d6bfc9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:56.751874 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-937c5b1a-b242-46be-9daf-1bbf60d6bfc9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:56.753385 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 428/877] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:56.759104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff706b-416e-4c67-ba41-16ce3c019d25 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:56.769017 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff706b-416e-4c67-ba41-16ce3c019d25 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:56.773583 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afc66a-382f-4a90-8837-fbabb3dc512e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:56.774338 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc66a-382f-4a90-8837-fbabb3dc512e admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:56.774723 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc66a-382f-4a90-8837-fbabb3dc512e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:56.774996 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc66a-382f-4a90-8837-fbabb3dc512e admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:56.775775 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afc66a-382f-4a90-8837-fbabb3dc512e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:56.776132 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afc66a-382f-4a90-8837-fbabb3dc512e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:56.777754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afc66a-382f-4a90-8837-fbabb3dc512e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:56.790436 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 450/878] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:56.796043 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c5b1a-b242-46be-9daf-1bbf60d6bfc9 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:56.805893 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c5b1a-b242-46be-9daf-1bbf60d6bfc9 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:56.810522 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ce885-2a67-4589-8157-237e135cd7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:56.811332 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ce885-2a67-4589-8157-237e135cd7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:56.811633 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ce885-2a67-4589-8157-237e135cd7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:56.811899 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ce885-2a67-4589-8157-237e135cd7d4 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:56.820771 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ce885-2a67-4589-8157-237e135cd7d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:56.823026 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ce885-2a67-4589-8157-237e135cd7d4 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:56.837790 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-bc2ce885-2a67-4589-8157-237e135cd7d4 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 10 12:35:56.839435 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 429/879] 10.222.0.13 () {56 vars in 1138 bytes} [Mon Jan 10 12:35:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:56.845470 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afc66a-382f-4a90-8837-fbabb3dc512e admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:56.856066 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afc66a-382f-4a90-8837-fbabb3dc512e admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:56.861060 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f1f14-f6b6-4655-933c-3e8fe4d33ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:56.861780 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f1f14-f6b6-4655-933c-3e8fe4d33ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:56.862053 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f1f14-f6b6-4655-933c-3e8fe4d33ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:56.862321 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f1f14-f6b6-4655-933c-3e8fe4d33ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:56.863198 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f1f14-f6b6-4655-933c-3e8fe4d33ab4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:56.863507 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f1f14-f6b6-4655-933c-3e8fe4d33ab4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:56.865434 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f1f14-f6b6-4655-933c-3e8fe4d33ab4 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:56.884364 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 451/880] 10.222.0.13 () {56 vars in 1170 bytes} [Mon Jan 10 12:35:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:56.889695 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ce885-2a67-4589-8157-237e135cd7d4 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:56.899681 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ce885-2a67-4589-8157-237e135cd7d4 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:56.904427 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e2065-8c3a-4282-8aab-b56054c13ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:56.905076 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e2065-8c3a-4282-8aab-b56054c13ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:56.905353 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e2065-8c3a-4282-8aab-b56054c13ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:56.905627 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e2065-8c3a-4282-8aab-b56054c13ac0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:56.914014 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e2065-8c3a-4282-8aab-b56054c13ac0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:56.916229 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e2065-8c3a-4282-8aab-b56054c13ac0 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:56.925577 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 430/881] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:35:56 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:35:56.931439 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f1f14-f6b6-4655-933c-3e8fe4d33ab4 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:56.942850 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f1f14-f6b6-4655-933c-3e8fe4d33ab4 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:56.947764 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31f08a-56e3-4fca-b1c1-23be5ec40487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:56.948808 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31f08a-56e3-4fca-b1c1-23be5ec40487 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:56.949261 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31f08a-56e3-4fca-b1c1-23be5ec40487 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:56.949718 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31f08a-56e3-4fca-b1c1-23be5ec40487 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:56.960478 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31f08a-56e3-4fca-b1c1-23be5ec40487 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:56.962581 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31f08a-56e3-4fca-b1c1-23be5ec40487 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:56.979898 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-9d31f08a-56e3-4fca-b1c1-23be5ec40487 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:56.981680 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 452/882] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:56.987364 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e2065-8c3a-4282-8aab-b56054c13ac0 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:56.996673 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e2065-8c3a-4282-8aab-b56054c13ac0 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:57.001402 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a4bbe-5bc0-402b-9e9f-f8ee3c6900a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:57.002288 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a4bbe-5bc0-402b-9e9f-f8ee3c6900a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:57.002737 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a4bbe-5bc0-402b-9e9f-f8ee3c6900a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:57.003182 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a4bbe-5bc0-402b-9e9f-f8ee3c6900a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:57.004127 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a4bbe-5bc0-402b-9e9f-f8ee3c6900a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:57.004605 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a4bbe-5bc0-402b-9e9f-f8ee3c6900a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:57.006436 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a4bbe-5bc0-402b-9e9f-f8ee3c6900a1 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:57.022103 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 431/883] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:57.028198 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31f08a-56e3-4fca-b1c1-23be5ec40487 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:57.038614 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31f08a-56e3-4fca-b1c1-23be5ec40487 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:57.043738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff945b2-92db-46fd-987c-2d3b7288454d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:57.044779 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff945b2-92db-46fd-987c-2d3b7288454d admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:57.045236 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff945b2-92db-46fd-987c-2d3b7288454d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:57.045675 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff945b2-92db-46fd-987c-2d3b7288454d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:57.053228 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff945b2-92db-46fd-987c-2d3b7288454d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:57.055404 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff945b2-92db-46fd-987c-2d3b7288454d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:57.068704 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-9ff945b2-92db-46fd-987c-2d3b7288454d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:35:57.070396 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 453/884] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:35:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:57.076340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a4bbe-5bc0-402b-9e9f-f8ee3c6900a1 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:57.086253 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a4bbe-5bc0-402b-9e9f-f8ee3c6900a1 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:57.091668 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec976206-e1fa-43a5-a6cf-0710313753e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:57.092555 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec976206-e1fa-43a5-a6cf-0710313753e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:57.093005 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec976206-e1fa-43a5-a6cf-0710313753e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:57.093445 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec976206-e1fa-43a5-a6cf-0710313753e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:57.094411 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec976206-e1fa-43a5-a6cf-0710313753e8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:57.094888 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec976206-e1fa-43a5-a6cf-0710313753e8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:57.096934 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec976206-e1fa-43a5-a6cf-0710313753e8 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:57.109437 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 432/885] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:35:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:57.115549 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff945b2-92db-46fd-987c-2d3b7288454d admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:57.126160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff945b2-92db-46fd-987c-2d3b7288454d admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:57.130894 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e6d2c-6ca7-4a4b-8b36-d2cd0b5df42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:57.131800 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e6d2c-6ca7-4a4b-8b36-d2cd0b5df42c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:57.132250 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e6d2c-6ca7-4a4b-8b36-d2cd0b5df42c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:57.132688 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e6d2c-6ca7-4a4b-8b36-d2cd0b5df42c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:57.133701 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e6d2c-6ca7-4a4b-8b36-d2cd0b5df42c admin admin] RBAC: Adding query filter params (role.id=f697c07a4ed645e683846610a1b2e341, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=44e5602fd019411aa8f0e091ed533ae8) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:57.134253 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e6d2c-6ca7-4a4b-8b36-d2cd0b5df42c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:57.136437 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e6d2c-6ca7-4a4b-8b36-d2cd0b5df42c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:57.142487 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 454/886] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:35:57 2022] GET /identity/v3/role_assignments?user.id=44e5602fd019411aa8f0e091ed533ae8&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=f697c07a4ed645e683846610a1b2e341 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:57.323988 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5977a-414d-4b2b-8348-3f49f307f2a3 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:57.324233 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5977a-414d-4b2b-8348-3f49f307f2a3 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:57.324458 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5977a-414d-4b2b-8348-3f49f307f2a3 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:57.326553 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 433/887] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:57.333816 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045817d-2db8-417f-91db-29f639e0aad5 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:57.334119 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045817d-2db8-417f-91db-29f639e0aad5 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:57.334372 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045817d-2db8-417f-91db-29f639e0aad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:57.353085 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-3045817d-2db8-417f-91db-29f639e0aad5 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:57.354292 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-3045817d-2db8-417f-91db-29f639e0aad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:57.362401 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 455/888] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:57 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:35:57.386093 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5977a-414d-4b2b-8348-3f49f307f2a3 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:57.398990 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5977a-414d-4b2b-8348-3f49f307f2a3 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:57.406445 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081ae2c-aebd-44cb-8f6d-02f8eaccbaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:57.410367 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081ae2c-aebd-44cb-8f6d-02f8eaccbaab admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:57.410367 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081ae2c-aebd-44cb-8f6d-02f8eaccbaab admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:57.410367 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081ae2c-aebd-44cb-8f6d-02f8eaccbaab admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:57.410367 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081ae2c-aebd-44cb-8f6d-02f8eaccbaab admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:57.410367 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081ae2c-aebd-44cb-8f6d-02f8eaccbaab admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:57.421805 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-2081ae2c-aebd-44cb-8f6d-02f8eaccbaab admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 10 12:35:57.423310 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 434/889] 10.222.0.13 () {56 vars in 1147 bytes} [Mon Jan 10 12:35:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:57.429339 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045817d-2db8-417f-91db-29f639e0aad5 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:57.439745 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045817d-2db8-417f-91db-29f639e0aad5 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:57.445124 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdd14e-b726-400e-858c-6c42425a4ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:57.446076 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdd14e-b726-400e-858c-6c42425a4ecf admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:57.446589 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdd14e-b726-400e-858c-6c42425a4ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:57.447059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdd14e-b726-400e-858c-6c42425a4ecf admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:57.448026 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdd14e-b726-400e-858c-6c42425a4ecf admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:57.448553 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdd14e-b726-400e-858c-6c42425a4ecf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:57.450364 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdd14e-b726-400e-858c-6c42425a4ecf admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:57.456080 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 456/890] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jan 10 12:35:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:57.461985 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081ae2c-aebd-44cb-8f6d-02f8eaccbaab admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:57.464830 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b43c2-623c-45cb-b629-4db4394a6f55 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:57.465114 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b43c2-623c-45cb-b629-4db4394a6f55 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:57.465384 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b43c2-623c-45cb-b629-4db4394a6f55 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:57.467406 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 457/891] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:57.473535 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be721c4-dfc6-407b-a9c0-8fa2d837a2b8 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:57.474155 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be721c4-dfc6-407b-a9c0-8fa2d837a2b8 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:57.474623 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be721c4-dfc6-407b-a9c0-8fa2d837a2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:57.476995 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081ae2c-aebd-44cb-8f6d-02f8eaccbaab admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:57.482299 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04457404-1258-4cfe-ad67-d16edeb7c9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:57.482985 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04457404-1258-4cfe-ad67-d16edeb7c9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:57.483265 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04457404-1258-4cfe-ad67-d16edeb7c9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:57.484506 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04457404-1258-4cfe-ad67-d16edeb7c9d5 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:57.485391 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04457404-1258-4cfe-ad67-d16edeb7c9d5 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:57.485706 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04457404-1258-4cfe-ad67-d16edeb7c9d5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:57.487366 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04457404-1258-4cfe-ad67-d16edeb7c9d5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:57.494018 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 435/892] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jan 10 12:35:57 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:57.500882 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-4be721c4-dfc6-407b-a9c0-8fa2d837a2b8 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:57.502607 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-4be721c4-dfc6-407b-a9c0-8fa2d837a2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:57.519729 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 458/893] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:57 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:35:57.537515 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04457404-1258-4cfe-ad67-d16edeb7c9d5 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:57.549766 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04457404-1258-4cfe-ad67-d16edeb7c9d5 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:57.555021 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad9b89-23a5-4058-9da3-e5b0ff416e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:57.556398 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad9b89-23a5-4058-9da3-e5b0ff416e56 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:57.557411 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad9b89-23a5-4058-9da3-e5b0ff416e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:57.557882 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad9b89-23a5-4058-9da3-e5b0ff416e56 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:57.558868 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad9b89-23a5-4058-9da3-e5b0ff416e56 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:57.560909 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad9b89-23a5-4058-9da3-e5b0ff416e56 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:57.587935 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 436/894] 10.222.0.13 () {60 vars in 1162 bytes} [Mon Jan 10 12:35:57 2022] POST /identity/v3/services => generated 251 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:35:57.942234 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119c5f6-a789-443a-9823-3e9e622efcdc None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:57.943245 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119c5f6-a789-443a-9823-3e9e622efcdc None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:57.943767 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119c5f6-a789-443a-9823-3e9e622efcdc None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:57.946075 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 459/895] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:57.951421 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf17db-82f7-48ec-9fe0-b4fcd0f8b5ef None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:57.951737 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf17db-82f7-48ec-9fe0-b4fcd0f8b5ef None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:57.952012 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf17db-82f7-48ec-9fe0-b4fcd0f8b5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:57.970194 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-0bbf17db-82f7-48ec-9fe0-b4fcd0f8b5ef None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:57.971789 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-0bbf17db-82f7-48ec-9fe0-b4fcd0f8b5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:57.989673 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 437/896] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:57 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:35:58.013856 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119c5f6-a789-443a-9823-3e9e622efcdc None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:58.027029 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119c5f6-a789-443a-9823-3e9e622efcdc None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:58.031388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eaaa30-e0dc-4da7-8ec2-acbecc750298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:58.032234 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eaaa30-e0dc-4da7-8ec2-acbecc750298 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:58.032509 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eaaa30-e0dc-4da7-8ec2-acbecc750298 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:58.032772 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eaaa30-e0dc-4da7-8ec2-acbecc750298 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:58.033448 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eaaa30-e0dc-4da7-8ec2-acbecc750298 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:58.035055 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eaaa30-e0dc-4da7-8ec2-acbecc750298 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:58.046802 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-e9eaaa30-e0dc-4da7-8ec2-acbecc750298 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 10 12:35:58.048399 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 460/897] 10.222.0.13 () {56 vars in 1153 bytes} [Mon Jan 10 12:35:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:58.056954 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf17db-82f7-48ec-9fe0-b4fcd0f8b5ef None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:58.066376 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf17db-82f7-48ec-9fe0-b4fcd0f8b5ef None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:58.070855 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3031d-9adf-4584-b10f-9cc25c598c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:58.071643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3031d-9adf-4584-b10f-9cc25c598c6f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:58.071928 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3031d-9adf-4584-b10f-9cc25c598c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:58.072196 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3031d-9adf-4584-b10f-9cc25c598c6f admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:58.072920 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3031d-9adf-4584-b10f-9cc25c598c6f admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:58.073220 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3031d-9adf-4584-b10f-9cc25c598c6f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:58.074808 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3031d-9adf-4584-b10f-9cc25c598c6f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:58.079967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 438/898] 10.222.0.13 () {56 vars in 1147 bytes} [Mon Jan 10 12:35:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:58.085435 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eaaa30-e0dc-4da7-8ec2-acbecc750298 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:58.095819 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eaaa30-e0dc-4da7-8ec2-acbecc750298 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:58.100849 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c1442-c9fb-418a-9a51-eb5b4f6e44a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:58.101797 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c1442-c9fb-418a-9a51-eb5b4f6e44a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:58.102292 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c1442-c9fb-418a-9a51-eb5b4f6e44a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:58.102862 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c1442-c9fb-418a-9a51-eb5b4f6e44a8 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:58.104030 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c1442-c9fb-418a-9a51-eb5b4f6e44a8 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:58.104549 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c1442-c9fb-418a-9a51-eb5b4f6e44a8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:58.106423 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c1442-c9fb-418a-9a51-eb5b4f6e44a8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:58.112050 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 461/899] 10.222.0.13 () {56 vars in 1147 bytes} [Mon Jan 10 12:35:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:58.117962 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3031d-9adf-4584-b10f-9cc25c598c6f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:58.128613 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3031d-9adf-4584-b10f-9cc25c598c6f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:58.133497 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c60e34-f664-4965-8b38-b5146c454780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:58.134632 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c60e34-f664-4965-8b38-b5146c454780 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:58.135114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c60e34-f664-4965-8b38-b5146c454780 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:58.135697 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c60e34-f664-4965-8b38-b5146c454780 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:58.136713 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c60e34-f664-4965-8b38-b5146c454780 admin admin] RBAC: Adding query filter params (interface=public, service_id=689878e1847548788727aafdf3a27469, region_id=RegionOne) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:58.137254 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c60e34-f664-4965-8b38-b5146c454780 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:58.138654 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-15c60e34-f664-4965-8b38-b5146c454780 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:35:58.138654 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:35:58.138654 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:35:58.139895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c60e34-f664-4965-8b38-b5146c454780 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:58.147997 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 439/900] 10.222.0.13 () {56 vars in 1272 bytes} [Mon Jan 10 12:35:58 2022] GET /identity/v3/endpoints?service_id=689878e1847548788727aafdf3a27469&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:58.153748 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c1442-c9fb-418a-9a51-eb5b4f6e44a8 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:58.163953 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c1442-c9fb-418a-9a51-eb5b4f6e44a8 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:58.168867 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f89e4-e186-44a8-9743-6e67647cc80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:58.169797 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f89e4-e186-44a8-9743-6e67647cc80e admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:58.170277 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f89e4-e186-44a8-9743-6e67647cc80e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:58.170888 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f89e4-e186-44a8-9743-6e67647cc80e admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:58.171815 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f89e4-e186-44a8-9743-6e67647cc80e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:58.173696 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f89e4-e186-44a8-9743-6e67647cc80e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:58.179974 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 462/901] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jan 10 12:35:58 2022] GET /identity/v3/services => generated 1268 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:35:59.583680 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6862a-9407-4182-8556-f5e2a81daf92 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:59.584236 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6862a-9407-4182-8556-f5e2a81daf92 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:59.584236 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6862a-9407-4182-8556-f5e2a81daf92 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:59.586229 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 440/902] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:59.591868 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e410045-a6c6-4810-a800-a7c20094acf4 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:59.592298 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e410045-a6c6-4810-a800-a7c20094acf4 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:59.592396 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e410045-a6c6-4810-a800-a7c20094acf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:59.610382 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-1e410045-a6c6-4810-a800-a7c20094acf4 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:59.611614 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-1e410045-a6c6-4810-a800-a7c20094acf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:35:59.619726 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 463/903] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:59 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:35:59.648315 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6862a-9407-4182-8556-f5e2a81daf92 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:59.661350 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6862a-9407-4182-8556-f5e2a81daf92 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:59.666115 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6886a1-cd7d-4e36-8d5e-99879f80ae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:59.666946 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6886a1-cd7d-4e36-8d5e-99879f80ae1d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:59.667221 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6886a1-cd7d-4e36-8d5e-99879f80ae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:59.667490 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6886a1-cd7d-4e36-8d5e-99879f80ae1d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:59.681479 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6886a1-cd7d-4e36-8d5e-99879f80ae1d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:35:59.688893 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-cb6886a1-cd7d-4e36-8d5e-99879f80ae1d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 10 12:35:59.690757 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 441/904] 10.222.0.13 () {56 vars in 1141 bytes} [Mon Jan 10 12:35:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:59.696729 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e410045-a6c6-4810-a800-a7c20094acf4 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:59.705753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e410045-a6c6-4810-a800-a7c20094acf4 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:59.710390 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6b31b-771c-4c6e-9309-d3ca6fa94944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:59.711059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6b31b-771c-4c6e-9309-d3ca6fa94944 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:59.711340 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6b31b-771c-4c6e-9309-d3ca6fa94944 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:59.711633 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6b31b-771c-4c6e-9309-d3ca6fa94944 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:59.712471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6b31b-771c-4c6e-9309-d3ca6fa94944 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:59.712763 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6b31b-771c-4c6e-9309-d3ca6fa94944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:59.714537 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6b31b-771c-4c6e-9309-d3ca6fa94944 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:59.723343 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 464/905] 10.222.0.13 () {56 vars in 1136 bytes} [Mon Jan 10 12:35:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:35:59.729478 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6886a1-cd7d-4e36-8d5e-99879f80ae1d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:59.740265 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6886a1-cd7d-4e36-8d5e-99879f80ae1d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:59.749058 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47859f8-a2c9-4273-ba8c-dd8864accfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:59.749863 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47859f8-a2c9-4273-ba8c-dd8864accfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:59.750143 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47859f8-a2c9-4273-ba8c-dd8864accfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:59.750412 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47859f8-a2c9-4273-ba8c-dd8864accfd6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:59.761196 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47859f8-a2c9-4273-ba8c-dd8864accfd6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:59.763152 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47859f8-a2c9-4273-ba8c-dd8864accfd6 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:59.779979 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-e47859f8-a2c9-4273-ba8c-dd8864accfd6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:59.781463 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 442/906] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:59.787113 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6b31b-771c-4c6e-9309-d3ca6fa94944 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:59.797054 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6b31b-771c-4c6e-9309-d3ca6fa94944 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:59.801498 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4d1f-084b-4e88-b5b7-3a189bf24392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:59.802205 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4d1f-084b-4e88-b5b7-3a189bf24392 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:59.802484 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4d1f-084b-4e88-b5b7-3a189bf24392 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:59.802749 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4d1f-084b-4e88-b5b7-3a189bf24392 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:59.803481 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa4d1f-084b-4e88-b5b7-3a189bf24392 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:59.803833 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa4d1f-084b-4e88-b5b7-3a189bf24392 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:59.805420 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa4d1f-084b-4e88-b5b7-3a189bf24392 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:59.818419 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 465/907] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:59.824422 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47859f8-a2c9-4273-ba8c-dd8864accfd6 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:59.834130 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47859f8-a2c9-4273-ba8c-dd8864accfd6 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:59.838798 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232683a8-87de-4c09-beba-30c18275f084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:59.839630 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232683a8-87de-4c09-beba-30c18275f084 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:59.839908 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232683a8-87de-4c09-beba-30c18275f084 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:59.840173 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232683a8-87de-4c09-beba-30c18275f084 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:59.847632 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232683a8-87de-4c09-beba-30c18275f084 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:59.849644 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232683a8-87de-4c09-beba-30c18275f084 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:59.863597 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-232683a8-87de-4c09-beba-30c18275f084 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 10 12:35:59.865049 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 443/908] 10.222.0.13 () {56 vars in 1138 bytes} [Mon Jan 10 12:35:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:59.870816 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4d1f-084b-4e88-b5b7-3a189bf24392 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:59.880648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4d1f-084b-4e88-b5b7-3a189bf24392 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:59.885250 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d3ecb-9de6-4e06-9123-9e05b5f4f7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:59.885929 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d3ecb-9de6-4e06-9123-9e05b5f4f7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:59.886209 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d3ecb-9de6-4e06-9123-9e05b5f4f7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:59.886479 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d3ecb-9de6-4e06-9123-9e05b5f4f7e5 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:59.887334 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d3ecb-9de6-4e06-9123-9e05b5f4f7e5 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:59.887669 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d3ecb-9de6-4e06-9123-9e05b5f4f7e5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:59.889646 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d3ecb-9de6-4e06-9123-9e05b5f4f7e5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:59.907462 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 466/909] 10.222.0.13 () {56 vars in 1170 bytes} [Mon Jan 10 12:35:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:35:59.913024 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232683a8-87de-4c09-beba-30c18275f084 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:59.923242 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232683a8-87de-4c09-beba-30c18275f084 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:59.928585 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc8d00-1e09-4da3-9cef-0f04d467f5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:59.929387 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc8d00-1e09-4da3-9cef-0f04d467f5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:59.929770 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc8d00-1e09-4da3-9cef-0f04d467f5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:59.930023 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc8d00-1e09-4da3-9cef-0f04d467f5d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:59.941689 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc8d00-1e09-4da3-9cef-0f04d467f5d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:59.943569 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc8d00-1e09-4da3-9cef-0f04d467f5d4 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:59.960582 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-e8fc8d00-1e09-4da3-9cef-0f04d467f5d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:35:59.962147 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 444/910] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:35:59.965383 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25344656-4030-4c9a-9d20-efffc7de21a0 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:59.965667 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25344656-4030-4c9a-9d20-efffc7de21a0 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:59.965939 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25344656-4030-4c9a-9d20-efffc7de21a0 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:59.967736 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 467/911] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:35:59.972330 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc8d00-1e09-4da3-9cef-0f04d467f5d4 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:35:59.974079 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51f9a8-c5db-4df2-aa84-6a86d602c192 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:59.974574 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51f9a8-c5db-4df2-aa84-6a86d602c192 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:59.975039 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51f9a8-c5db-4df2-aa84-6a86d602c192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:59.982312 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc8d00-1e09-4da3-9cef-0f04d467f5d4 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:35:59.986934 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b0e54-557a-497f-94ca-d359c11d73d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:35:59.987623 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b0e54-557a-497f-94ca-d359c11d73d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:35:59.987904 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b0e54-557a-497f-94ca-d359c11d73d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:35:59.988178 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b0e54-557a-497f-94ca-d359c11d73d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:35:59.988924 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b0e54-557a-497f-94ca-d359c11d73d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:35:59.989218 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b0e54-557a-497f-94ca-d359c11d73d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:35:59.990825 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b0e54-557a-497f-94ca-d359c11d73d2 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:35:59.995130 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-ef51f9a8-c5db-4df2-aa84-6a86d602c192 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:35:59.996596 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ef51f9a8-c5db-4df2-aa84-6a86d602c192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:00.003219 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 445/912] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:00.008974 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 468/913] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:35:59 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:00.010964 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b0e54-557a-497f-94ca-d359c11d73d2 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:00.024834 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b0e54-557a-497f-94ca-d359c11d73d2 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:00.029811 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7ea6c-8044-4608-83ea-20c3fadc72c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:00.030846 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7ea6c-8044-4608-83ea-20c3fadc72c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:00.031380 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7ea6c-8044-4608-83ea-20c3fadc72c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:00.031891 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7ea6c-8044-4608-83ea-20c3fadc72c4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:00.037261 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51f9a8-c5db-4df2-aa84-6a86d602c192 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:00.043441 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7ea6c-8044-4608-83ea-20c3fadc72c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:00.045710 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7ea6c-8044-4608-83ea-20c3fadc72c4 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:00.046309 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51f9a8-c5db-4df2-aa84-6a86d602c192 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:00.051330 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25415d96-d55a-436b-931e-703654411c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:00.052027 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25415d96-d55a-436b-931e-703654411c44 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:00.052302 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25415d96-d55a-436b-931e-703654411c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:00.052570 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25415d96-d55a-436b-931e-703654411c44 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:00.053325 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25415d96-d55a-436b-931e-703654411c44 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:00.055206 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25415d96-d55a-436b-931e-703654411c44 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:00.062135 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-c5a7ea6c-8044-4608-83ea-20c3fadc72c4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:36:00.064026 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 446/914] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:36:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:36:00.072828 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7ea6c-8044-4608-83ea-20c3fadc72c4 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:00.082299 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7ea6c-8044-4608-83ea-20c3fadc72c4 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:00.083973 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 469/915] 10.222.0.13 () {60 vars in 1162 bytes} [Mon Jan 10 12:36:00 2022] POST /identity/v3/services => generated 241 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:36:00.107229 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5c54a-d26d-4cdb-afbd-72e853c4d883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:00.108296 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5c54a-d26d-4cdb-afbd-72e853c4d883 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:00.108780 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5c54a-d26d-4cdb-afbd-72e853c4d883 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:00.109222 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5c54a-d26d-4cdb-afbd-72e853c4d883 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:00.110255 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5c54a-d26d-4cdb-afbd-72e853c4d883 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:00.110799 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5c54a-d26d-4cdb-afbd-72e853c4d883 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:00.113054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5c54a-d26d-4cdb-afbd-72e853c4d883 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:00.126068 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade9c13-d489-46be-93b5-1a324f50d970 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:00.126384 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade9c13-d489-46be-93b5-1a324f50d970 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:00.127458 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade9c13-d489-46be-93b5-1a324f50d970 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:00.129842 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 470/916] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:00.129982 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 447/917] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:36:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:36:00.136052 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735f767-ffd0-487b-a807-eb47aa577817 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:00.136337 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735f767-ffd0-487b-a807-eb47aa577817 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:00.136597 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735f767-ffd0-487b-a807-eb47aa577817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:00.139694 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5c54a-d26d-4cdb-afbd-72e853c4d883 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:00.150398 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5c54a-d26d-4cdb-afbd-72e853c4d883 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:00.155842 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f320cd7-187b-47d8-be98-a064c505372a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:00.157123 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f320cd7-187b-47d8-be98-a064c505372a admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:00.157665 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f320cd7-187b-47d8-be98-a064c505372a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:00.158138 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f320cd7-187b-47d8-be98-a064c505372a admin admin] PATH_INFO: `/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/44e5602fd019411aa8f0e091ed533ae8/roles/f697c07a4ed645e683846610a1b2e341` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:00.158560 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-a735f767-ffd0-487b-a807-eb47aa577817 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:00.159855 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-a735f767-ffd0-487b-a807-eb47aa577817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:00.161274 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f320cd7-187b-47d8-be98-a064c505372a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0105f8c08c84f538cd7ba86fcd26b62, user_id=44e5602fd019411aa8f0e091ed533ae8, role_id=f697c07a4ed645e683846610a1b2e341)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:00.164535 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f320cd7-187b-47d8-be98-a064c505372a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:00.175540 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 471/918] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:00 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:00.187376 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 448/919] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:36:00 2022] PUT /identity/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/44e5602fd019411aa8f0e091ed533ae8/roles/f697c07a4ed645e683846610a1b2e341 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:36:00.196313 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735f767-ffd0-487b-a807-eb47aa577817 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:00.207033 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735f767-ffd0-487b-a807-eb47aa577817 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:00.281446 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40099d2d-db16-45e2-a6a8-5a05420688f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:00.282293 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40099d2d-db16-45e2-a6a8-5a05420688f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:00.282570 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40099d2d-db16-45e2-a6a8-5a05420688f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:00.282836 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40099d2d-db16-45e2-a6a8-5a05420688f2 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:00.283571 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40099d2d-db16-45e2-a6a8-5a05420688f2 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:00.285324 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40099d2d-db16-45e2-a6a8-5a05420688f2 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:00.300439 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-40099d2d-db16-45e2-a6a8-5a05420688f2 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 10 12:36:00.302135 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 472/920] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:36:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:00.308453 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f320cd7-187b-47d8-be98-a064c505372a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:00.319953 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f320cd7-187b-47d8-be98-a064c505372a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:00.325423 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85544747-8fbe-489c-85f8-be58bcf4c70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:00.326521 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85544747-8fbe-489c-85f8-be58bcf4c70e admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:00.327072 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85544747-8fbe-489c-85f8-be58bcf4c70e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:00.327566 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85544747-8fbe-489c-85f8-be58bcf4c70e admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:00.328579 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85544747-8fbe-489c-85f8-be58bcf4c70e admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:00.329125 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85544747-8fbe-489c-85f8-be58bcf4c70e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:00.331109 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85544747-8fbe-489c-85f8-be58bcf4c70e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:00.337579 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 449/921] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:36:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:00.344442 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40099d2d-db16-45e2-a6a8-5a05420688f2 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:00.359753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40099d2d-db16-45e2-a6a8-5a05420688f2 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:00.364348 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7e72f-2cc6-4596-b35f-753512fe0a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:00.365065 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7e72f-2cc6-4596-b35f-753512fe0a80 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:00.365341 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7e72f-2cc6-4596-b35f-753512fe0a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:00.365614 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7e72f-2cc6-4596-b35f-753512fe0a80 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:00.366348 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7e72f-2cc6-4596-b35f-753512fe0a80 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:00.366650 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7e72f-2cc6-4596-b35f-753512fe0a80 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:00.368412 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7e72f-2cc6-4596-b35f-753512fe0a80 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:00.374590 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 473/922] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:36:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:00.380504 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85544747-8fbe-489c-85f8-be58bcf4c70e admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:00.391681 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85544747-8fbe-489c-85f8-be58bcf4c70e admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:00.396404 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7ccc9-e916-471f-8ab6-46d19ade46a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:00.397086 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7ccc9-e916-471f-8ab6-46d19ade46a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:00.397415 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7ccc9-e916-471f-8ab6-46d19ade46a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:00.397681 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7ccc9-e916-471f-8ab6-46d19ade46a4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:00.398550 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7ccc9-e916-471f-8ab6-46d19ade46a4 admin admin] RBAC: Adding query filter params (interface=public, service_id=a189406d65444945b19e6978e7a0268e, region_id=RegionOne) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:00.398858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7ccc9-e916-471f-8ab6-46d19ade46a4 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:00.400821 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7ccc9-e916-471f-8ab6-46d19ade46a4 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:00.407297 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 450/923] 10.222.0.13 () {56 vars in 1272 bytes} [Mon Jan 10 12:36:00 2022] GET /identity/v3/endpoints?service_id=a189406d65444945b19e6978e7a0268e&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:36:00.413536 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7e72f-2cc6-4596-b35f-753512fe0a80 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:00.424389 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7e72f-2cc6-4596-b35f-753512fe0a80 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:00.429332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0bb4e-ce60-4ad7-b0d3-b35ac7b469ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:00.430235 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0bb4e-ce60-4ad7-b0d3-b35ac7b469ad admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:00.430661 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0bb4e-ce60-4ad7-b0d3-b35ac7b469ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:00.431137 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0bb4e-ce60-4ad7-b0d3-b35ac7b469ad admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:00.432144 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0bb4e-ce60-4ad7-b0d3-b35ac7b469ad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:00.433931 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0bb4e-ce60-4ad7-b0d3-b35ac7b469ad admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:00.441762 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 474/924] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jan 10 12:36:00 2022] GET /identity/v3/services => generated 1497 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:36:00.717168 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18364b2-6db4-430a-b371-227bc0b23663 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:00.717870 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18364b2-6db4-430a-b371-227bc0b23663 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:00.717870 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18364b2-6db4-430a-b371-227bc0b23663 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:00.719637 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 451/925] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:00.724858 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5b416-2c01-4db6-88b3-8711d0dfacce None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:00.725320 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5b416-2c01-4db6-88b3-8711d0dfacce None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:00.725471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5b416-2c01-4db6-88b3-8711d0dfacce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:00.751286 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-7dc5b416-2c01-4db6-88b3-8711d0dfacce None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:00.752521 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-7dc5b416-2c01-4db6-88b3-8711d0dfacce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:00.760771 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 475/926] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:00 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:00.784694 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18364b2-6db4-430a-b371-227bc0b23663 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:00.800534 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18364b2-6db4-430a-b371-227bc0b23663 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:00.804493 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb8d7f-72bb-4759-924d-8fa1d3df4a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:00.805479 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb8d7f-72bb-4759-924d-8fa1d3df4a16 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:00.805976 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb8d7f-72bb-4759-924d-8fa1d3df4a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:00.806426 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb8d7f-72bb-4759-924d-8fa1d3df4a16 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:00.807296 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb8d7f-72bb-4759-924d-8fa1d3df4a16 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:00.809095 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb8d7f-72bb-4759-924d-8fa1d3df4a16 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:00.821097 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-3fdb8d7f-72bb-4759-924d-8fa1d3df4a16 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 10 12:36:00.823019 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 452/927] 10.222.0.13 () {56 vars in 1153 bytes} [Mon Jan 10 12:36:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:00.829112 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5b416-2c01-4db6-88b3-8711d0dfacce None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:00.838522 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5b416-2c01-4db6-88b3-8711d0dfacce None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:00.843354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f64453-e541-4efd-9dc0-5e037bacfdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:00.844280 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f64453-e541-4efd-9dc0-5e037bacfdf1 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:00.844726 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f64453-e541-4efd-9dc0-5e037bacfdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:00.845178 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f64453-e541-4efd-9dc0-5e037bacfdf1 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:00.846074 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f64453-e541-4efd-9dc0-5e037bacfdf1 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:00.846582 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f64453-e541-4efd-9dc0-5e037bacfdf1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:00.848357 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f64453-e541-4efd-9dc0-5e037bacfdf1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:00.854043 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 476/928] 10.222.0.13 () {56 vars in 1147 bytes} [Mon Jan 10 12:36:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:00.859719 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb8d7f-72bb-4759-924d-8fa1d3df4a16 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:00.870793 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb8d7f-72bb-4759-924d-8fa1d3df4a16 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:00.875686 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5ea21-29ab-4c79-a9fa-9f3a6068da05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:00.876566 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5ea21-29ab-4c79-a9fa-9f3a6068da05 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:00.877011 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5ea21-29ab-4c79-a9fa-9f3a6068da05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:00.877447 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5ea21-29ab-4c79-a9fa-9f3a6068da05 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:00.878378 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5ea21-29ab-4c79-a9fa-9f3a6068da05 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:00.878866 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5ea21-29ab-4c79-a9fa-9f3a6068da05 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:00.880722 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5ea21-29ab-4c79-a9fa-9f3a6068da05 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:00.887305 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 453/929] 10.222.0.13 () {56 vars in 1147 bytes} [Mon Jan 10 12:36:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:36:00.893116 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f64453-e541-4efd-9dc0-5e037bacfdf1 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:00.903391 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f64453-e541-4efd-9dc0-5e037bacfdf1 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:00.908163 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02da56-dc75-4fc6-8071-a08bf591e553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:00.909030 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02da56-dc75-4fc6-8071-a08bf591e553 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:00.909509 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02da56-dc75-4fc6-8071-a08bf591e553 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:00.910007 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02da56-dc75-4fc6-8071-a08bf591e553 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:00.910938 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02da56-dc75-4fc6-8071-a08bf591e553 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:00.912228 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING py.warnings [None req-fb02da56-dc75-4fc6-8071-a08bf591e553 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:36:00.912228 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: warnings.warn(msg) Jan 10 12:36:00.912228 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: Jan 10 12:36:00.913456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02da56-dc75-4fc6-8071-a08bf591e553 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:00.939207 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 477/930] 10.222.0.13 () {60 vars in 1165 bytes} [Mon Jan 10 12:36:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:36:02.597391 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4c521-43b8-4447-8f22-b8479920c7cb None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:02.598435 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4c521-43b8-4447-8f22-b8479920c7cb None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:02.598905 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4c521-43b8-4447-8f22-b8479920c7cb None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:02.601321 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 454/931] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:02.606852 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3b834-eacf-46a1-8e73-0470544a55d6 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:02.607352 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3b834-eacf-46a1-8e73-0470544a55d6 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:02.607439 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3b834-eacf-46a1-8e73-0470544a55d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:02.625223 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-88d3b834-eacf-46a1-8e73-0470544a55d6 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:02.626400 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-88d3b834-eacf-46a1-8e73-0470544a55d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:02.638689 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c62ea-e1cb-434c-ad33-814f433ebdf7 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:02.638974 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c62ea-e1cb-434c-ad33-814f433ebdf7 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:02.639239 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c62ea-e1cb-434c-ad33-814f433ebdf7 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:02.641054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 455/932] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:36:02.645435 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 478/933] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:02 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:36:02.646865 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebffbd2-bf09-4271-853d-5a89557fc6ea None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:02.647147 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebffbd2-bf09-4271-853d-5a89557fc6ea None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:02.647419 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebffbd2-bf09-4271-853d-5a89557fc6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:02.667079 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-8ebffbd2-bf09-4271-853d-5a89557fc6ea None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:02.668633 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-8ebffbd2-bf09-4271-853d-5a89557fc6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:02.672249 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3b834-eacf-46a1-8e73-0470544a55d6 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:02.682265 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3b834-eacf-46a1-8e73-0470544a55d6 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:02.682599 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 456/934] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:02 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:02.686857 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e29ca3-ef43-43b8-94c7-e5a4a95d8f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:02.687703 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e29ca3-ef43-43b8-94c7-e5a4a95d8f5b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:02.687980 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e29ca3-ef43-43b8-94c7-e5a4a95d8f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:02.688255 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e29ca3-ef43-43b8-94c7-e5a4a95d8f5b admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:02.688915 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e29ca3-ef43-43b8-94c7-e5a4a95d8f5b admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:02.690887 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e29ca3-ef43-43b8-94c7-e5a4a95d8f5b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:02.702923 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-d8e29ca3-ef43-43b8-94c7-e5a4a95d8f5b admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 10 12:36:02.704464 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 479/935] 10.222.0.13 () {56 vars in 1147 bytes} [Mon Jan 10 12:36:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:36:02.705717 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebffbd2-bf09-4271-853d-5a89557fc6ea None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:02.710163 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e29ca3-ef43-43b8-94c7-e5a4a95d8f5b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:02.715481 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebffbd2-bf09-4271-853d-5a89557fc6ea None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:02.720260 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35babb-5cca-45c5-aee3-2d0fcc3bbcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:02.721059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e29ca3-ef43-43b8-94c7-e5a4a95d8f5b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:02.721549 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35babb-5cca-45c5-aee3-2d0fcc3bbcee admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:02.722028 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35babb-5cca-45c5-aee3-2d0fcc3bbcee admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:02.722508 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35babb-5cca-45c5-aee3-2d0fcc3bbcee admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:02.725514 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7aee7-c9b6-4f60-a9f9-b1cd1745e26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:02.726168 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7aee7-c9b6-4f60-a9f9-b1cd1745e26c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:02.726439 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7aee7-c9b6-4f60-a9f9-b1cd1745e26c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:02.726703 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7aee7-c9b6-4f60-a9f9-b1cd1745e26c admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:02.727415 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7aee7-c9b6-4f60-a9f9-b1cd1745e26c admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:02.728746 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7aee7-c9b6-4f60-a9f9-b1cd1745e26c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:02.730349 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7aee7-c9b6-4f60-a9f9-b1cd1745e26c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:02.735843 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 480/936] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jan 10 12:36:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:36:02.742207 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7aee7-c9b6-4f60-a9f9-b1cd1745e26c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:02.743292 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35babb-5cca-45c5-aee3-2d0fcc3bbcee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:36:02.750728 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-5a35babb-5cca-45c5-aee3-2d0fcc3bbcee admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 10 12:36:02.751850 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7aee7-c9b6-4f60-a9f9-b1cd1745e26c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:02.757233 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde84bd-2b3b-4f55-bf0b-55673236bc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:02.757233 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde84bd-2b3b-4f55-bf0b-55673236bc7b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:02.757233 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde84bd-2b3b-4f55-bf0b-55673236bc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:02.757621 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 457/937] 10.222.0.13 () {56 vars in 1141 bytes} [Mon Jan 10 12:36:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:02.757887 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde84bd-2b3b-4f55-bf0b-55673236bc7b admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:02.758648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde84bd-2b3b-4f55-bf0b-55673236bc7b admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:02.759152 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35babb-5cca-45c5-aee3-2d0fcc3bbcee admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:02.759436 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde84bd-2b3b-4f55-bf0b-55673236bc7b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:02.761422 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde84bd-2b3b-4f55-bf0b-55673236bc7b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:02.767081 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 481/938] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jan 10 12:36:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:36:02.769546 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35babb-5cca-45c5-aee3-2d0fcc3bbcee admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:02.772855 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde84bd-2b3b-4f55-bf0b-55673236bc7b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:02.776083 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab6cb9-2276-4ef4-a4f1-da400720076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:02.776951 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab6cb9-2276-4ef4-a4f1-da400720076a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:02.777495 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab6cb9-2276-4ef4-a4f1-da400720076a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:02.777935 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab6cb9-2276-4ef4-a4f1-da400720076a admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:02.778882 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab6cb9-2276-4ef4-a4f1-da400720076a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:02.779357 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab6cb9-2276-4ef4-a4f1-da400720076a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:02.781229 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab6cb9-2276-4ef4-a4f1-da400720076a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:02.783620 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde84bd-2b3b-4f55-bf0b-55673236bc7b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:02.788251 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a44cc-005a-49fe-9f10-fbca553b3b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:02.788979 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a44cc-005a-49fe-9f10-fbca553b3b62 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:02.789326 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a44cc-005a-49fe-9f10-fbca553b3b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:02.789658 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a44cc-005a-49fe-9f10-fbca553b3b62 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:02.790836 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a44cc-005a-49fe-9f10-fbca553b3b62 admin admin] RBAC: Adding query filter params (interface=public, service_id=51f047868903471593c2b33d97f4d00c, region_id=RegionOne) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:02.791207 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a44cc-005a-49fe-9f10-fbca553b3b62 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:02.796418 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a44cc-005a-49fe-9f10-fbca553b3b62 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:02.796629 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 458/939] 10.222.0.13 () {56 vars in 1136 bytes} [Mon Jan 10 12:36:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:02.798163 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab6cb9-2276-4ef4-a4f1-da400720076a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:02.799169 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 482/940] 10.222.0.13 () {56 vars in 1272 bytes} [Mon Jan 10 12:36:02 2022] GET /identity/v3/endpoints?service_id=51f047868903471593c2b33d97f4d00c&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:36:02.804404 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a44cc-005a-49fe-9f10-fbca553b3b62 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:02.808123 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab6cb9-2276-4ef4-a4f1-da400720076a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:02.812817 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993bb15-2e35-4645-ab4c-139f36eecd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:02.813806 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993bb15-2e35-4645-ab4c-139f36eecd96 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:02.814279 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993bb15-2e35-4645-ab4c-139f36eecd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:02.814729 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993bb15-2e35-4645-ab4c-139f36eecd96 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:02.815749 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a44cc-005a-49fe-9f10-fbca553b3b62 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:02.820361 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44de8ac-c3f2-4b24-857d-be987cbd7443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:02.821094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44de8ac-c3f2-4b24-857d-be987cbd7443 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:02.821571 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44de8ac-c3f2-4b24-857d-be987cbd7443 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:02.822541 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44de8ac-c3f2-4b24-857d-be987cbd7443 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:02.823303 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44de8ac-c3f2-4b24-857d-be987cbd7443 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:02.825090 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44de8ac-c3f2-4b24-857d-be987cbd7443 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:02.827853 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993bb15-2e35-4645-ab4c-139f36eecd96 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:02.829754 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993bb15-2e35-4645-ab4c-139f36eecd96 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:02.833240 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 483/941] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jan 10 12:36:02 2022] GET /identity/v3/services => generated 1497 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:36:02.850077 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-8993bb15-2e35-4645-ab4c-139f36eecd96 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:36:02.856941 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 459/942] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:36:02.858693 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44de8ac-c3f2-4b24-857d-be987cbd7443 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:02.872468 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44de8ac-c3f2-4b24-857d-be987cbd7443 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:02.878186 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d353c-5669-4f09-8536-338b57cb6ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:02.879172 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d353c-5669-4f09-8536-338b57cb6ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:02.879666 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d353c-5669-4f09-8536-338b57cb6ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:02.880134 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d353c-5669-4f09-8536-338b57cb6ed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:02.881063 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d353c-5669-4f09-8536-338b57cb6ed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:02.881542 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d353c-5669-4f09-8536-338b57cb6ed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:02.883392 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d353c-5669-4f09-8536-338b57cb6ed2 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:02.901132 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 484/943] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:02.903899 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993bb15-2e35-4645-ab4c-139f36eecd96 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:02.914919 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993bb15-2e35-4645-ab4c-139f36eecd96 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:02.919941 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b6d03-4345-4485-a7da-861a09a58d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:02.922807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffff9f-3851-49b2-a261-79f48ef737f8 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:02.923300 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffff9f-3851-49b2-a261-79f48ef737f8 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:02.923810 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffff9f-3851-49b2-a261-79f48ef737f8 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:02.925892 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 485/944] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:36:02.926271 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b6d03-4345-4485-a7da-861a09a58d28 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:02.926813 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b6d03-4345-4485-a7da-861a09a58d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:02.927391 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b6d03-4345-4485-a7da-861a09a58d28 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:02.932807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbf9ce-0418-4cbb-8260-c379c86e5498 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:02.933398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbf9ce-0418-4cbb-8260-c379c86e5498 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:02.933843 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbf9ce-0418-4cbb-8260-c379c86e5498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:02.937946 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b6d03-4345-4485-a7da-861a09a58d28 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:02.940552 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b6d03-4345-4485-a7da-861a09a58d28 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:02.955145 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-07dbf9ce-0418-4cbb-8260-c379c86e5498 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:02.956724 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-07dbf9ce-0418-4cbb-8260-c379c86e5498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:02.958233 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-068b6d03-4345-4485-a7da-861a09a58d28 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 10 12:36:02.964234 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 460/945] 10.222.0.13 () {56 vars in 1138 bytes} [Mon Jan 10 12:36:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:02.965977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b6d03-4345-4485-a7da-861a09a58d28 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:02.977053 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b6d03-4345-4485-a7da-861a09a58d28 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:02.977839 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 486/946] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:02 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:36:02.983355 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225078a9-10cc-403c-8144-7e8c1d571289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:02.984536 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225078a9-10cc-403c-8144-7e8c1d571289 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:02.985013 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225078a9-10cc-403c-8144-7e8c1d571289 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:02.985551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225078a9-10cc-403c-8144-7e8c1d571289 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:02.986776 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225078a9-10cc-403c-8144-7e8c1d571289 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:02.987317 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225078a9-10cc-403c-8144-7e8c1d571289 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:02.989730 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225078a9-10cc-403c-8144-7e8c1d571289 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:03.003797 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbf9ce-0418-4cbb-8260-c379c86e5498 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:03.013480 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbf9ce-0418-4cbb-8260-c379c86e5498 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:03.018663 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 461/947] 10.222.0.13 () {56 vars in 1170 bytes} [Mon Jan 10 12:36:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:03.020672 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225078a9-10cc-403c-8144-7e8c1d571289 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:03.023532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e8276-2c9a-42b6-9b51-4712b738e1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:03.024563 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e8276-2c9a-42b6-9b51-4712b738e1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:03.024959 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e8276-2c9a-42b6-9b51-4712b738e1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:03.025295 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e8276-2c9a-42b6-9b51-4712b738e1a3 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:03.026051 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e8276-2c9a-42b6-9b51-4712b738e1a3 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:03.027871 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e8276-2c9a-42b6-9b51-4712b738e1a3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:03.033988 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225078a9-10cc-403c-8144-7e8c1d571289 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:03.038910 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e1e12-6233-4f86-ad9d-4aaac39c4b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:03.039885 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e1e12-6233-4f86-ad9d-4aaac39c4b7d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:03.040084 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-f02e8276-2c9a-42b6-9b51-4712b738e1a3 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 10 12:36:03.040579 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e1e12-6233-4f86-ad9d-4aaac39c4b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:03.041017 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e1e12-6233-4f86-ad9d-4aaac39c4b7d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:03.047141 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 487/948] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:36:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:36:03.048781 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e8276-2c9a-42b6-9b51-4712b738e1a3 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:03.051335 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e1e12-6233-4f86-ad9d-4aaac39c4b7d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:03.053326 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e1e12-6233-4f86-ad9d-4aaac39c4b7d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:03.062841 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e8276-2c9a-42b6-9b51-4712b738e1a3 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:03.069559 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 462/949] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:36:03 2022] GET /identity/v3/auth/tokens => generated 1952 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:36:03.071724 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e1e12-6233-4f86-ad9d-4aaac39c4b7d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:03.073384 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54762a9-e809-4c56-ad63-283a8b9700c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:03.074263 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54762a9-e809-4c56-ad63-283a8b9700c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:03.074639 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54762a9-e809-4c56-ad63-283a8b9700c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:03.075100 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54762a9-e809-4c56-ad63-283a8b9700c3 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:03.075976 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54762a9-e809-4c56-ad63-283a8b9700c3 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:03.076431 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54762a9-e809-4c56-ad63-283a8b9700c3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:03.078212 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54762a9-e809-4c56-ad63-283a8b9700c3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:03.083199 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e1e12-6233-4f86-ad9d-4aaac39c4b7d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:03.083766 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 488/950] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:36:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:36:03.088775 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edde4b-f812-41ea-8e16-737d9fbe763c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:03.089256 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54762a9-e809-4c56-ad63-283a8b9700c3 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:03.089576 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edde4b-f812-41ea-8e16-737d9fbe763c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:03.089935 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edde4b-f812-41ea-8e16-737d9fbe763c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:03.090206 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edde4b-f812-41ea-8e16-737d9fbe763c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:03.099958 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54762a9-e809-4c56-ad63-283a8b9700c3 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:03.104860 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edde4b-f812-41ea-8e16-737d9fbe763c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:03.106905 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edde4b-f812-41ea-8e16-737d9fbe763c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:03.108641 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579aa53d-b661-469e-9386-eb10e04fa0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:03.108641 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aa53d-b661-469e-9386-eb10e04fa0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:03.108913 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aa53d-b661-469e-9386-eb10e04fa0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:03.109171 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aa53d-b661-469e-9386-eb10e04fa0b0 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:03.109947 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579aa53d-b661-469e-9386-eb10e04fa0b0 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:03.110247 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579aa53d-b661-469e-9386-eb10e04fa0b0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:03.111912 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579aa53d-b661-469e-9386-eb10e04fa0b0 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:03.117682 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 489/951] 10.222.0.13 () {56 vars in 1135 bytes} [Mon Jan 10 12:36:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:03.122893 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579aa53d-b661-469e-9386-eb10e04fa0b0 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:03.127971 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-c7edde4b-f812-41ea-8e16-737d9fbe763c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:36:03.129621 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 463/952] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:03.135635 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edde4b-f812-41ea-8e16-737d9fbe763c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:03.137583 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579aa53d-b661-469e-9386-eb10e04fa0b0 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:03.142486 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec10f1-7ad6-4071-a14d-125b8cb88468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:03.143355 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec10f1-7ad6-4071-a14d-125b8cb88468 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:03.143803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec10f1-7ad6-4071-a14d-125b8cb88468 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:03.144225 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec10f1-7ad6-4071-a14d-125b8cb88468 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:03.145172 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec10f1-7ad6-4071-a14d-125b8cb88468 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:03.145418 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edde4b-f812-41ea-8e16-737d9fbe763c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:03.147288 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec10f1-7ad6-4071-a14d-125b8cb88468 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:03.150022 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae184a-55e3-4796-a7de-d48de298eb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:03.150697 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae184a-55e3-4796-a7de-d48de298eb72 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:03.150972 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae184a-55e3-4796-a7de-d48de298eb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:03.151248 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae184a-55e3-4796-a7de-d48de298eb72 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:03.152290 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae184a-55e3-4796-a7de-d48de298eb72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:03.152596 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae184a-55e3-4796-a7de-d48de298eb72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:03.154895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae184a-55e3-4796-a7de-d48de298eb72 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:03.169483 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 490/954] 10.222.0.13 () {60 vars in 1165 bytes} [Mon Jan 10 12:36:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:36:03.171584 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 464/954] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:36:03.173915 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec10f1-7ad6-4071-a14d-125b8cb88468 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:03.198291 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec10f1-7ad6-4071-a14d-125b8cb88468 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:03.204062 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c2bfd-d890-4b3b-a0bd-6b5215a5c42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:03.205278 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c2bfd-d890-4b3b-a0bd-6b5215a5c42c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:03.205745 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c2bfd-d890-4b3b-a0bd-6b5215a5c42c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:03.206203 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c2bfd-d890-4b3b-a0bd-6b5215a5c42c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:03.215682 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c2bfd-d890-4b3b-a0bd-6b5215a5c42c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:03.218178 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c2bfd-d890-4b3b-a0bd-6b5215a5c42c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:03.233317 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-330c2bfd-d890-4b3b-a0bd-6b5215a5c42c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:36:03.235360 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 491/955] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:36:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:36:03.243584 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae184a-55e3-4796-a7de-d48de298eb72 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:03.253864 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae184a-55e3-4796-a7de-d48de298eb72 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:03.258525 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772f112-ee3d-4ee0-a431-9fcf5655fae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:03.259355 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772f112-ee3d-4ee0-a431-9fcf5655fae1 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:03.259669 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772f112-ee3d-4ee0-a431-9fcf5655fae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:03.259938 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772f112-ee3d-4ee0-a431-9fcf5655fae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:03.260763 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772f112-ee3d-4ee0-a431-9fcf5655fae1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:03.261065 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772f112-ee3d-4ee0-a431-9fcf5655fae1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:03.263048 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772f112-ee3d-4ee0-a431-9fcf5655fae1 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:03.282091 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 465/956] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:36:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:03.283709 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c2bfd-d890-4b3b-a0bd-6b5215a5c42c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:03.294431 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c2bfd-d890-4b3b-a0bd-6b5215a5c42c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:03.299128 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa56ec2-138b-4add-a8c5-5292546ca8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:03.300010 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa56ec2-138b-4add-a8c5-5292546ca8da admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:03.300294 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa56ec2-138b-4add-a8c5-5292546ca8da admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:03.300563 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa56ec2-138b-4add-a8c5-5292546ca8da admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:03.301414 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa56ec2-138b-4add-a8c5-5292546ca8da admin admin] RBAC: Adding query filter params (role.id=f697c07a4ed645e683846610a1b2e341, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=44e5602fd019411aa8f0e091ed533ae8) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:03.301723 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa56ec2-138b-4add-a8c5-5292546ca8da admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:03.303624 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa56ec2-138b-4add-a8c5-5292546ca8da admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:03.315307 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 492/957] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:36:03 2022] GET /identity/v3/role_assignments?user.id=44e5602fd019411aa8f0e091ed533ae8&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=f697c07a4ed645e683846610a1b2e341 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:03.436015 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d687190-ed24-4c60-9294-071a6ee85295 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:03.436295 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d687190-ed24-4c60-9294-071a6ee85295 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:03.436563 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d687190-ed24-4c60-9294-071a6ee85295 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:03.438370 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 466/958] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:03.446427 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d714f6c-c0b4-4f49-9ec5-2b5388e3172c None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:03.446938 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d714f6c-c0b4-4f49-9ec5-2b5388e3172c None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:03.447551 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d714f6c-c0b4-4f49-9ec5-2b5388e3172c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:03.466457 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-3d714f6c-c0b4-4f49-9ec5-2b5388e3172c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:03.467735 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-3d714f6c-c0b4-4f49-9ec5-2b5388e3172c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:03.476150 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 493/959] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:03 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:03.498805 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d687190-ed24-4c60-9294-071a6ee85295 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:03.511841 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d687190-ed24-4c60-9294-071a6ee85295 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:03.516326 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7586ebe-31cc-4848-a37c-dc4f4c554bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:03.517141 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7586ebe-31cc-4848-a37c-dc4f4c554bcb admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:03.517420 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7586ebe-31cc-4848-a37c-dc4f4c554bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:03.517694 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7586ebe-31cc-4848-a37c-dc4f4c554bcb admin admin] PATH_INFO: `/v3/services/compute` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:03.518376 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7586ebe-31cc-4848-a37c-dc4f4c554bcb admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:03.520054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7586ebe-31cc-4848-a37c-dc4f4c554bcb admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:03.532027 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-e7586ebe-31cc-4848-a37c-dc4f4c554bcb admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 10 12:36:03.533635 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 467/960] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:36:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:03.540314 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d714f6c-c0b4-4f49-9ec5-2b5388e3172c None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:03.549824 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d714f6c-c0b4-4f49-9ec5-2b5388e3172c None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:03.554948 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7b93f-933e-4966-ba8a-0de50f7e4509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:03.555696 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7b93f-933e-4966-ba8a-0de50f7e4509 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:03.556094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7b93f-933e-4966-ba8a-0de50f7e4509 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:03.556870 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7b93f-933e-4966-ba8a-0de50f7e4509 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:03.557041 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7b93f-933e-4966-ba8a-0de50f7e4509 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:03.557266 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7b93f-933e-4966-ba8a-0de50f7e4509 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:03.558888 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7b93f-933e-4966-ba8a-0de50f7e4509 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:03.564436 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 494/961] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jan 10 12:36:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:36:03.570559 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7586ebe-31cc-4848-a37c-dc4f4c554bcb admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:03.580473 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7586ebe-31cc-4848-a37c-dc4f4c554bcb admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:03.585226 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5370b-4e75-4b16-a594-20b82dcc26c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:03.585941 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5370b-4e75-4b16-a594-20b82dcc26c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:03.586218 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5370b-4e75-4b16-a594-20b82dcc26c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:03.586540 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5370b-4e75-4b16-a594-20b82dcc26c7 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:03.587353 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5370b-4e75-4b16-a594-20b82dcc26c7 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:03.588069 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5370b-4e75-4b16-a594-20b82dcc26c7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:03.589459 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5370b-4e75-4b16-a594-20b82dcc26c7 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:03.594708 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 468/962] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jan 10 12:36:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:05.405295 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35b9a4-05a4-498e-9d39-f9f049ec504b None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:05.405295 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35b9a4-05a4-498e-9d39-f9f049ec504b None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:05.405295 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35b9a4-05a4-498e-9d39-f9f049ec504b None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:05.406521 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 495/963] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:05.412458 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb951de-0a58-4a49-bafd-3e4229092a32 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:05.413312 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb951de-0a58-4a49-bafd-3e4229092a32 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:05.413848 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb951de-0a58-4a49-bafd-3e4229092a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:05.432009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-deb951de-0a58-4a49-bafd-3e4229092a32 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:05.434847 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-deb951de-0a58-4a49-bafd-3e4229092a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:05.443462 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 469/964] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:05 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:05.468830 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35b9a4-05a4-498e-9d39-f9f049ec504b None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:05.481707 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35b9a4-05a4-498e-9d39-f9f049ec504b None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:05.486494 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d726f-9769-4901-8576-3429daaa3f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:05.487542 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d726f-9769-4901-8576-3429daaa3f30 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:05.488022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d726f-9769-4901-8576-3429daaa3f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:05.488510 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d726f-9769-4901-8576-3429daaa3f30 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:05.489398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d726f-9769-4901-8576-3429daaa3f30 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:05.491199 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d726f-9769-4901-8576-3429daaa3f30 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:05.503769 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-a07d726f-9769-4901-8576-3429daaa3f30 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 10 12:36:05.505522 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 496/965] 10.222.0.13 () {56 vars in 1147 bytes} [Mon Jan 10 12:36:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:05.511990 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb951de-0a58-4a49-bafd-3e4229092a32 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:05.521468 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb951de-0a58-4a49-bafd-3e4229092a32 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:05.526439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce649b5-f3bb-48d1-bd16-d8d6ef156167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:05.527357 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce649b5-f3bb-48d1-bd16-d8d6ef156167 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:05.527868 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce649b5-f3bb-48d1-bd16-d8d6ef156167 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:05.528371 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce649b5-f3bb-48d1-bd16-d8d6ef156167 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:05.529294 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce649b5-f3bb-48d1-bd16-d8d6ef156167 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:05.529792 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce649b5-f3bb-48d1-bd16-d8d6ef156167 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:05.531626 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce649b5-f3bb-48d1-bd16-d8d6ef156167 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:05.537215 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 470/966] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jan 10 12:36:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:05.543169 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d726f-9769-4901-8576-3429daaa3f30 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:05.553210 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d726f-9769-4901-8576-3429daaa3f30 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:05.558235 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e1fb8-b4f8-4140-b134-335a8bc023b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:05.559195 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e1fb8-b4f8-4140-b134-335a8bc023b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:05.559725 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e1fb8-b4f8-4140-b134-335a8bc023b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:05.560215 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e1fb8-b4f8-4140-b134-335a8bc023b9 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:05.561139 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e1fb8-b4f8-4140-b134-335a8bc023b9 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:05.561637 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e1fb8-b4f8-4140-b134-335a8bc023b9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:05.563444 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e1fb8-b4f8-4140-b134-335a8bc023b9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:05.569887 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 497/967] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jan 10 12:36:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:05.576154 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce649b5-f3bb-48d1-bd16-d8d6ef156167 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:05.586940 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce649b5-f3bb-48d1-bd16-d8d6ef156167 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:05.592218 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48894ef-2395-444e-8676-3cb7fbd77fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:05.593293 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48894ef-2395-444e-8676-3cb7fbd77fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:05.593772 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48894ef-2395-444e-8676-3cb7fbd77fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:05.594257 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48894ef-2395-444e-8676-3cb7fbd77fe2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:05.595243 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48894ef-2395-444e-8676-3cb7fbd77fe2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:05.597163 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48894ef-2395-444e-8676-3cb7fbd77fe2 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:05.619105 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 471/968] 10.222.0.13 () {60 vars in 1165 bytes} [Mon Jan 10 12:36:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:36:05.644043 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce452989-775a-4430-9bc8-6a8f19f920b4 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:05.644391 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce452989-775a-4430-9bc8-6a8f19f920b4 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:05.644601 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce452989-775a-4430-9bc8-6a8f19f920b4 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:05.646733 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 498/969] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:05.652894 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057602a0-de89-4a40-b6ac-717022bef1be None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:05.653228 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057602a0-de89-4a40-b6ac-717022bef1be None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:05.653448 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057602a0-de89-4a40-b6ac-717022bef1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:05.672965 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-057602a0-de89-4a40-b6ac-717022bef1be None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:05.674084 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-057602a0-de89-4a40-b6ac-717022bef1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:05.692337 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 472/970] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:05 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:05.718290 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce452989-775a-4430-9bc8-6a8f19f920b4 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:05.732325 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce452989-775a-4430-9bc8-6a8f19f920b4 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:05.736990 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb771e0-32f3-4c87-ad71-5c33ec9cf463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:05.737683 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb771e0-32f3-4c87-ad71-5c33ec9cf463 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:05.737956 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb771e0-32f3-4c87-ad71-5c33ec9cf463 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:05.738225 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb771e0-32f3-4c87-ad71-5c33ec9cf463 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:05.738975 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb771e0-32f3-4c87-ad71-5c33ec9cf463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:05.740972 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb771e0-32f3-4c87-ad71-5c33ec9cf463 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:05.742411 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.common [None req-ebb771e0-32f3-4c87-ad71-5c33ec9cf463 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 10 12:36:05.764180 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.sql.core [None req-ebb771e0-32f3-4c87-ad71-5c33ec9cf463 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jan 10 12:36:05.764180 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jan 10 12:36:05.764180 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [parameters: {'id': 'f71fada78d674db5993220edc42f2424', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jan 10 12:36:05.764180 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86081) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 10 12:36:05.771482 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-ebb771e0-32f3-4c87-ad71-5c33ec9cf463 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f71fada78d674db5993220edc42f2424.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f71fada78d674db5993220edc42f2424. Jan 10 12:36:05.773331 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 499/971] 10.222.0.13 () {60 vars in 1161 bytes} [Mon Jan 10 12:36:05 2022] POST /identity/v3/projects => generated 262 bytes in 55 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:05.779676 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057602a0-de89-4a40-b6ac-717022bef1be None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:05.789285 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057602a0-de89-4a40-b6ac-717022bef1be None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:05.794132 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c9460-137d-4123-ab6b-9426d18fe091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:05.795012 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9460-137d-4123-ab6b-9426d18fe091 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:05.795287 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9460-137d-4123-ab6b-9426d18fe091 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:05.795580 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c9460-137d-4123-ab6b-9426d18fe091 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:05.804004 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c9460-137d-4123-ab6b-9426d18fe091 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:05.806171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c9460-137d-4123-ab6b-9426d18fe091 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:05.821165 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-6c5c9460-137d-4123-ab6b-9426d18fe091 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:36:05.823028 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 473/972] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:36:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:05.829585 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb771e0-32f3-4c87-ad71-5c33ec9cf463 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:05.837812 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09b844-6a4f-41e4-886a-cbf3cb2db469 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:05.838385 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09b844-6a4f-41e4-886a-cbf3cb2db469 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:05.838664 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09b844-6a4f-41e4-886a-cbf3cb2db469 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:05.840854 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb771e0-32f3-4c87-ad71-5c33ec9cf463 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:05.843473 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 474/973] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:36:05.848081 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc3b52-1dca-4bda-b9c4-034a2d59bab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:05.848574 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e21841-1c6f-4614-94c6-c78460ffd2e2 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:05.848856 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e21841-1c6f-4614-94c6-c78460ffd2e2 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:05.848997 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc3b52-1dca-4bda-b9c4-034a2d59bab5 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:05.849173 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e21841-1c6f-4614-94c6-c78460ffd2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:05.849316 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc3b52-1dca-4bda-b9c4-034a2d59bab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:05.849643 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc3b52-1dca-4bda-b9c4-034a2d59bab5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:05.850493 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc3b52-1dca-4bda-b9c4-034a2d59bab5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:05.850926 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc3b52-1dca-4bda-b9c4-034a2d59bab5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:05.853407 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc3b52-1dca-4bda-b9c4-034a2d59bab5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:05.868881 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-90e21841-1c6f-4614-94c6-c78460ffd2e2 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:05.870977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-90e21841-1c6f-4614-94c6-c78460ffd2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:05.876312 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 500/974] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jan 10 12:36:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:05.884606 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 475/975] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:05 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:36:05.908073 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc3b52-1dca-4bda-b9c4-034a2d59bab5 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:05.919905 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc3b52-1dca-4bda-b9c4-034a2d59bab5 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:05.926572 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a439605-ac67-4f97-86c1-c071cebadd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:05.927694 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a439605-ac67-4f97-86c1-c071cebadd29 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:05.927986 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a439605-ac67-4f97-86c1-c071cebadd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:05.928448 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a439605-ac67-4f97-86c1-c071cebadd29 admin admin] PATH_INFO: `/v3/services/image` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:05.929161 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a439605-ac67-4f97-86c1-c071cebadd29 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:05.931532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a439605-ac67-4f97-86c1-c071cebadd29 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:05.945210 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-3a439605-ac67-4f97-86c1-c071cebadd29 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 10 12:36:05.947039 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 501/976] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jan 10 12:36:05 2022] GET /identity/v3/services/image => generated 86 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:05.955152 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e21841-1c6f-4614-94c6-c78460ffd2e2 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:05.965368 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e21841-1c6f-4614-94c6-c78460ffd2e2 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:05.970614 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8c07b-9bdb-4fe4-bac3-d3db4254f9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:05.971701 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8c07b-9bdb-4fe4-bac3-d3db4254f9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:05.972184 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8c07b-9bdb-4fe4-bac3-d3db4254f9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:05.972683 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8c07b-9bdb-4fe4-bac3-d3db4254f9d6 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:05.973641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8c07b-9bdb-4fe4-bac3-d3db4254f9d6 admin admin] RBAC: Adding query filter params (name=image) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:05.974171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8c07b-9bdb-4fe4-bac3-d3db4254f9d6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:05.976121 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8c07b-9bdb-4fe4-bac3-d3db4254f9d6 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:05.982498 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 476/977] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:36:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:05.988265 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a439605-ac67-4f97-86c1-c071cebadd29 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:05.999100 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a439605-ac67-4f97-86c1-c071cebadd29 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:06.004491 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae134c-126f-46c3-988e-8c5c8b255dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:06.005516 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae134c-126f-46c3-988e-8c5c8b255dbf admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:06.006055 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae134c-126f-46c3-988e-8c5c8b255dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:06.006630 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae134c-126f-46c3-988e-8c5c8b255dbf admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:06.007757 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae134c-126f-46c3-988e-8c5c8b255dbf admin admin] RBAC: Adding query filter params (type=image) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:06.008361 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae134c-126f-46c3-988e-8c5c8b255dbf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:06.010473 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae134c-126f-46c3-988e-8c5c8b255dbf admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:06.016799 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 502/978] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:36:05 2022] GET /identity/v3/services?type=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:06.049606 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb112b-e135-40cc-90cd-96df0bea9c76 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:06.049948 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb112b-e135-40cc-90cd-96df0bea9c76 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:06.050178 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb112b-e135-40cc-90cd-96df0bea9c76 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:06.052540 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 477/979] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:06.058701 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42d009-acb9-4f02-ad65-86441efb1c8d None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:06.059061 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42d009-acb9-4f02-ad65-86441efb1c8d None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:06.059262 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42d009-acb9-4f02-ad65-86441efb1c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:06.080577 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-eb42d009-acb9-4f02-ad65-86441efb1c8d None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:06.082274 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-eb42d009-acb9-4f02-ad65-86441efb1c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:06.092519 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 503/980] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:06 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:06.117742 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb112b-e135-40cc-90cd-96df0bea9c76 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:06.132130 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb112b-e135-40cc-90cd-96df0bea9c76 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:06.137472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ab091-c840-4bec-8d47-20fc79942ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:06.138497 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ab091-c840-4bec-8d47-20fc79942ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:06.139001 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ab091-c840-4bec-8d47-20fc79942ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:06.139482 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ab091-c840-4bec-8d47-20fc79942ee3 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:06.140484 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ab091-c840-4bec-8d47-20fc79942ee3 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:06.142313 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ab091-c840-4bec-8d47-20fc79942ee3 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:06.160608 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 478/981] 10.222.0.13 () {60 vars in 1162 bytes} [Mon Jan 10 12:36:06 2022] POST /identity/v3/services => generated 242 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:36:08.183146 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c4d7a-c9d0-4be6-8254-3a62d5fecc5f None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.184250 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c4d7a-c9d0-4be6-8254-3a62d5fecc5f None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.184735 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c4d7a-c9d0-4be6-8254-3a62d5fecc5f None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.187316 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 504/982] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:08.193833 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b567d-b1e1-4c8a-8ab4-d62952be2d8b None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.194812 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b567d-b1e1-4c8a-8ab4-d62952be2d8b None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.195287 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b567d-b1e1-4c8a-8ab4-d62952be2d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.214120 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-d15b567d-b1e1-4c8a-8ab4-d62952be2d8b None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:08.215686 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-d15b567d-b1e1-4c8a-8ab4-d62952be2d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:08.233143 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 479/983] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:08 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:36:08.258033 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c4d7a-c9d0-4be6-8254-3a62d5fecc5f None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:08.270829 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c4d7a-c9d0-4be6-8254-3a62d5fecc5f None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:08.276471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84c186-48fd-4d23-8bc5-1518bbfb028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:08.277508 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84c186-48fd-4d23-8bc5-1518bbfb028a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.278095 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84c186-48fd-4d23-8bc5-1518bbfb028a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.278560 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84c186-48fd-4d23-8bc5-1518bbfb028a admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.279434 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84c186-48fd-4d23-8bc5-1518bbfb028a admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:08.281304 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84c186-48fd-4d23-8bc5-1518bbfb028a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:08.293540 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-1d84c186-48fd-4d23-8bc5-1518bbfb028a admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 10 12:36:08.295322 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 505/984] 10.222.0.13 () {56 vars in 1147 bytes} [Mon Jan 10 12:36:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:08.301592 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b567d-b1e1-4c8a-8ab4-d62952be2d8b None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:08.311215 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b567d-b1e1-4c8a-8ab4-d62952be2d8b None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:08.316459 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c83ae0-c99c-43ea-ac42-2fb40946f671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:08.317346 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c83ae0-c99c-43ea-ac42-2fb40946f671 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.317849 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c83ae0-c99c-43ea-ac42-2fb40946f671 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.318336 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c83ae0-c99c-43ea-ac42-2fb40946f671 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.319269 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c83ae0-c99c-43ea-ac42-2fb40946f671 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:08.319801 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c83ae0-c99c-43ea-ac42-2fb40946f671 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:08.321892 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c83ae0-c99c-43ea-ac42-2fb40946f671 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:08.331865 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 480/985] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jan 10 12:36:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:08.334010 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84c186-48fd-4d23-8bc5-1518bbfb028a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:08.344197 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84c186-48fd-4d23-8bc5-1518bbfb028a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:08.349131 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fa2a3-2e34-4ff3-b1ec-1351d6a4241e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:08.350023 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fa2a3-2e34-4ff3-b1ec-1351d6a4241e admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.350544 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fa2a3-2e34-4ff3-b1ec-1351d6a4241e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.351009 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fa2a3-2e34-4ff3-b1ec-1351d6a4241e admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.351972 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fa2a3-2e34-4ff3-b1ec-1351d6a4241e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:08.352542 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fa2a3-2e34-4ff3-b1ec-1351d6a4241e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:08.354537 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fa2a3-2e34-4ff3-b1ec-1351d6a4241e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:08.360496 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 506/986] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jan 10 12:36:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:08.366591 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c83ae0-c99c-43ea-ac42-2fb40946f671 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:08.377245 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c83ae0-c99c-43ea-ac42-2fb40946f671 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:08.382133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14fa44-2ff2-4fd8-ade0-7c21fd88fbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:08.383036 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14fa44-2ff2-4fd8-ade0-7c21fd88fbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.383561 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14fa44-2ff2-4fd8-ade0-7c21fd88fbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.384115 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14fa44-2ff2-4fd8-ade0-7c21fd88fbb5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.385142 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14fa44-2ff2-4fd8-ade0-7c21fd88fbb5 admin admin] RBAC: Adding query filter params (interface=admin, service_id=51f047868903471593c2b33d97f4d00c, region_id=RegionOne) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:08.385653 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14fa44-2ff2-4fd8-ade0-7c21fd88fbb5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:08.387454 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14fa44-2ff2-4fd8-ade0-7c21fd88fbb5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:08.393742 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 481/987] 10.222.0.13 () {56 vars in 1270 bytes} [Mon Jan 10 12:36:08 2022] GET /identity/v3/endpoints?service_id=51f047868903471593c2b33d97f4d00c&interface=admin®ion_id=RegionOne => generated 193 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:08.397369 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd014b8-b2b4-460a-b47c-0838ba04d5cf None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.397650 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd014b8-b2b4-460a-b47c-0838ba04d5cf None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.397920 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd014b8-b2b4-460a-b47c-0838ba04d5cf None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.400104 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14fa44-2ff2-4fd8-ade0-7c21fd88fbb5 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:08.400337 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 507/988] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:08.407928 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9d353-86ff-409f-a32b-528e2481dda1 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.408444 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9d353-86ff-409f-a32b-528e2481dda1 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.408695 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9d353-86ff-409f-a32b-528e2481dda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.414244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14fa44-2ff2-4fd8-ade0-7c21fd88fbb5 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:08.419505 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38760802-2f0e-473a-9c25-6f9b7ef05cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:08.420455 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38760802-2f0e-473a-9c25-6f9b7ef05cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.421009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38760802-2f0e-473a-9c25-6f9b7ef05cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.421481 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38760802-2f0e-473a-9c25-6f9b7ef05cf9 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.422379 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38760802-2f0e-473a-9c25-6f9b7ef05cf9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:08.424247 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38760802-2f0e-473a-9c25-6f9b7ef05cf9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:08.427934 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-99c9d353-86ff-409f-a32b-528e2481dda1 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:08.429105 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-99c9d353-86ff-409f-a32b-528e2481dda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:08.431967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 482/989] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jan 10 12:36:08 2022] GET /identity/v3/services => generated 1727 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:36:08.441775 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 508/990] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:08 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:36:08.469973 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38760802-2f0e-473a-9c25-6f9b7ef05cf9 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:08.475315 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752f8d5-40b6-48fe-830f-2656dbbbcf5a None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.475619 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752f8d5-40b6-48fe-830f-2656dbbbcf5a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.475876 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752f8d5-40b6-48fe-830f-2656dbbbcf5a None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.478089 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 509/991] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:36:08.486091 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38760802-2f0e-473a-9c25-6f9b7ef05cf9 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:08.486697 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ed392-076c-4ac1-96d6-208dd359a961 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.487165 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ed392-076c-4ac1-96d6-208dd359a961 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.487652 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ed392-076c-4ac1-96d6-208dd359a961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.490850 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800736e-f33a-4a5d-999d-bdfe868ccc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:08.491659 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800736e-f33a-4a5d-999d-bdfe868ccc21 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.491936 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800736e-f33a-4a5d-999d-bdfe868ccc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.492203 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800736e-f33a-4a5d-999d-bdfe868ccc21 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.492945 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800736e-f33a-4a5d-999d-bdfe868ccc21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:08.496032 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800736e-f33a-4a5d-999d-bdfe868ccc21 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:08.497979 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.common [None req-e800736e-f33a-4a5d-999d-bdfe868ccc21 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 10 12:36:08.511258 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-0b1ed392-076c-4ac1-96d6-208dd359a961 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:08.511825 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.sql.core [None req-e800736e-f33a-4a5d-999d-bdfe868ccc21 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jan 10 12:36:08.511825 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jan 10 12:36:08.511825 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [parameters: {'user_id': 'e4c58b3b805740eaa091dbe4823f86d5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jan 10 12:36:08.511825 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86080) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 10 12:36:08.513225 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-0b1ed392-076c-4ac1-96d6-208dd359a961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:08.527660 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 510/992] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:08 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:08.528455 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-e800736e-f33a-4a5d-999d-bdfe868ccc21 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jan 10 12:36:08.530255 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 483/993] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:36:08 2022] POST /identity/v3/users => generated 160 bytes in 61 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:08.536451 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ed392-076c-4ac1-96d6-208dd359a961 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:08.546980 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ed392-076c-4ac1-96d6-208dd359a961 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:08.550875 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800736e-f33a-4a5d-999d-bdfe868ccc21 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:08.557029 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4de3d-7e76-473e-a45c-cb3a95a8dffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:08.558174 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4de3d-7e76-473e-a45c-cb3a95a8dffd admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.558670 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4de3d-7e76-473e-a45c-cb3a95a8dffd admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.559149 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4de3d-7e76-473e-a45c-cb3a95a8dffd admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.563780 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800736e-f33a-4a5d-999d-bdfe868ccc21 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:08.568864 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfa033-6a99-441b-9d02-805042a233bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:08.569433 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4de3d-7e76-473e-a45c-cb3a95a8dffd admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:08.569570 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfa033-6a99-441b-9d02-805042a233bb admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.569809 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfa033-6a99-441b-9d02-805042a233bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.570074 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfa033-6a99-441b-9d02-805042a233bb admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.570824 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfa033-6a99-441b-9d02-805042a233bb admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:08.572689 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4de3d-7e76-473e-a45c-cb3a95a8dffd admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:08.573617 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfa033-6a99-441b-9d02-805042a233bb admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:08.588961 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-f8a4de3d-7e76-473e-a45c-cb3a95a8dffd admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 10 12:36:08.590959 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 511/994] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:36:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:08.597585 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4de3d-7e76-473e-a45c-cb3a95a8dffd admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:08.607558 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 484/995] 10.222.0.13 () {60 vars in 1162 bytes} [Mon Jan 10 12:36:08 2022] POST /identity/v3/services => generated 242 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:36:08.617961 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4de3d-7e76-473e-a45c-cb3a95a8dffd admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:08.636392 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81f456-ca8e-44d7-b76e-4fb7afaef73b None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.637182 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81f456-ca8e-44d7-b76e-4fb7afaef73b None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.637516 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81f456-ca8e-44d7-b76e-4fb7afaef73b None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.640255 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4afd1-4919-460e-89c8-5da6b4f504e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:08.640504 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 485/996] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:36:08.640949 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4afd1-4919-460e-89c8-5da6b4f504e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.641223 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4afd1-4919-460e-89c8-5da6b4f504e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.641485 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4afd1-4919-460e-89c8-5da6b4f504e7 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.642437 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4afd1-4919-460e-89c8-5da6b4f504e7 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:08.642736 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4afd1-4919-460e-89c8-5da6b4f504e7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:08.647575 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4afd1-4919-460e-89c8-5da6b4f504e7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:08.650415 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205cdbb-23b7-4965-960c-bf7d00d4f5e5 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.651079 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205cdbb-23b7-4965-960c-bf7d00d4f5e5 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.651339 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205cdbb-23b7-4965-960c-bf7d00d4f5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.672690 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-6205cdbb-23b7-4965-960c-bf7d00d4f5e5 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:08.674473 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-6205cdbb-23b7-4965-960c-bf7d00d4f5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:08.684496 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 486/997] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:08 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:36:08.688759 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 512/998] 10.222.0.13 () {56 vars in 1122 bytes} [Mon Jan 10 12:36:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:36:08.710219 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205cdbb-23b7-4965-960c-bf7d00d4f5e5 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:08.720851 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205cdbb-23b7-4965-960c-bf7d00d4f5e5 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:08.725757 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501047b-a225-43ea-b156-50ea98a53df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:08.726583 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501047b-a225-43ea-b156-50ea98a53df8 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.726856 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501047b-a225-43ea-b156-50ea98a53df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.727121 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501047b-a225-43ea-b156-50ea98a53df8 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.728586 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501047b-a225-43ea-b156-50ea98a53df8 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:08.729889 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501047b-a225-43ea-b156-50ea98a53df8 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:08.741589 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-c501047b-a225-43ea-b156-50ea98a53df8 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 10 12:36:08.743314 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 487/999] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:36:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:08.750327 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4afd1-4919-460e-89c8-5da6b4f504e7 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:08.761512 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4afd1-4919-460e-89c8-5da6b4f504e7 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:08.766891 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251338d-d1b3-4b07-9560-954f73201e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:08.767755 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251338d-d1b3-4b07-9560-954f73201e4a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.768031 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251338d-d1b3-4b07-9560-954f73201e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.768347 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251338d-d1b3-4b07-9560-954f73201e4a admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.769124 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251338d-d1b3-4b07-9560-954f73201e4a admin admin] RBAC: Adding query filter params (name=compute) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:08.769432 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251338d-d1b3-4b07-9560-954f73201e4a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:08.771266 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251338d-d1b3-4b07-9560-954f73201e4a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:08.778624 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 513/1000] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jan 10 12:36:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:08.784596 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501047b-a225-43ea-b156-50ea98a53df8 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:08.796175 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501047b-a225-43ea-b156-50ea98a53df8 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:08.801248 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963c3c3-cd8b-4e3a-afc0-8b5f048fa479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:08.801993 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963c3c3-cd8b-4e3a-afc0-8b5f048fa479 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.802312 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963c3c3-cd8b-4e3a-afc0-8b5f048fa479 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.802581 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963c3c3-cd8b-4e3a-afc0-8b5f048fa479 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.803327 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963c3c3-cd8b-4e3a-afc0-8b5f048fa479 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:08.803708 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963c3c3-cd8b-4e3a-afc0-8b5f048fa479 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:08.805515 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963c3c3-cd8b-4e3a-afc0-8b5f048fa479 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:08.812656 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 488/1001] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jan 10 12:36:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:08.819278 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251338d-d1b3-4b07-9560-954f73201e4a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:08.830687 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251338d-d1b3-4b07-9560-954f73201e4a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:08.835777 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33c4c0-f437-47f2-ab16-2c8015d50938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:08.836559 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33c4c0-f437-47f2-ab16-2c8015d50938 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.836872 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33c4c0-f437-47f2-ab16-2c8015d50938 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.837181 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33c4c0-f437-47f2-ab16-2c8015d50938 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.838744 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33c4c0-f437-47f2-ab16-2c8015d50938 admin admin] RBAC: Adding query filter params (interface=public, service_id=6d4acb95c79046f99c110858d22c5c91, region_id=RegionOne) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:08.839052 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33c4c0-f437-47f2-ab16-2c8015d50938 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:08.840782 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33c4c0-f437-47f2-ab16-2c8015d50938 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:08.847275 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 514/1002] 10.222.0.13 () {56 vars in 1272 bytes} [Mon Jan 10 12:36:08 2022] GET /identity/v3/endpoints?service_id=6d4acb95c79046f99c110858d22c5c91&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:08.854189 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963c3c3-cd8b-4e3a-afc0-8b5f048fa479 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:08.865005 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963c3c3-cd8b-4e3a-afc0-8b5f048fa479 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:08.870710 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9f0f3-24f9-4168-baf6-f38eb677e208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:08.872528 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9f0f3-24f9-4168-baf6-f38eb677e208 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:08.872528 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9f0f3-24f9-4168-baf6-f38eb677e208 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:08.872528 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9f0f3-24f9-4168-baf6-f38eb677e208 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:08.872795 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9f0f3-24f9-4168-baf6-f38eb677e208 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:08.875235 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9f0f3-24f9-4168-baf6-f38eb677e208 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:08.882660 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 489/1003] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jan 10 12:36:08 2022] GET /identity/v3/services => generated 1957 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:36:10.898654 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9e0e2-8f35-4eb1-ac29-cb2fdba4321a None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:10.899269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9e0e2-8f35-4eb1-ac29-cb2fdba4321a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:10.899269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9e0e2-8f35-4eb1-ac29-cb2fdba4321a None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:10.901248 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 515/1004] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:10.906658 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40afd5-fc1c-4b31-87ed-60ab41c4c17b None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:10.907108 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40afd5-fc1c-4b31-87ed-60ab41c4c17b None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:10.907189 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40afd5-fc1c-4b31-87ed-60ab41c4c17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:10.925665 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-6d40afd5-fc1c-4b31-87ed-60ab41c4c17b None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:10.926849 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-6d40afd5-fc1c-4b31-87ed-60ab41c4c17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:10.935001 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 490/1005] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:10 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:36:10.959776 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9e0e2-8f35-4eb1-ac29-cb2fdba4321a None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:10.973075 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9e0e2-8f35-4eb1-ac29-cb2fdba4321a None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:10.977730 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c691d-5a78-48ab-90ad-efe788f66a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:10.978542 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c691d-5a78-48ab-90ad-efe788f66a2d admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:10.978830 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c691d-5a78-48ab-90ad-efe788f66a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:10.979101 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c691d-5a78-48ab-90ad-efe788f66a2d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:10.979818 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c691d-5a78-48ab-90ad-efe788f66a2d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:10.981431 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c691d-5a78-48ab-90ad-efe788f66a2d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:10.993265 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-810c691d-5a78-48ab-90ad-efe788f66a2d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 10 12:36:10.995414 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 516/1006] 10.222.0.13 () {56 vars in 1147 bytes} [Mon Jan 10 12:36:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:11.000698 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40afd5-fc1c-4b31-87ed-60ab41c4c17b None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:11.010895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40afd5-fc1c-4b31-87ed-60ab41c4c17b None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:11.016851 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ff018-1a30-4dda-8e89-cd86500e0464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:11.017621 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ff018-1a30-4dda-8e89-cd86500e0464 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:11.017963 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ff018-1a30-4dda-8e89-cd86500e0464 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:11.018292 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ff018-1a30-4dda-8e89-cd86500e0464 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:11.019087 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ff018-1a30-4dda-8e89-cd86500e0464 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:11.019455 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ff018-1a30-4dda-8e89-cd86500e0464 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:11.021154 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ff018-1a30-4dda-8e89-cd86500e0464 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:11.027438 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 491/1007] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jan 10 12:36:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:11.033083 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c691d-5a78-48ab-90ad-efe788f66a2d admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:11.043017 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c691d-5a78-48ab-90ad-efe788f66a2d admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:11.047975 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ec16d-a129-44f6-88c9-fefb48b1e809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:11.048631 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ec16d-a129-44f6-88c9-fefb48b1e809 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:11.048889 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ec16d-a129-44f6-88c9-fefb48b1e809 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:11.049179 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ec16d-a129-44f6-88c9-fefb48b1e809 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:11.049889 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ec16d-a129-44f6-88c9-fefb48b1e809 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:11.050190 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ec16d-a129-44f6-88c9-fefb48b1e809 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:11.051798 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ec16d-a129-44f6-88c9-fefb48b1e809 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:11.057189 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 517/1008] 10.222.0.13 () {56 vars in 1143 bytes} [Mon Jan 10 12:36:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:36:11.062689 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ff018-1a30-4dda-8e89-cd86500e0464 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:11.073609 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ff018-1a30-4dda-8e89-cd86500e0464 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:11.078509 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a272f4-838d-411e-a815-2c44e1420331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:11.079173 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a272f4-838d-411e-a815-2c44e1420331 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:11.079454 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a272f4-838d-411e-a815-2c44e1420331 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:11.079762 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a272f4-838d-411e-a815-2c44e1420331 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:11.080535 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a272f4-838d-411e-a815-2c44e1420331 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:11.082141 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a272f4-838d-411e-a815-2c44e1420331 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:11.089954 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a2649-82d4-40e6-b6b6-7e40ce14bedd None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:11.090323 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a2649-82d4-40e6-b6b6-7e40ce14bedd None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:11.090567 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a2649-82d4-40e6-b6b6-7e40ce14bedd None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:11.092999 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 518/1009] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:11.098612 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acc3d9-4eac-40ce-9804-c57fbf6a2fdd None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:11.098892 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acc3d9-4eac-40ce-9804-c57fbf6a2fdd None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:11.099156 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acc3d9-4eac-40ce-9804-c57fbf6a2fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:11.103577 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 492/1010] 10.222.0.13 () {60 vars in 1165 bytes} [Mon Jan 10 12:36:11 2022] POST /identity/v3/endpoints => generated 325 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:36:11.120598 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-61acc3d9-4eac-40ce-9804-c57fbf6a2fdd None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:11.121845 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-61acc3d9-4eac-40ce-9804-c57fbf6a2fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:11.141816 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 519/1011] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:11 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:36:11.166203 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a272f4-838d-411e-a815-2c44e1420331 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:11.177512 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a272f4-838d-411e-a815-2c44e1420331 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:11.182632 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53478582-7ab6-47b3-8c78-68395d5508cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:11.183458 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53478582-7ab6-47b3-8c78-68395d5508cd admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:11.183773 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53478582-7ab6-47b3-8c78-68395d5508cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:11.184048 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53478582-7ab6-47b3-8c78-68395d5508cd admin admin] PATH_INFO: `/v3/services/image` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:11.184737 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53478582-7ab6-47b3-8c78-68395d5508cd admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:11.186386 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53478582-7ab6-47b3-8c78-68395d5508cd admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:11.198890 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-53478582-7ab6-47b3-8c78-68395d5508cd admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 10 12:36:11.203572 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 493/1012] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jan 10 12:36:11 2022] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:11.206531 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acc3d9-4eac-40ce-9804-c57fbf6a2fdd None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:11.216337 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acc3d9-4eac-40ce-9804-c57fbf6a2fdd None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:11.221422 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbe106-a7f5-4094-95d4-17d79f33400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:11.222179 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbe106-a7f5-4094-95d4-17d79f33400d admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:11.222514 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbe106-a7f5-4094-95d4-17d79f33400d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:11.222818 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbe106-a7f5-4094-95d4-17d79f33400d admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:11.223659 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbe106-a7f5-4094-95d4-17d79f33400d admin admin] RBAC: Adding query filter params (name=image) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:11.224028 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbe106-a7f5-4094-95d4-17d79f33400d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:11.225776 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbe106-a7f5-4094-95d4-17d79f33400d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:11.232304 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 520/1013] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:36:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:11.238037 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53478582-7ab6-47b3-8c78-68395d5508cd admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:11.249474 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53478582-7ab6-47b3-8c78-68395d5508cd admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:11.254289 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b8112-1faa-4a3a-b415-d6a176cab740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:11.254981 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b8112-1faa-4a3a-b415-d6a176cab740 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:11.255250 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b8112-1faa-4a3a-b415-d6a176cab740 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:11.255551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b8112-1faa-4a3a-b415-d6a176cab740 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:11.256307 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b8112-1faa-4a3a-b415-d6a176cab740 admin admin] RBAC: Adding query filter params (type=image) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:11.256614 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b8112-1faa-4a3a-b415-d6a176cab740 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:11.258252 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b8112-1faa-4a3a-b415-d6a176cab740 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:11.264756 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 494/1014] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:36:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:11.271347 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbe106-a7f5-4094-95d4-17d79f33400d admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:11.281782 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbe106-a7f5-4094-95d4-17d79f33400d admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:11.287355 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176de48-ffeb-47d5-8b23-45e9e1fb2ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:11.288249 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176de48-ffeb-47d5-8b23-45e9e1fb2ebc admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:11.288666 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176de48-ffeb-47d5-8b23-45e9e1fb2ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:11.289193 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176de48-ffeb-47d5-8b23-45e9e1fb2ebc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:11.290375 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176de48-ffeb-47d5-8b23-45e9e1fb2ebc admin admin] RBAC: Adding query filter params (interface=public, service_id=844a11a60a4a4981b22c4b8bba0487f1, region_id=RegionOne) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:11.290891 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176de48-ffeb-47d5-8b23-45e9e1fb2ebc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:11.292865 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176de48-ffeb-47d5-8b23-45e9e1fb2ebc admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:11.300289 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 521/1015] 10.222.0.13 () {56 vars in 1272 bytes} [Mon Jan 10 12:36:11 2022] GET /identity/v3/endpoints?service_id=844a11a60a4a4981b22c4b8bba0487f1&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:11.304958 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b8112-1faa-4a3a-b415-d6a176cab740 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:11.309219 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895ab92-3d5a-485c-900f-c4987753685f None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:11.309502 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895ab92-3d5a-485c-900f-c4987753685f None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:11.309769 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895ab92-3d5a-485c-900f-c4987753685f None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:11.312008 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 522/1016] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:36:11.316016 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b8112-1faa-4a3a-b415-d6a176cab740 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:11.318273 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d0fd8-6fc1-4910-914c-0921babac015 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:11.318750 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d0fd8-6fc1-4910-914c-0921babac015 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:11.319217 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d0fd8-6fc1-4910-914c-0921babac015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:11.320977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912fcec-4080-4baa-9092-482cfa04b014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:11.321736 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912fcec-4080-4baa-9092-482cfa04b014 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:11.322015 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912fcec-4080-4baa-9092-482cfa04b014 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:11.322286 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912fcec-4080-4baa-9092-482cfa04b014 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:11.323000 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912fcec-4080-4baa-9092-482cfa04b014 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:11.324635 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912fcec-4080-4baa-9092-482cfa04b014 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:11.331793 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 495/1017] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jan 10 12:36:11 2022] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:36:11.346934 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-2f7d0fd8-6fc1-4910-914c-0921babac015 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:11.348253 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-2f7d0fd8-6fc1-4910-914c-0921babac015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:11.356893 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 523/1018] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:11 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:36:11.381845 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912fcec-4080-4baa-9092-482cfa04b014 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:11.392294 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912fcec-4080-4baa-9092-482cfa04b014 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:11.401434 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7215e-a2db-41b3-b053-dec2522c1072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:11.402344 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7215e-a2db-41b3-b053-dec2522c1072 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:11.402645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7215e-a2db-41b3-b053-dec2522c1072 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:11.402913 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7215e-a2db-41b3-b053-dec2522c1072 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:11.403642 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7215e-a2db-41b3-b053-dec2522c1072 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:11.405327 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7215e-a2db-41b3-b053-dec2522c1072 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:11.417209 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-11f7215e-a2db-41b3-b053-dec2522c1072 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 10 12:36:11.418729 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 496/1019] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:36:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:11.424761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d0fd8-6fc1-4910-914c-0921babac015 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:11.434497 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d0fd8-6fc1-4910-914c-0921babac015 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:11.439352 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014358aa-de7a-46dc-9c2f-2e9559ea5261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:11.440560 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014358aa-de7a-46dc-9c2f-2e9559ea5261 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:11.440909 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014358aa-de7a-46dc-9c2f-2e9559ea5261 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:11.441247 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014358aa-de7a-46dc-9c2f-2e9559ea5261 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:11.442056 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014358aa-de7a-46dc-9c2f-2e9559ea5261 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:11.442466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014358aa-de7a-46dc-9c2f-2e9559ea5261 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:11.444327 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014358aa-de7a-46dc-9c2f-2e9559ea5261 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:11.451185 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 524/1020] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jan 10 12:36:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:36:11.456247 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7215e-a2db-41b3-b053-dec2522c1072 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:11.467565 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7215e-a2db-41b3-b053-dec2522c1072 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:11.472144 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634dad9-a76c-4ae4-9e39-0712c1abb724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:11.472829 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634dad9-a76c-4ae4-9e39-0712c1abb724 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:11.473107 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634dad9-a76c-4ae4-9e39-0712c1abb724 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:11.473374 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634dad9-a76c-4ae4-9e39-0712c1abb724 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:11.474121 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634dad9-a76c-4ae4-9e39-0712c1abb724 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:11.474425 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634dad9-a76c-4ae4-9e39-0712c1abb724 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:11.476109 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634dad9-a76c-4ae4-9e39-0712c1abb724 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:11.486794 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 497/1021] 10.222.0.13 () {56 vars in 1133 bytes} [Mon Jan 10 12:36:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:11.488821 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014358aa-de7a-46dc-9c2f-2e9559ea5261 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:11.499127 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014358aa-de7a-46dc-9c2f-2e9559ea5261 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:11.504468 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607bd32-367e-4482-a466-64e5aae4f2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:11.505195 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607bd32-367e-4482-a466-64e5aae4f2ac admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:11.505539 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607bd32-367e-4482-a466-64e5aae4f2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:11.505876 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607bd32-367e-4482-a466-64e5aae4f2ac admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:11.506737 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607bd32-367e-4482-a466-64e5aae4f2ac admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:11.508508 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607bd32-367e-4482-a466-64e5aae4f2ac admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:11.532990 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 525/1022] 10.222.0.13 () {60 vars in 1165 bytes} [Mon Jan 10 12:36:11 2022] POST /identity/v3/endpoints => generated 334 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:36:13.551039 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a4890-2d76-413f-bb70-3ceb3965a993 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:13.551609 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a4890-2d76-413f-bb70-3ceb3965a993 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:13.551609 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a4890-2d76-413f-bb70-3ceb3965a993 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:13.553384 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 498/1023] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:13.558947 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1b280-d91e-4e45-9d36-6788427dd75e None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:13.559385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1b280-d91e-4e45-9d36-6788427dd75e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:13.559492 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1b280-d91e-4e45-9d36-6788427dd75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:13.579704 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-35f1b280-d91e-4e45-9d36-6788427dd75e None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:13.580937 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-35f1b280-d91e-4e45-9d36-6788427dd75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:13.599686 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 526/1024] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:13 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:13.624492 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a4890-2d76-413f-bb70-3ceb3965a993 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:13.637426 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a4890-2d76-413f-bb70-3ceb3965a993 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:13.642009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a63dde-77bf-4f0b-9ef8-d4d813735707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:13.642796 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a63dde-77bf-4f0b-9ef8-d4d813735707 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:13.643073 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a63dde-77bf-4f0b-9ef8-d4d813735707 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:13.643306 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a63dde-77bf-4f0b-9ef8-d4d813735707 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:13.644614 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a63dde-77bf-4f0b-9ef8-d4d813735707 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:13.646294 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a63dde-77bf-4f0b-9ef8-d4d813735707 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:13.651541 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 499/1025] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:36:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:13.654038 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1b280-d91e-4e45-9d36-6788427dd75e None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:13.663438 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1b280-d91e-4e45-9d36-6788427dd75e None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:13.668380 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e4da2-ca45-4cac-a9b7-477cfbe73089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:13.669054 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e4da2-ca45-4cac-a9b7-477cfbe73089 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:13.669336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e4da2-ca45-4cac-a9b7-477cfbe73089 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:13.669607 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e4da2-ca45-4cac-a9b7-477cfbe73089 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:13.670341 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e4da2-ca45-4cac-a9b7-477cfbe73089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:13.672303 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e4da2-ca45-4cac-a9b7-477cfbe73089 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:13.701719 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 527/1026] 10.222.0.13 () {60 vars in 1162 bytes} [Mon Jan 10 12:36:13 2022] POST /identity/v3/projects => generated 311 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:36:13.757412 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61f649-ead9-4672-b5c5-35680a30e9f3 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:13.757693 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61f649-ead9-4672-b5c5-35680a30e9f3 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:13.758122 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61f649-ead9-4672-b5c5-35680a30e9f3 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:13.760289 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 500/1027] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:13.766266 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a4a0c-4b0c-4a85-88f9-5b4a9ca3e9cb None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:13.766610 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a4a0c-4b0c-4a85-88f9-5b4a9ca3e9cb None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:13.766779 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a4a0c-4b0c-4a85-88f9-5b4a9ca3e9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:13.786114 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-430a4a0c-4b0c-4a85-88f9-5b4a9ca3e9cb None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:13.787319 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-430a4a0c-4b0c-4a85-88f9-5b4a9ca3e9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:13.854508 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 528/1028] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:13 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:13.878797 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61f649-ead9-4672-b5c5-35680a30e9f3 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:13.892872 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61f649-ead9-4672-b5c5-35680a30e9f3 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:13.897700 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312ae42-8fbb-4b41-99ca-12d44950a7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:13.898603 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312ae42-8fbb-4b41-99ca-12d44950a7cb admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:13.898879 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312ae42-8fbb-4b41-99ca-12d44950a7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:13.899185 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312ae42-8fbb-4b41-99ca-12d44950a7cb admin admin] PATH_INFO: `/v3/services/image` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:13.900674 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312ae42-8fbb-4b41-99ca-12d44950a7cb admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:13.902365 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312ae42-8fbb-4b41-99ca-12d44950a7cb admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:13.914142 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-b312ae42-8fbb-4b41-99ca-12d44950a7cb admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 10 12:36:13.916257 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 501/1029] 10.222.0.13 () {56 vars in 1126 bytes} [Mon Jan 10 12:36:13 2022] GET /identity/v3/services/image => generated 86 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:13.922847 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a4a0c-4b0c-4a85-88f9-5b4a9ca3e9cb None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:13.934288 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a4a0c-4b0c-4a85-88f9-5b4a9ca3e9cb None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:13.939367 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e0e66-cc4a-454e-966c-66733eeaec90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:13.940425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e0e66-cc4a-454e-966c-66733eeaec90 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:13.940698 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e0e66-cc4a-454e-966c-66733eeaec90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:13.940945 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e0e66-cc4a-454e-966c-66733eeaec90 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:13.941662 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e0e66-cc4a-454e-966c-66733eeaec90 admin admin] RBAC: Adding query filter params (name=image) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:13.941980 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e0e66-cc4a-454e-966c-66733eeaec90 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:13.943655 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e0e66-cc4a-454e-966c-66733eeaec90 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:13.949582 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 529/1030] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:36:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:13.955348 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312ae42-8fbb-4b41-99ca-12d44950a7cb admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:13.965691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312ae42-8fbb-4b41-99ca-12d44950a7cb admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:13.970260 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755788ad-b021-489c-8641-e84f23427f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:13.970913 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755788ad-b021-489c-8641-e84f23427f17 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:13.971207 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755788ad-b021-489c-8641-e84f23427f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:13.971464 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755788ad-b021-489c-8641-e84f23427f17 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:13.972200 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755788ad-b021-489c-8641-e84f23427f17 admin admin] RBAC: Adding query filter params (type=image) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:13.972519 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755788ad-b021-489c-8641-e84f23427f17 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:13.974082 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755788ad-b021-489c-8641-e84f23427f17 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:13.980004 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 502/1031] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:36:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:13.985493 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e0e66-cc4a-454e-966c-66733eeaec90 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:13.996215 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e0e66-cc4a-454e-966c-66733eeaec90 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:14.000949 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc02a8-1567-47ec-8ca9-3a67204f9388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:14.001617 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc02a8-1567-47ec-8ca9-3a67204f9388 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:14.001897 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc02a8-1567-47ec-8ca9-3a67204f9388 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:14.002166 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc02a8-1567-47ec-8ca9-3a67204f9388 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:14.002942 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fc02a8-1567-47ec-8ca9-3a67204f9388 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:14.004582 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fc02a8-1567-47ec-8ca9-3a67204f9388 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:14.024146 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 530/1032] 10.222.0.13 () {60 vars in 1165 bytes} [Mon Jan 10 12:36:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:36:14.034361 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381f705-6acb-4dfb-8df2-20823fb72b02 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:14.034643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381f705-6acb-4dfb-8df2-20823fb72b02 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:14.034914 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381f705-6acb-4dfb-8df2-20823fb72b02 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:14.036842 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 503/1033] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:14.043024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac20d94-2cfb-4779-a8dc-64ce7098f63a None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:14.043351 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac20d94-2cfb-4779-a8dc-64ce7098f63a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:14.043614 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac20d94-2cfb-4779-a8dc-64ce7098f63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:14.063195 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-fac20d94-2cfb-4779-a8dc-64ce7098f63a None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:14.064490 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-fac20d94-2cfb-4779-a8dc-64ce7098f63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:14.087437 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 531/1034] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:14 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:14.110371 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381f705-6acb-4dfb-8df2-20823fb72b02 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:14.124255 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381f705-6acb-4dfb-8df2-20823fb72b02 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:14.130013 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6f988-ba37-4fad-bbdb-56d841d0babf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:14.130869 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6f988-ba37-4fad-bbdb-56d841d0babf admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:14.131144 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6f988-ba37-4fad-bbdb-56d841d0babf admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:14.131415 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6f988-ba37-4fad-bbdb-56d841d0babf admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:14.145479 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6f988-ba37-4fad-bbdb-56d841d0babf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:36:14.152919 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-fde6f988-ba37-4fad-bbdb-56d841d0babf admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 10 12:36:14.154493 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 504/1035] 10.222.0.13 () {56 vars in 1141 bytes} [Mon Jan 10 12:36:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:14.160703 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac20d94-2cfb-4779-a8dc-64ce7098f63a None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:14.170804 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac20d94-2cfb-4779-a8dc-64ce7098f63a None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:14.175896 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5420c8-5962-435e-bcac-17f9e05e4a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:14.176768 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5420c8-5962-435e-bcac-17f9e05e4a19 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:14.177150 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5420c8-5962-435e-bcac-17f9e05e4a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:14.177518 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5420c8-5962-435e-bcac-17f9e05e4a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:14.178425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5420c8-5962-435e-bcac-17f9e05e4a19 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:14.178838 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5420c8-5962-435e-bcac-17f9e05e4a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:14.180686 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5420c8-5962-435e-bcac-17f9e05e4a19 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:14.190820 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 532/1036] 10.222.0.13 () {56 vars in 1136 bytes} [Mon Jan 10 12:36:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:14.197142 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6f988-ba37-4fad-bbdb-56d841d0babf admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:14.207583 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6f988-ba37-4fad-bbdb-56d841d0babf admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:14.213415 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6772734-6926-49f8-b22f-f231cf0cb082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:14.214201 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6772734-6926-49f8-b22f-f231cf0cb082 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:14.214485 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6772734-6926-49f8-b22f-f231cf0cb082 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:14.214751 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6772734-6926-49f8-b22f-f231cf0cb082 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:14.226629 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6772734-6926-49f8-b22f-f231cf0cb082 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:14.228623 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6772734-6926-49f8-b22f-f231cf0cb082 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:14.246935 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-b6772734-6926-49f8-b22f-f231cf0cb082 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:36:14.248430 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 505/1037] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:14.254232 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5420c8-5962-435e-bcac-17f9e05e4a19 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:14.264983 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5420c8-5962-435e-bcac-17f9e05e4a19 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:14.270756 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e185dfd-d31b-4ffa-b465-c9932883062e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:14.271488 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e185dfd-d31b-4ffa-b465-c9932883062e admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:14.271880 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e185dfd-d31b-4ffa-b465-c9932883062e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:14.272184 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e185dfd-d31b-4ffa-b465-c9932883062e admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:14.273019 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e185dfd-d31b-4ffa-b465-c9932883062e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:14.273374 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e185dfd-d31b-4ffa-b465-c9932883062e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:14.275598 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e185dfd-d31b-4ffa-b465-c9932883062e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:14.288562 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 533/1038] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:14.294570 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6772734-6926-49f8-b22f-f231cf0cb082 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:14.304768 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6772734-6926-49f8-b22f-f231cf0cb082 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:14.310414 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c69361-a3af-4bd8-967d-01eef640f4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:14.311189 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c69361-a3af-4bd8-967d-01eef640f4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:14.311489 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c69361-a3af-4bd8-967d-01eef640f4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:14.311826 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c69361-a3af-4bd8-967d-01eef640f4d8 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:14.319764 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c69361-a3af-4bd8-967d-01eef640f4d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:14.321950 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c69361-a3af-4bd8-967d-01eef640f4d8 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:14.335685 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-38c69361-a3af-4bd8-967d-01eef640f4d8 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 12:36:14.337196 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 506/1039] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jan 10 12:36:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:14.342956 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e185dfd-d31b-4ffa-b465-c9932883062e admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:14.352994 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e185dfd-d31b-4ffa-b465-c9932883062e admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:14.357695 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ede3fd-712f-47fd-b1c0-3c0eefd16211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:14.358435 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ede3fd-712f-47fd-b1c0-3c0eefd16211 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:14.358799 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ede3fd-712f-47fd-b1c0-3c0eefd16211 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:14.359131 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ede3fd-712f-47fd-b1c0-3c0eefd16211 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:14.360107 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ede3fd-712f-47fd-b1c0-3c0eefd16211 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:14.360521 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ede3fd-712f-47fd-b1c0-3c0eefd16211 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:14.362404 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ede3fd-712f-47fd-b1c0-3c0eefd16211 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:14.379860 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 534/1040] 10.222.0.13 () {56 vars in 1154 bytes} [Mon Jan 10 12:36:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:14.385619 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c69361-a3af-4bd8-967d-01eef640f4d8 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:14.395944 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c69361-a3af-4bd8-967d-01eef640f4d8 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:14.401315 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef63ca-5f90-4a7a-ad30-b625b57ec89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:14.402067 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef63ca-5f90-4a7a-ad30-b625b57ec89d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:14.402465 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef63ca-5f90-4a7a-ad30-b625b57ec89d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:14.402829 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef63ca-5f90-4a7a-ad30-b625b57ec89d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:14.411136 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef63ca-5f90-4a7a-ad30-b625b57ec89d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:14.413089 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef63ca-5f90-4a7a-ad30-b625b57ec89d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:14.435538 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 507/1041] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:36:14 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:36:14.437588 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ede3fd-712f-47fd-b1c0-3c0eefd16211 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:14.448685 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ede3fd-712f-47fd-b1c0-3c0eefd16211 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:14.454762 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f18c6c-c57e-46bc-9ec0-fba230921d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:14.455778 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f18c6c-c57e-46bc-9ec0-fba230921d57 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:14.456174 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f18c6c-c57e-46bc-9ec0-fba230921d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:14.456576 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f18c6c-c57e-46bc-9ec0-fba230921d57 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:14.468514 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f18c6c-c57e-46bc-9ec0-fba230921d57 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:14.470619 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f18c6c-c57e-46bc-9ec0-fba230921d57 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:14.489497 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-a4f18c6c-c57e-46bc-9ec0-fba230921d57 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:36:14.491035 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 535/1042] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:14.497690 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef63ca-5f90-4a7a-ad30-b625b57ec89d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:14.506878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef63ca-5f90-4a7a-ad30-b625b57ec89d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:14.511919 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53379f5-bb9d-44b7-9c42-282ed252329b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:14.512701 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53379f5-bb9d-44b7-9c42-282ed252329b admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:14.513073 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53379f5-bb9d-44b7-9c42-282ed252329b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:14.513432 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53379f5-bb9d-44b7-9c42-282ed252329b admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:14.514254 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53379f5-bb9d-44b7-9c42-282ed252329b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:14.514650 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53379f5-bb9d-44b7-9c42-282ed252329b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:14.516356 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53379f5-bb9d-44b7-9c42-282ed252329b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:14.528928 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 508/1043] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:14.534715 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f18c6c-c57e-46bc-9ec0-fba230921d57 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:14.544717 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f18c6c-c57e-46bc-9ec0-fba230921d57 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:14.549267 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849be65-1ed7-4bc6-8b6d-f0acdea8e5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:14.550160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849be65-1ed7-4bc6-8b6d-f0acdea8e5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:14.550529 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849be65-1ed7-4bc6-8b6d-f0acdea8e5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:14.550922 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849be65-1ed7-4bc6-8b6d-f0acdea8e5b8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:14.558385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849be65-1ed7-4bc6-8b6d-f0acdea8e5b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:14.560585 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849be65-1ed7-4bc6-8b6d-f0acdea8e5b8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:14.574545 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-2849be65-1ed7-4bc6-8b6d-f0acdea8e5b8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:36:14.576058 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 536/1044] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:14.581813 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53379f5-bb9d-44b7-9c42-282ed252329b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:14.592058 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53379f5-bb9d-44b7-9c42-282ed252329b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:14.597002 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251702c-7967-423f-98ca-d478c2585316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:14.597750 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251702c-7967-423f-98ca-d478c2585316 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:14.598122 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251702c-7967-423f-98ca-d478c2585316 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:14.598477 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251702c-7967-423f-98ca-d478c2585316 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:14.599367 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251702c-7967-423f-98ca-d478c2585316 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:14.599796 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251702c-7967-423f-98ca-d478c2585316 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:14.601722 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251702c-7967-423f-98ca-d478c2585316 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:14.614464 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 509/1045] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:36:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:14.620508 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849be65-1ed7-4bc6-8b6d-f0acdea8e5b8 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:14.630977 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849be65-1ed7-4bc6-8b6d-f0acdea8e5b8 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:14.635796 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f85610-4ced-44d3-ad06-668a6249ac19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:14.636497 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f85610-4ced-44d3-ad06-668a6249ac19 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:14.636833 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f85610-4ced-44d3-ad06-668a6249ac19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:14.637161 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f85610-4ced-44d3-ad06-668a6249ac19 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:14.638054 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f85610-4ced-44d3-ad06-668a6249ac19 admin admin] RBAC: Adding query filter params (role.id=f697c07a4ed645e683846610a1b2e341, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=d68fa8e4f3a341a5b74ee32c85e59869) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:14.638440 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f85610-4ced-44d3-ad06-668a6249ac19 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:14.640373 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f85610-4ced-44d3-ad06-668a6249ac19 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:14.645991 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 537/1046] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:36:14 2022] GET /identity/v3/role_assignments?user.id=d68fa8e4f3a341a5b74ee32c85e59869&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=f697c07a4ed645e683846610a1b2e341 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:36:16.166393 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a8a0d-7deb-4173-8d82-f27139324a5b None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:16.167002 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a8a0d-7deb-4173-8d82-f27139324a5b None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:16.167002 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a8a0d-7deb-4173-8d82-f27139324a5b None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:16.168745 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 510/1047] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:16.174505 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b73538-853f-48c7-a0b0-bd2408dad518 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:16.174967 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b73538-853f-48c7-a0b0-bd2408dad518 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:16.175056 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b73538-853f-48c7-a0b0-bd2408dad518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:16.193143 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-15b73538-853f-48c7-a0b0-bd2408dad518 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:16.194335 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-15b73538-853f-48c7-a0b0-bd2408dad518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:16.202612 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 538/1048] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:16.229298 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a8a0d-7deb-4173-8d82-f27139324a5b None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:16.242067 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a8a0d-7deb-4173-8d82-f27139324a5b None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:16.247371 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91fce1-3e08-4160-994d-b368b09667b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:16.248187 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91fce1-3e08-4160-994d-b368b09667b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:16.248444 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91fce1-3e08-4160-994d-b368b09667b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:16.248734 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91fce1-3e08-4160-994d-b368b09667b1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:16.249943 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91fce1-3e08-4160-994d-b368b09667b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:16.251697 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91fce1-3e08-4160-994d-b368b09667b1 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:16.253254 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 511/1049] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:36:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:16.259172 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b73538-853f-48c7-a0b0-bd2408dad518 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:16.268299 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b73538-853f-48c7-a0b0-bd2408dad518 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:16.273296 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de810114-d9f2-4317-9b6f-696836de7bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:16.273961 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de810114-d9f2-4317-9b6f-696836de7bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:16.274278 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de810114-d9f2-4317-9b6f-696836de7bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:16.274600 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de810114-d9f2-4317-9b6f-696836de7bd3 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:16.275277 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de810114-d9f2-4317-9b6f-696836de7bd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:16.277229 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de810114-d9f2-4317-9b6f-696836de7bd3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:16.298678 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 539/1050] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Jan 10 12:36:16 2022] POST /identity/v3/users => generated 285 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:36:16.466271 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178145d-4fc1-474d-ac3d-3323e45ff6c2 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:16.466471 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178145d-4fc1-474d-ac3d-3323e45ff6c2 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:16.466843 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178145d-4fc1-474d-ac3d-3323e45ff6c2 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:16.468984 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 512/1051] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:16.476471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40d383-cfb1-43f6-8aa5-baa456be1811 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:16.476825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40d383-cfb1-43f6-8aa5-baa456be1811 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:16.477018 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40d383-cfb1-43f6-8aa5-baa456be1811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:16.495908 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-9e40d383-cfb1-43f6-8aa5-baa456be1811 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:16.497298 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-9e40d383-cfb1-43f6-8aa5-baa456be1811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:16.509868 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 540/1052] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:36:16.533396 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178145d-4fc1-474d-ac3d-3323e45ff6c2 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:16.546260 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178145d-4fc1-474d-ac3d-3323e45ff6c2 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:16.551298 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7d0a6-8f8e-4dc8-9fab-9c03fa4b0671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:16.551972 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7d0a6-8f8e-4dc8-9fab-9c03fa4b0671 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:16.552267 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7d0a6-8f8e-4dc8-9fab-9c03fa4b0671 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:16.552525 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7d0a6-8f8e-4dc8-9fab-9c03fa4b0671 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:16.560672 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7d0a6-8f8e-4dc8-9fab-9c03fa4b0671 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:16.562519 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7d0a6-8f8e-4dc8-9fab-9c03fa4b0671 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:16.572770 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 513/1053] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:36:16 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:36:16.579663 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40d383-cfb1-43f6-8aa5-baa456be1811 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:16.588761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40d383-cfb1-43f6-8aa5-baa456be1811 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:16.594033 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35953046-fcfe-4bb5-97e0-c5e2de40e694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:16.594852 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35953046-fcfe-4bb5-97e0-c5e2de40e694 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:16.595113 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35953046-fcfe-4bb5-97e0-c5e2de40e694 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:16.595379 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35953046-fcfe-4bb5-97e0-c5e2de40e694 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:16.596619 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35953046-fcfe-4bb5-97e0-c5e2de40e694 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:16.598320 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35953046-fcfe-4bb5-97e0-c5e2de40e694 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:16.600117 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 541/1054] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:36:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:17.087452 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fa7c1-3109-439e-98e4-9b65220dfcf0 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:17.087666 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fa7c1-3109-439e-98e4-9b65220dfcf0 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:17.087795 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fa7c1-3109-439e-98e4-9b65220dfcf0 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:17.089595 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 514/1055] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:17.094796 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d47537-fbf6-4edc-9be3-fa802a020d5a None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:17.095082 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d47537-fbf6-4edc-9be3-fa802a020d5a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:17.095355 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d47537-fbf6-4edc-9be3-fa802a020d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:17.114467 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-24d47537-fbf6-4edc-9be3-fa802a020d5a None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:17.115697 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-24d47537-fbf6-4edc-9be3-fa802a020d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:17.125260 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 542/1056] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:17 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:17.150085 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fa7c1-3109-439e-98e4-9b65220dfcf0 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:17.162785 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fa7c1-3109-439e-98e4-9b65220dfcf0 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:17.167591 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dee0a9-4c03-4c5a-9d1e-44dea4b17b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:17.168396 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dee0a9-4c03-4c5a-9d1e-44dea4b17b7f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:17.168673 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dee0a9-4c03-4c5a-9d1e-44dea4b17b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:17.168940 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dee0a9-4c03-4c5a-9d1e-44dea4b17b7f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:17.180160 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dee0a9-4c03-4c5a-9d1e-44dea4b17b7f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:36:17.187410 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-78dee0a9-4c03-4c5a-9d1e-44dea4b17b7f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 10 12:36:17.188675 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 515/1057] 10.222.0.13 () {56 vars in 1141 bytes} [Mon Jan 10 12:36:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:17.195309 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d47537-fbf6-4edc-9be3-fa802a020d5a None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:17.204782 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d47537-fbf6-4edc-9be3-fa802a020d5a None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:17.209992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43558b6d-fde4-423a-99f5-1784d8424a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:17.210813 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43558b6d-fde4-423a-99f5-1784d8424a9a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:17.211163 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43558b6d-fde4-423a-99f5-1784d8424a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:17.211406 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43558b6d-fde4-423a-99f5-1784d8424a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:17.212298 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43558b6d-fde4-423a-99f5-1784d8424a9a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:17.212576 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43558b6d-fde4-423a-99f5-1784d8424a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:17.214177 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43558b6d-fde4-423a-99f5-1784d8424a9a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:17.222831 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 543/1058] 10.222.0.13 () {56 vars in 1136 bytes} [Mon Jan 10 12:36:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:17.228938 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dee0a9-4c03-4c5a-9d1e-44dea4b17b7f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:17.239664 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dee0a9-4c03-4c5a-9d1e-44dea4b17b7f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:17.244530 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfff8d-2ec0-410b-893e-ce63713133a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:17.245368 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfff8d-2ec0-410b-893e-ce63713133a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:17.245636 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfff8d-2ec0-410b-893e-ce63713133a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:17.245898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfff8d-2ec0-410b-893e-ce63713133a3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:17.256414 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfff8d-2ec0-410b-893e-ce63713133a3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:17.258232 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfff8d-2ec0-410b-893e-ce63713133a3 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:17.275351 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-a2dfff8d-2ec0-410b-893e-ce63713133a3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:36:17.276502 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 516/1059] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:17.282482 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43558b6d-fde4-423a-99f5-1784d8424a9a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:17.292598 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43558b6d-fde4-423a-99f5-1784d8424a9a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:17.297486 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7be415-0be9-42f9-b6e5-0cd934d19db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:17.298129 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7be415-0be9-42f9-b6e5-0cd934d19db3 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:17.298396 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7be415-0be9-42f9-b6e5-0cd934d19db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:17.298659 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7be415-0be9-42f9-b6e5-0cd934d19db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:17.299388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7be415-0be9-42f9-b6e5-0cd934d19db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:17.299703 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7be415-0be9-42f9-b6e5-0cd934d19db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:17.301344 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7be415-0be9-42f9-b6e5-0cd934d19db3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:17.312761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 544/1060] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:17.318600 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfff8d-2ec0-410b-893e-ce63713133a3 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:17.328377 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfff8d-2ec0-410b-893e-ce63713133a3 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:17.332909 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c97863-15df-46a9-b09b-19138a6232c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:17.333680 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c97863-15df-46a9-b09b-19138a6232c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:17.333952 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c97863-15df-46a9-b09b-19138a6232c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:17.334215 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c97863-15df-46a9-b09b-19138a6232c9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:17.341481 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c97863-15df-46a9-b09b-19138a6232c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:17.343407 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c97863-15df-46a9-b09b-19138a6232c9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:17.356670 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-84c97863-15df-46a9-b09b-19138a6232c9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 12:36:17.357999 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 517/1061] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jan 10 12:36:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:17.363417 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7be415-0be9-42f9-b6e5-0cd934d19db3 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:17.373509 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7be415-0be9-42f9-b6e5-0cd934d19db3 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:17.379355 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151bc01-5ef8-4d78-b53b-8bd59eb9898a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:17.380128 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151bc01-5ef8-4d78-b53b-8bd59eb9898a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:17.380454 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151bc01-5ef8-4d78-b53b-8bd59eb9898a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:17.380781 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151bc01-5ef8-4d78-b53b-8bd59eb9898a admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:17.381699 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151bc01-5ef8-4d78-b53b-8bd59eb9898a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:17.382084 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151bc01-5ef8-4d78-b53b-8bd59eb9898a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:17.384153 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151bc01-5ef8-4d78-b53b-8bd59eb9898a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:17.401974 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 545/1062] 10.222.0.13 () {56 vars in 1154 bytes} [Mon Jan 10 12:36:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:17.407632 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c97863-15df-46a9-b09b-19138a6232c9 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:17.417496 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c97863-15df-46a9-b09b-19138a6232c9 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:17.422438 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235389a-0164-4ce1-9d72-1a74f9e8590c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:17.423220 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235389a-0164-4ce1-9d72-1a74f9e8590c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:17.423500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235389a-0164-4ce1-9d72-1a74f9e8590c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:17.423798 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235389a-0164-4ce1-9d72-1a74f9e8590c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:17.434171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235389a-0164-4ce1-9d72-1a74f9e8590c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:17.436062 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235389a-0164-4ce1-9d72-1a74f9e8590c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:17.453094 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-b235389a-0164-4ce1-9d72-1a74f9e8590c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:36:17.454292 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 518/1063] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:17.460158 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151bc01-5ef8-4d78-b53b-8bd59eb9898a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:17.470797 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151bc01-5ef8-4d78-b53b-8bd59eb9898a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:17.476323 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22df3b-4cc5-426f-a6bf-eabcbc89a751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:17.477057 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22df3b-4cc5-426f-a6bf-eabcbc89a751 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:17.477416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22df3b-4cc5-426f-a6bf-eabcbc89a751 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:17.477706 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22df3b-4cc5-426f-a6bf-eabcbc89a751 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:17.478542 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22df3b-4cc5-426f-a6bf-eabcbc89a751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:17.478832 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22df3b-4cc5-426f-a6bf-eabcbc89a751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:17.480465 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22df3b-4cc5-426f-a6bf-eabcbc89a751 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:17.492475 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 546/1064] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:17.498781 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235389a-0164-4ce1-9d72-1a74f9e8590c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:17.509563 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235389a-0164-4ce1-9d72-1a74f9e8590c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:17.515454 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43245fed-2a97-4d26-b9d4-e7e6e2ae65ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:17.516323 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43245fed-2a97-4d26-b9d4-e7e6e2ae65ce admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:17.516603 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43245fed-2a97-4d26-b9d4-e7e6e2ae65ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:17.516873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43245fed-2a97-4d26-b9d4-e7e6e2ae65ce admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:17.524858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43245fed-2a97-4d26-b9d4-e7e6e2ae65ce admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:17.526840 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43245fed-2a97-4d26-b9d4-e7e6e2ae65ce admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:17.540441 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-43245fed-2a97-4d26-b9d4-e7e6e2ae65ce admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:36:17.542711 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 519/1065] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:36:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:17.549078 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22df3b-4cc5-426f-a6bf-eabcbc89a751 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:17.559800 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22df3b-4cc5-426f-a6bf-eabcbc89a751 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:17.565586 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685ae2d-79ad-4b3f-a5f7-ba1d934ce1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:17.566343 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685ae2d-79ad-4b3f-a5f7-ba1d934ce1dd admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:17.566690 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685ae2d-79ad-4b3f-a5f7-ba1d934ce1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:17.567024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685ae2d-79ad-4b3f-a5f7-ba1d934ce1dd admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:17.567940 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685ae2d-79ad-4b3f-a5f7-ba1d934ce1dd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:17.568317 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685ae2d-79ad-4b3f-a5f7-ba1d934ce1dd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:17.570246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685ae2d-79ad-4b3f-a5f7-ba1d934ce1dd admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:17.582829 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 547/1066] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:17.588946 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43245fed-2a97-4d26-b9d4-e7e6e2ae65ce admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:17.603394 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43245fed-2a97-4d26-b9d4-e7e6e2ae65ce admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:17.611830 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6651bd-d3f0-420c-909b-b7c0988474b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:17.613167 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6651bd-d3f0-420c-909b-b7c0988474b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:17.613545 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6651bd-d3f0-420c-909b-b7c0988474b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:17.613938 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6651bd-d3f0-420c-909b-b7c0988474b7 admin admin] PATH_INFO: `/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/d68fa8e4f3a341a5b74ee32c85e59869/roles/f697c07a4ed645e683846610a1b2e341` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:17.617937 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6651bd-d3f0-420c-909b-b7c0988474b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0105f8c08c84f538cd7ba86fcd26b62, user_id=d68fa8e4f3a341a5b74ee32c85e59869, role_id=f697c07a4ed645e683846610a1b2e341)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:17.620638 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6651bd-d3f0-420c-909b-b7c0988474b7 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:17.636613 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 520/1067] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:36:17 2022] PUT /identity/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/d68fa8e4f3a341a5b74ee32c85e59869/roles/f697c07a4ed645e683846610a1b2e341 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:36:18.785660 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446222c-63a8-4493-8ee9-cd2229130ddb None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:18.786215 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446222c-63a8-4493-8ee9-cd2229130ddb None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:18.786215 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446222c-63a8-4493-8ee9-cd2229130ddb None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:18.788000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 548/1068] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:18.793354 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dc6b0-576a-4fbf-abb8-4a5722587ef4 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:18.793802 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dc6b0-576a-4fbf-abb8-4a5722587ef4 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:18.793902 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dc6b0-576a-4fbf-abb8-4a5722587ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:18.812173 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-0e1dc6b0-576a-4fbf-abb8-4a5722587ef4 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:18.813333 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-0e1dc6b0-576a-4fbf-abb8-4a5722587ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:18.871850 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 521/1069] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:18.896871 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446222c-63a8-4493-8ee9-cd2229130ddb None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:18.910261 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446222c-63a8-4493-8ee9-cd2229130ddb None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:18.915289 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b6724-17f3-453b-a043-7a766be46a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:18.916117 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b6724-17f3-453b-a043-7a766be46a75 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:18.916393 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b6724-17f3-453b-a043-7a766be46a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:18.916660 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b6724-17f3-453b-a043-7a766be46a75 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:18.927047 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b6724-17f3-453b-a043-7a766be46a75 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:36:18.933946 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-9c9b6724-17f3-453b-a043-7a766be46a75 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:36:18.935172 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 549/1070] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:36:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:18.941754 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dc6b0-576a-4fbf-abb8-4a5722587ef4 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:18.951451 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dc6b0-576a-4fbf-abb8-4a5722587ef4 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:18.957221 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd8fb5-0ed7-4a26-a31e-7e4fdc06b799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:18.957876 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd8fb5-0ed7-4a26-a31e-7e4fdc06b799 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:18.958147 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd8fb5-0ed7-4a26-a31e-7e4fdc06b799 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:18.958409 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd8fb5-0ed7-4a26-a31e-7e4fdc06b799 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:18.959169 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd8fb5-0ed7-4a26-a31e-7e4fdc06b799 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:18.959464 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd8fb5-0ed7-4a26-a31e-7e4fdc06b799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:18.961090 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd8fb5-0ed7-4a26-a31e-7e4fdc06b799 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:18.970342 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 522/1071] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:36:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:18.976308 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b6724-17f3-453b-a043-7a766be46a75 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:18.987377 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b6724-17f3-453b-a043-7a766be46a75 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:18.993725 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def76d66-f630-4e75-abf0-472273706373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:18.994589 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def76d66-f630-4e75-abf0-472273706373 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:18.994867 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def76d66-f630-4e75-abf0-472273706373 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:18.995140 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def76d66-f630-4e75-abf0-472273706373 admin admin] PATH_INFO: `/v3/users/47b2144e10c643439d1aca89c3a0047d` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:19.010005 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def76d66-f630-4e75-abf0-472273706373 admin admin] RBAC: Authorizing `identity:get_user(user_id=47b2144e10c643439d1aca89c3a0047d)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:19.012218 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def76d66-f630-4e75-abf0-472273706373 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:19.013901 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 550/1072] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:36:18 2022] GET /identity/v3/users/47b2144e10c643439d1aca89c3a0047d => generated 285 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:19.019928 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd8fb5-0ed7-4a26-a31e-7e4fdc06b799 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:19.030373 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd8fb5-0ed7-4a26-a31e-7e4fdc06b799 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:19.036133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef1a0c-9a1f-4805-9063-ab36b9b0b74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:19.036811 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef1a0c-9a1f-4805-9063-ab36b9b0b74f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:19.037091 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef1a0c-9a1f-4805-9063-ab36b9b0b74f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:19.037366 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef1a0c-9a1f-4805-9063-ab36b9b0b74f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:19.045473 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef1a0c-9a1f-4805-9063-ab36b9b0b74f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:19.047248 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef1a0c-9a1f-4805-9063-ab36b9b0b74f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:19.056262 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 523/1073] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:36:19 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:36:19.062029 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def76d66-f630-4e75-abf0-472273706373 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:19.072684 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def76d66-f630-4e75-abf0-472273706373 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:19.078094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3af67b-6a09-4e29-bb59-c28070fe1697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:19.078952 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3af67b-6a09-4e29-bb59-c28070fe1697 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:19.079226 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3af67b-6a09-4e29-bb59-c28070fe1697 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:19.079491 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3af67b-6a09-4e29-bb59-c28070fe1697 admin admin] PATH_INFO: `/v3/projects/fa4e863aca384572a8c67b4ae657b021` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:19.080855 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3af67b-6a09-4e29-bb59-c28070fe1697 admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4e863aca384572a8c67b4ae657b021)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:19.082902 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3af67b-6a09-4e29-bb59-c28070fe1697 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:19.084594 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 551/1074] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:36:19 2022] GET /identity/v3/projects/fa4e863aca384572a8c67b4ae657b021 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:19.090460 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef1a0c-9a1f-4805-9063-ab36b9b0b74f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:19.099558 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef1a0c-9a1f-4805-9063-ab36b9b0b74f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:19.105315 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf456394-3157-4426-a4bc-111030edade3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:19.105949 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf456394-3157-4426-a4bc-111030edade3 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:19.106224 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf456394-3157-4426-a4bc-111030edade3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:19.106490 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf456394-3157-4426-a4bc-111030edade3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:19.107336 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf456394-3157-4426-a4bc-111030edade3 admin admin] RBAC: Adding query filter params (role.id=9d097c033f454263a874fbafe92c9aea, scope.project.id=fa4e863aca384572a8c67b4ae657b021, user.id=47b2144e10c643439d1aca89c3a0047d) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:19.107676 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf456394-3157-4426-a4bc-111030edade3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:19.109500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf456394-3157-4426-a4bc-111030edade3 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:19.127543 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 524/1075] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:36:19 2022] GET /identity/v3/role_assignments?user.id=47b2144e10c643439d1aca89c3a0047d&scope.project.id=fa4e863aca384572a8c67b4ae657b021&role.id=9d097c033f454263a874fbafe92c9aea => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:20.026222 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f13028-f35f-487c-bb2a-6ae349999fae None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:20.026766 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f13028-f35f-487c-bb2a-6ae349999fae None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:20.026766 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f13028-f35f-487c-bb2a-6ae349999fae None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:20.028464 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 552/1076] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:20.034126 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144abb9b-5ced-4c40-8140-5f4fca101e11 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:20.034530 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144abb9b-5ced-4c40-8140-5f4fca101e11 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:20.034705 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144abb9b-5ced-4c40-8140-5f4fca101e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:20.053946 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-144abb9b-5ced-4c40-8140-5f4fca101e11 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:20.055144 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-144abb9b-5ced-4c40-8140-5f4fca101e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:20.064542 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 525/1077] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:20 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:20.090774 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f13028-f35f-487c-bb2a-6ae349999fae None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:20.105137 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f13028-f35f-487c-bb2a-6ae349999fae None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:20.110027 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30fa46-a862-4dd7-8c55-7e2127845c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:20.110834 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30fa46-a862-4dd7-8c55-7e2127845c8e admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:20.111114 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30fa46-a862-4dd7-8c55-7e2127845c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:20.111384 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30fa46-a862-4dd7-8c55-7e2127845c8e admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:20.121845 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30fa46-a862-4dd7-8c55-7e2127845c8e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:36:20.129033 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-7c30fa46-a862-4dd7-8c55-7e2127845c8e admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 10 12:36:20.130216 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 553/1078] 10.222.0.13 () {56 vars in 1141 bytes} [Mon Jan 10 12:36:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:20.136826 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144abb9b-5ced-4c40-8140-5f4fca101e11 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:20.145914 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144abb9b-5ced-4c40-8140-5f4fca101e11 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:20.151043 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8250c72-86ec-4dd1-a8cd-9b296668a9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:20.151806 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8250c72-86ec-4dd1-a8cd-9b296668a9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:20.152154 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8250c72-86ec-4dd1-a8cd-9b296668a9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:20.152492 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8250c72-86ec-4dd1-a8cd-9b296668a9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:20.153336 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8250c72-86ec-4dd1-a8cd-9b296668a9e9 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:20.153705 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8250c72-86ec-4dd1-a8cd-9b296668a9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:20.155333 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8250c72-86ec-4dd1-a8cd-9b296668a9e9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:20.164175 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 526/1079] 10.222.0.13 () {56 vars in 1136 bytes} [Mon Jan 10 12:36:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:20.170232 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30fa46-a862-4dd7-8c55-7e2127845c8e admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:20.180769 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30fa46-a862-4dd7-8c55-7e2127845c8e admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:20.185672 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bd7aa-3c47-490e-9675-42e453ab95e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:20.186447 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bd7aa-3c47-490e-9675-42e453ab95e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:20.186726 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bd7aa-3c47-490e-9675-42e453ab95e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:20.186993 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bd7aa-3c47-490e-9675-42e453ab95e9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:20.198680 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bd7aa-3c47-490e-9675-42e453ab95e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:20.200556 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bd7aa-3c47-490e-9675-42e453ab95e9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:20.217921 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-a70bd7aa-3c47-490e-9675-42e453ab95e9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:36:20.219446 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 554/1080] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:20.225391 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8250c72-86ec-4dd1-a8cd-9b296668a9e9 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:20.236640 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8250c72-86ec-4dd1-a8cd-9b296668a9e9 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:20.242275 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7fc86-9900-47b2-b38d-c37e9a668fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:20.243370 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7fc86-9900-47b2-b38d-c37e9a668fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:20.243696 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7fc86-9900-47b2-b38d-c37e9a668fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:20.243962 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7fc86-9900-47b2-b38d-c37e9a668fc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:20.244712 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7fc86-9900-47b2-b38d-c37e9a668fc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:20.245011 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7fc86-9900-47b2-b38d-c37e9a668fc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:20.246599 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7fc86-9900-47b2-b38d-c37e9a668fc0 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:20.259814 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 527/1081] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:20.265535 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bd7aa-3c47-490e-9675-42e453ab95e9 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:20.275648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bd7aa-3c47-490e-9675-42e453ab95e9 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:20.281578 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9305a38-776a-418f-94c9-d68e28c3f5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:20.282276 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9305a38-776a-418f-94c9-d68e28c3f5ff admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:20.282552 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9305a38-776a-418f-94c9-d68e28c3f5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:20.282818 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9305a38-776a-418f-94c9-d68e28c3f5ff admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:20.291197 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9305a38-776a-418f-94c9-d68e28c3f5ff admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:20.293269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9305a38-776a-418f-94c9-d68e28c3f5ff admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:20.307740 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-d9305a38-776a-418f-94c9-d68e28c3f5ff admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 10 12:36:20.308895 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 555/1082] 10.222.0.13 () {56 vars in 1114 bytes} [Mon Jan 10 12:36:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:20.315177 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7fc86-9900-47b2-b38d-c37e9a668fc0 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:20.325831 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7fc86-9900-47b2-b38d-c37e9a668fc0 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:20.331667 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cd1dd-f8ad-46e3-aba2-b7870a3e62c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:20.332388 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cd1dd-f8ad-46e3-aba2-b7870a3e62c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:20.332666 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cd1dd-f8ad-46e3-aba2-b7870a3e62c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:20.332939 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cd1dd-f8ad-46e3-aba2-b7870a3e62c1 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:20.333778 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94cd1dd-f8ad-46e3-aba2-b7870a3e62c1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:20.334070 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94cd1dd-f8ad-46e3-aba2-b7870a3e62c1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:20.335950 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94cd1dd-f8ad-46e3-aba2-b7870a3e62c1 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:20.354315 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 528/1083] 10.222.0.13 () {56 vars in 1154 bytes} [Mon Jan 10 12:36:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:20.360354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9305a38-776a-418f-94c9-d68e28c3f5ff admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:20.370056 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9305a38-776a-418f-94c9-d68e28c3f5ff admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:20.375652 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184d2b2-4896-48f1-9344-79046fe5af6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:20.376299 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184d2b2-4896-48f1-9344-79046fe5af6a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:20.376578 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184d2b2-4896-48f1-9344-79046fe5af6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:20.376844 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184d2b2-4896-48f1-9344-79046fe5af6a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:20.384897 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184d2b2-4896-48f1-9344-79046fe5af6a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:20.386661 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184d2b2-4896-48f1-9344-79046fe5af6a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:20.395361 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 556/1084] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:36:20 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:36:20.401630 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cd1dd-f8ad-46e3-aba2-b7870a3e62c1 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:20.411465 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cd1dd-f8ad-46e3-aba2-b7870a3e62c1 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:20.416544 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e9bcb-96bb-4700-ac08-43f467255f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:20.417324 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e9bcb-96bb-4700-ac08-43f467255f4d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:20.417596 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e9bcb-96bb-4700-ac08-43f467255f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:20.417861 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e9bcb-96bb-4700-ac08-43f467255f4d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:20.428107 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e9bcb-96bb-4700-ac08-43f467255f4d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:20.429932 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e9bcb-96bb-4700-ac08-43f467255f4d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:20.447318 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-5c0e9bcb-96bb-4700-ac08-43f467255f4d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:36:20.449929 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 529/1085] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:20.458405 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184d2b2-4896-48f1-9344-79046fe5af6a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:20.468068 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184d2b2-4896-48f1-9344-79046fe5af6a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:20.472557 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978da9d-e4fd-4ad0-8bb5-1cebd50ba509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:20.473218 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978da9d-e4fd-4ad0-8bb5-1cebd50ba509 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:20.473494 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978da9d-e4fd-4ad0-8bb5-1cebd50ba509 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:20.473760 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978da9d-e4fd-4ad0-8bb5-1cebd50ba509 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:20.474502 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978da9d-e4fd-4ad0-8bb5-1cebd50ba509 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:20.474806 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978da9d-e4fd-4ad0-8bb5-1cebd50ba509 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:20.476437 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978da9d-e4fd-4ad0-8bb5-1cebd50ba509 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:20.488532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 557/1086] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:20.494582 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e9bcb-96bb-4700-ac08-43f467255f4d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:20.504287 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e9bcb-96bb-4700-ac08-43f467255f4d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:20.509326 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39ff0d-7bca-48cb-884d-42e9e37049fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:20.510112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39ff0d-7bca-48cb-884d-42e9e37049fc admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:20.510385 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39ff0d-7bca-48cb-884d-42e9e37049fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:20.510650 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39ff0d-7bca-48cb-884d-42e9e37049fc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:20.517601 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39ff0d-7bca-48cb-884d-42e9e37049fc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:20.519547 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39ff0d-7bca-48cb-884d-42e9e37049fc admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:20.532438 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-cc39ff0d-7bca-48cb-884d-42e9e37049fc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:36:20.533540 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 530/1087] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:36:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:36:20.539424 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978da9d-e4fd-4ad0-8bb5-1cebd50ba509 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:20.549630 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978da9d-e4fd-4ad0-8bb5-1cebd50ba509 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:20.555531 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa60dfc-3a56-48e3-9ba4-0f787b252f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:20.556215 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa60dfc-3a56-48e3-9ba4-0f787b252f42 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:20.556492 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa60dfc-3a56-48e3-9ba4-0f787b252f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:20.556762 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa60dfc-3a56-48e3-9ba4-0f787b252f42 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:20.557562 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa60dfc-3a56-48e3-9ba4-0f787b252f42 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:20.557864 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa60dfc-3a56-48e3-9ba4-0f787b252f42 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:20.559751 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa60dfc-3a56-48e3-9ba4-0f787b252f42 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:20.573259 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 558/1088] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:36:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:20.579202 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39ff0d-7bca-48cb-884d-42e9e37049fc admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:20.589594 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39ff0d-7bca-48cb-884d-42e9e37049fc admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:20.594472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f9eef-f1c3-4909-b3cf-dac7ae05a995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:20.595093 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f9eef-f1c3-4909-b3cf-dac7ae05a995 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:20.595367 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f9eef-f1c3-4909-b3cf-dac7ae05a995 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:20.595667 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f9eef-f1c3-4909-b3cf-dac7ae05a995 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:20.596510 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f9eef-f1c3-4909-b3cf-dac7ae05a995 admin admin] RBAC: Adding query filter params (role.id=f697c07a4ed645e683846610a1b2e341, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=d68fa8e4f3a341a5b74ee32c85e59869) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:20.596812 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f9eef-f1c3-4909-b3cf-dac7ae05a995 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:20.598639 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f9eef-f1c3-4909-b3cf-dac7ae05a995 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:20.604739 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 531/1089] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:36:20 2022] GET /identity/v3/role_assignments?user.id=d68fa8e4f3a341a5b74ee32c85e59869&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=f697c07a4ed645e683846610a1b2e341 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:21.469520 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46307e8-6342-4272-b913-0147f08384a6 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:21.470048 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46307e8-6342-4272-b913-0147f08384a6 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:21.470048 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46307e8-6342-4272-b913-0147f08384a6 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:21.471966 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 559/1090] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:21.477722 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d09e4-a9a6-4d3b-9b7e-4bc20a551703 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:21.478186 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d09e4-a9a6-4d3b-9b7e-4bc20a551703 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:21.478268 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d09e4-a9a6-4d3b-9b7e-4bc20a551703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:21.496129 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-1b4d09e4-a9a6-4d3b-9b7e-4bc20a551703 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:21.497284 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-1b4d09e4-a9a6-4d3b-9b7e-4bc20a551703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:21.506141 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 532/1091] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:21 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:21.531163 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46307e8-6342-4272-b913-0147f08384a6 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:21.548854 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46307e8-6342-4272-b913-0147f08384a6 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:21.554174 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca391a4-05a2-4dfe-ab9a-bfbf31adbb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:21.554952 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca391a4-05a2-4dfe-ab9a-bfbf31adbb56 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:21.555463 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca391a4-05a2-4dfe-ab9a-bfbf31adbb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:21.555869 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca391a4-05a2-4dfe-ab9a-bfbf31adbb56 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:21.567069 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca391a4-05a2-4dfe-ab9a-bfbf31adbb56 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:36:21.573973 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-cca391a4-05a2-4dfe-ab9a-bfbf31adbb56 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:36:21.575143 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 560/1092] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:36:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:21.584079 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d09e4-a9a6-4d3b-9b7e-4bc20a551703 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:21.598268 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d09e4-a9a6-4d3b-9b7e-4bc20a551703 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:21.605453 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702864d2-484d-49ea-9fad-708d06366a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:21.606100 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702864d2-484d-49ea-9fad-708d06366a6e admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:21.606372 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702864d2-484d-49ea-9fad-708d06366a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:21.606635 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702864d2-484d-49ea-9fad-708d06366a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:21.607392 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702864d2-484d-49ea-9fad-708d06366a6e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:21.607722 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702864d2-484d-49ea-9fad-708d06366a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:21.609315 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702864d2-484d-49ea-9fad-708d06366a6e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:21.617788 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 533/1093] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:36:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:21.623419 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca391a4-05a2-4dfe-ab9a-bfbf31adbb56 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:21.636314 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca391a4-05a2-4dfe-ab9a-bfbf31adbb56 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:21.641211 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72c61c-3332-4871-83dc-e17963f3bdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:21.642057 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72c61c-3332-4871-83dc-e17963f3bdf9 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:21.642336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72c61c-3332-4871-83dc-e17963f3bdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:21.642609 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72c61c-3332-4871-83dc-e17963f3bdf9 admin admin] PATH_INFO: `/v3/users/47b2144e10c643439d1aca89c3a0047d` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:21.643871 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72c61c-3332-4871-83dc-e17963f3bdf9 admin admin] RBAC: Authorizing `identity:get_user(user_id=47b2144e10c643439d1aca89c3a0047d)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:21.646016 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a72c61c-3332-4871-83dc-e17963f3bdf9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:21.647607 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 561/1094] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:36:21 2022] GET /identity/v3/users/47b2144e10c643439d1aca89c3a0047d => generated 285 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:36:21.652982 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702864d2-484d-49ea-9fad-708d06366a6e admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:21.662338 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702864d2-484d-49ea-9fad-708d06366a6e admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:21.667617 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583908af-6d81-4283-bf94-370e6383ab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:21.668432 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583908af-6d81-4283-bf94-370e6383ab7b admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:21.668703 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583908af-6d81-4283-bf94-370e6383ab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:21.668975 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583908af-6d81-4283-bf94-370e6383ab7b admin admin] PATH_INFO: `/v3/projects/fa4e863aca384572a8c67b4ae657b021` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:21.670160 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583908af-6d81-4283-bf94-370e6383ab7b admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4e863aca384572a8c67b4ae657b021)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:21.672204 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583908af-6d81-4283-bf94-370e6383ab7b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:21.673845 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 534/1095] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:36:21 2022] GET /identity/v3/projects/fa4e863aca384572a8c67b4ae657b021 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:21.679440 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72c61c-3332-4871-83dc-e17963f3bdf9 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:21.690174 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72c61c-3332-4871-83dc-e17963f3bdf9 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:21.696207 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08078388-6af1-4336-b461-00ce21a634b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:21.697166 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08078388-6af1-4336-b461-00ce21a634b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:21.697445 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08078388-6af1-4336-b461-00ce21a634b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:21.697718 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08078388-6af1-4336-b461-00ce21a634b8 admin admin] PATH_INFO: `/v3/projects/fa4e863aca384572a8c67b4ae657b021/users/47b2144e10c643439d1aca89c3a0047d/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:21.700060 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08078388-6af1-4336-b461-00ce21a634b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4e863aca384572a8c67b4ae657b021, user_id=47b2144e10c643439d1aca89c3a0047d, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:21.702681 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08078388-6af1-4336-b461-00ce21a634b8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:21.719059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 562/1096] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:36:21 2022] PUT /identity/v3/projects/fa4e863aca384572a8c67b4ae657b021/users/47b2144e10c643439d1aca89c3a0047d/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:36:24.047369 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5917a-057e-42f4-97ae-c4485bf25f95 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:24.047931 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5917a-057e-42f4-97ae-c4485bf25f95 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:24.047931 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5917a-057e-42f4-97ae-c4485bf25f95 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:24.050594 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 535/1097] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:24.059320 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44029c1-d616-44fe-933b-0639fd15c5ab None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:24.059754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44029c1-d616-44fe-933b-0639fd15c5ab None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:24.059970 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44029c1-d616-44fe-933b-0639fd15c5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:24.082901 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-e44029c1-d616-44fe-933b-0639fd15c5ab None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:24.084123 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-e44029c1-d616-44fe-933b-0639fd15c5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:24.152521 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 563/1098] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:24 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:24.177971 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5917a-057e-42f4-97ae-c4485bf25f95 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:24.193929 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5917a-057e-42f4-97ae-c4485bf25f95 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:24.200189 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ef3f1-0030-4c8e-8e84-35386b7a4d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:24.200971 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ef3f1-0030-4c8e-8e84-35386b7a4d18 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:24.201248 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ef3f1-0030-4c8e-8e84-35386b7a4d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:24.201512 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ef3f1-0030-4c8e-8e84-35386b7a4d18 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:24.213181 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ef3f1-0030-4c8e-8e84-35386b7a4d18 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:36:24.219875 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-287ef3f1-0030-4c8e-8e84-35386b7a4d18 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:36:24.221026 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 536/1099] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:36:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:24.226997 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44029c1-d616-44fe-933b-0639fd15c5ab None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:24.235975 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44029c1-d616-44fe-933b-0639fd15c5ab None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:24.241093 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4120719-5478-4f5b-91aa-118ecf07fd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:24.241745 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4120719-5478-4f5b-91aa-118ecf07fd83 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:24.242020 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4120719-5478-4f5b-91aa-118ecf07fd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:24.242400 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4120719-5478-4f5b-91aa-118ecf07fd83 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:24.243972 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4120719-5478-4f5b-91aa-118ecf07fd83 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:24.244381 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4120719-5478-4f5b-91aa-118ecf07fd83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:24.245995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4120719-5478-4f5b-91aa-118ecf07fd83 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:24.254397 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 564/1100] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:36:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:24.260575 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ef3f1-0030-4c8e-8e84-35386b7a4d18 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:24.271796 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ef3f1-0030-4c8e-8e84-35386b7a4d18 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:24.278303 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d52406-db3c-41ad-8be7-b7bde608dc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:24.279145 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d52406-db3c-41ad-8be7-b7bde608dc03 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:24.279419 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d52406-db3c-41ad-8be7-b7bde608dc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:24.279706 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d52406-db3c-41ad-8be7-b7bde608dc03 admin admin] PATH_INFO: `/v3/users/47b2144e10c643439d1aca89c3a0047d` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:24.281126 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d52406-db3c-41ad-8be7-b7bde608dc03 admin admin] RBAC: Authorizing `identity:get_user(user_id=47b2144e10c643439d1aca89c3a0047d)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:24.283246 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d52406-db3c-41ad-8be7-b7bde608dc03 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:24.284910 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 537/1101] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:36:24 2022] GET /identity/v3/users/47b2144e10c643439d1aca89c3a0047d => generated 285 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:24.290406 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4120719-5478-4f5b-91aa-118ecf07fd83 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:24.300778 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4120719-5478-4f5b-91aa-118ecf07fd83 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:24.306317 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8bb82-d111-4d76-8bc4-4a53a83ec9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:24.306933 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8bb82-d111-4d76-8bc4-4a53a83ec9cf admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:24.307208 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8bb82-d111-4d76-8bc4-4a53a83ec9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:24.307474 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8bb82-d111-4d76-8bc4-4a53a83ec9cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:24.315621 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8bb82-d111-4d76-8bc4-4a53a83ec9cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:24.317338 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8bb82-d111-4d76-8bc4-4a53a83ec9cf admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:24.326113 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 565/1102] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:36:24 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:36:24.331539 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d52406-db3c-41ad-8be7-b7bde608dc03 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:24.342670 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d52406-db3c-41ad-8be7-b7bde608dc03 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:24.348380 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef3a04-2f26-41d2-b9e9-f5cbb120cba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:24.349220 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef3a04-2f26-41d2-b9e9-f5cbb120cba8 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:24.349499 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef3a04-2f26-41d2-b9e9-f5cbb120cba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:24.349760 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef3a04-2f26-41d2-b9e9-f5cbb120cba8 admin admin] PATH_INFO: `/v3/projects/fa4e863aca384572a8c67b4ae657b021` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:24.351055 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef3a04-2f26-41d2-b9e9-f5cbb120cba8 admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4e863aca384572a8c67b4ae657b021)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:24.353606 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef3a04-2f26-41d2-b9e9-f5cbb120cba8 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:24.355218 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 538/1103] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:36:24 2022] GET /identity/v3/projects/fa4e863aca384572a8c67b4ae657b021 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:24.360738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8bb82-d111-4d76-8bc4-4a53a83ec9cf admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:24.369342 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8bb82-d111-4d76-8bc4-4a53a83ec9cf admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:24.374321 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411fe4c-7b17-43c9-b04f-31860a4d07cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:24.374924 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411fe4c-7b17-43c9-b04f-31860a4d07cf admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:24.375193 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411fe4c-7b17-43c9-b04f-31860a4d07cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:24.375464 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411fe4c-7b17-43c9-b04f-31860a4d07cf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:24.376351 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411fe4c-7b17-43c9-b04f-31860a4d07cf admin admin] RBAC: Adding query filter params (role.id=9d097c033f454263a874fbafe92c9aea, scope.project.id=fa4e863aca384572a8c67b4ae657b021, user.id=47b2144e10c643439d1aca89c3a0047d) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:24.376652 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411fe4c-7b17-43c9-b04f-31860a4d07cf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:24.378452 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411fe4c-7b17-43c9-b04f-31860a4d07cf admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:24.384364 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 566/1104] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:36:24 2022] GET /identity/v3/role_assignments?user.id=47b2144e10c643439d1aca89c3a0047d&scope.project.id=fa4e863aca384572a8c67b4ae657b021&role.id=9d097c033f454263a874fbafe92c9aea => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:26.797851 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7f8fb-6249-42fd-a689-2f71e9b188b2 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:26.798715 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7f8fb-6249-42fd-a689-2f71e9b188b2 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:26.798947 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7f8fb-6249-42fd-a689-2f71e9b188b2 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:26.801872 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 539/1105] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:26.809789 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255bbe0-af4a-4b0a-a53b-1b6aaf2d777f None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:26.810233 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255bbe0-af4a-4b0a-a53b-1b6aaf2d777f None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:26.810325 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255bbe0-af4a-4b0a-a53b-1b6aaf2d777f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:26.829850 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-6255bbe0-af4a-4b0a-a53b-1b6aaf2d777f None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:26.831018 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-6255bbe0-af4a-4b0a-a53b-1b6aaf2d777f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:26.839353 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 567/1106] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:26 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:36:26.871306 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7f8fb-6249-42fd-a689-2f71e9b188b2 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:26.891444 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7f8fb-6249-42fd-a689-2f71e9b188b2 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:26.896400 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b0e9b-a7fb-4439-a9d2-cb81e55bfd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:26.897182 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b0e9b-a7fb-4439-a9d2-cb81e55bfd77 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:26.897462 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b0e9b-a7fb-4439-a9d2-cb81e55bfd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:26.897729 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b0e9b-a7fb-4439-a9d2-cb81e55bfd77 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:26.899127 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b0e9b-a7fb-4439-a9d2-cb81e55bfd77 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:26.900869 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b0e9b-a7fb-4439-a9d2-cb81e55bfd77 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:26.902467 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 540/1107] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:36:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:26.911698 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255bbe0-af4a-4b0a-a53b-1b6aaf2d777f None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:26.922929 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255bbe0-af4a-4b0a-a53b-1b6aaf2d777f None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:26.929441 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f329c2-f0cb-4a6c-b676-f86ff32e1516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:26.930429 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f329c2-f0cb-4a6c-b676-f86ff32e1516 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:26.930595 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f329c2-f0cb-4a6c-b676-f86ff32e1516 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:26.930849 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f329c2-f0cb-4a6c-b676-f86ff32e1516 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:26.931574 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f329c2-f0cb-4a6c-b676-f86ff32e1516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:26.933494 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f329c2-f0cb-4a6c-b676-f86ff32e1516 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:26.955802 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 568/1108] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Jan 10 12:36:26 2022] POST /identity/v3/users => generated 286 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:36:29.391797 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80bbcd-5334-4e81-b361-6700508adb67 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:29.392664 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80bbcd-5334-4e81-b361-6700508adb67 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:29.392664 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80bbcd-5334-4e81-b361-6700508adb67 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:29.395505 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 541/1109] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:29.404293 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab3039-b9da-4bb5-9ab0-fdd1eeb69b90 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:29.404707 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab3039-b9da-4bb5-9ab0-fdd1eeb69b90 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:29.404898 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab3039-b9da-4bb5-9ab0-fdd1eeb69b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:29.427566 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-56ab3039-b9da-4bb5-9ab0-fdd1eeb69b90 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:29.428789 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-56ab3039-b9da-4bb5-9ab0-fdd1eeb69b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:29.438378 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 569/1110] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:29 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:29.464880 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80bbcd-5334-4e81-b361-6700508adb67 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:29.487298 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80bbcd-5334-4e81-b361-6700508adb67 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:29.495383 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794ccf5-6e36-4f9a-8f87-df1fb9c01dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:29.496251 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794ccf5-6e36-4f9a-8f87-df1fb9c01dae admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:29.496520 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794ccf5-6e36-4f9a-8f87-df1fb9c01dae admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:29.496782 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794ccf5-6e36-4f9a-8f87-df1fb9c01dae admin admin] PATH_INFO: `/v3/roles/6d59759e4d584ea688a6c0883ef5d9c6` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:29.498401 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794ccf5-6e36-4f9a-8f87-df1fb9c01dae admin admin] RBAC: Authorizing `identity:get_role(role_id=6d59759e4d584ea688a6c0883ef5d9c6)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:29.499436 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-d794ccf5-6e36-4f9a-8f87-df1fb9c01dae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:36:29.499436 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:36:29.499436 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:36:29.500335 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794ccf5-6e36-4f9a-8f87-df1fb9c01dae admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:29.501650 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 542/1111] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:36:29 2022] GET /identity/v3/roles/6d59759e4d584ea688a6c0883ef5d9c6 => generated 223 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:29.507386 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab3039-b9da-4bb5-9ab0-fdd1eeb69b90 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:29.516519 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab3039-b9da-4bb5-9ab0-fdd1eeb69b90 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:29.521518 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922234c5-0e88-442f-ad35-858e5ab66470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:29.522369 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922234c5-0e88-442f-ad35-858e5ab66470 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:29.522648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922234c5-0e88-442f-ad35-858e5ab66470 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:29.522910 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922234c5-0e88-442f-ad35-858e5ab66470 admin admin] PATH_INFO: `/v3/users/68a6e4f18aa3467da83f5dc1e0d7626c` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:29.536478 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922234c5-0e88-442f-ad35-858e5ab66470 admin admin] RBAC: Authorizing `identity:get_user(user_id=68a6e4f18aa3467da83f5dc1e0d7626c)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:29.538648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922234c5-0e88-442f-ad35-858e5ab66470 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:29.540321 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 570/1112] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:36:29 2022] GET /identity/v3/users/68a6e4f18aa3467da83f5dc1e0d7626c => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:29.546026 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794ccf5-6e36-4f9a-8f87-df1fb9c01dae admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:29.557230 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794ccf5-6e36-4f9a-8f87-df1fb9c01dae admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:29.562999 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f141a0-6692-484d-9070-aaf90d688835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:29.563646 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f141a0-6692-484d-9070-aaf90d688835 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:29.563921 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f141a0-6692-484d-9070-aaf90d688835 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:29.564182 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f141a0-6692-484d-9070-aaf90d688835 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:29.573439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f141a0-6692-484d-9070-aaf90d688835 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:29.575163 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f141a0-6692-484d-9070-aaf90d688835 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:29.584695 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 543/1113] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:36:29 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:36:29.593077 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922234c5-0e88-442f-ad35-858e5ab66470 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:29.609104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922234c5-0e88-442f-ad35-858e5ab66470 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:29.618423 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d7558-57f8-47a6-8a80-2cb9de544c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:29.619256 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d7558-57f8-47a6-8a80-2cb9de544c3c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:29.619537 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d7558-57f8-47a6-8a80-2cb9de544c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:29.619847 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d7558-57f8-47a6-8a80-2cb9de544c3c admin admin] PATH_INFO: `/v3/projects/fa4e863aca384572a8c67b4ae657b021` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:29.621188 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d7558-57f8-47a6-8a80-2cb9de544c3c admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4e863aca384572a8c67b4ae657b021)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:29.623208 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d7558-57f8-47a6-8a80-2cb9de544c3c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:29.624882 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 571/1114] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:36:29 2022] GET /identity/v3/projects/fa4e863aca384572a8c67b4ae657b021 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:29.631426 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f141a0-6692-484d-9070-aaf90d688835 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:29.646312 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f141a0-6692-484d-9070-aaf90d688835 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:29.653454 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f20fc4-fcee-4a6a-aeaa-74695c49cddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:29.654067 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f20fc4-fcee-4a6a-aeaa-74695c49cddf admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:29.654336 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f20fc4-fcee-4a6a-aeaa-74695c49cddf admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:29.654629 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f20fc4-fcee-4a6a-aeaa-74695c49cddf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:29.655455 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f20fc4-fcee-4a6a-aeaa-74695c49cddf admin admin] RBAC: Adding query filter params (role.id=6d59759e4d584ea688a6c0883ef5d9c6, scope.project.id=fa4e863aca384572a8c67b4ae657b021, user.id=68a6e4f18aa3467da83f5dc1e0d7626c) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:29.655788 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f20fc4-fcee-4a6a-aeaa-74695c49cddf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:29.657572 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f20fc4-fcee-4a6a-aeaa-74695c49cddf admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:29.663274 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 544/1115] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:36:29 2022] GET /identity/v3/role_assignments?user.id=68a6e4f18aa3467da83f5dc1e0d7626c&scope.project.id=fa4e863aca384572a8c67b4ae657b021&role.id=6d59759e4d584ea688a6c0883ef5d9c6 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:32.045350 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec31b2e-0ec8-4c4d-8cd4-74d5d5c4e13c None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:32.046296 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec31b2e-0ec8-4c4d-8cd4-74d5d5c4e13c None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:32.046296 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec31b2e-0ec8-4c4d-8cd4-74d5d5c4e13c None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:32.048998 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 572/1116] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:32.055186 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a96b8-bb74-46d3-a10c-e61b7026edbd None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:32.056114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a96b8-bb74-46d3-a10c-e61b7026edbd None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:32.056114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a96b8-bb74-46d3-a10c-e61b7026edbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:32.080860 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-cc5a96b8-bb74-46d3-a10c-e61b7026edbd None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:32.082051 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-cc5a96b8-bb74-46d3-a10c-e61b7026edbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:32.091409 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 545/1117] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:32 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:32.119809 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec31b2e-0ec8-4c4d-8cd4-74d5d5c4e13c None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:32.139027 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec31b2e-0ec8-4c4d-8cd4-74d5d5c4e13c None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:32.145324 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b33028-1c0c-4a74-a641-8883b481b714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:32.146172 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b33028-1c0c-4a74-a641-8883b481b714 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:32.146450 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b33028-1c0c-4a74-a641-8883b481b714 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:32.146716 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b33028-1c0c-4a74-a641-8883b481b714 admin admin] PATH_INFO: `/v3/roles/6d59759e4d584ea688a6c0883ef5d9c6` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:32.148445 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b33028-1c0c-4a74-a641-8883b481b714 admin admin] RBAC: Authorizing `identity:get_role(role_id=6d59759e4d584ea688a6c0883ef5d9c6)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:32.149533 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING py.warnings [None req-04b33028-1c0c-4a74-a641-8883b481b714 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:36:32.149533 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: warnings.warn(msg) Jan 10 12:36:32.149533 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: Jan 10 12:36:32.150410 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b33028-1c0c-4a74-a641-8883b481b714 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:32.151763 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 573/1118] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:36:32 2022] GET /identity/v3/roles/6d59759e4d584ea688a6c0883ef5d9c6 => generated 223 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:32.160862 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a96b8-bb74-46d3-a10c-e61b7026edbd None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:32.171854 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a96b8-bb74-46d3-a10c-e61b7026edbd None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:32.177711 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9a5d1-b1a3-4e8d-9b01-7d2f47826698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:32.178563 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9a5d1-b1a3-4e8d-9b01-7d2f47826698 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:32.178835 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9a5d1-b1a3-4e8d-9b01-7d2f47826698 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:32.179096 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9a5d1-b1a3-4e8d-9b01-7d2f47826698 admin admin] PATH_INFO: `/v3/users/68a6e4f18aa3467da83f5dc1e0d7626c` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:32.180571 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9a5d1-b1a3-4e8d-9b01-7d2f47826698 admin admin] RBAC: Authorizing `identity:get_user(user_id=68a6e4f18aa3467da83f5dc1e0d7626c)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:32.182667 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9a5d1-b1a3-4e8d-9b01-7d2f47826698 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:32.184264 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 546/1119] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:36:32 2022] GET /identity/v3/users/68a6e4f18aa3467da83f5dc1e0d7626c => generated 286 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:32.189941 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b33028-1c0c-4a74-a641-8883b481b714 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:32.200698 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b33028-1c0c-4a74-a641-8883b481b714 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:32.207059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f3228-f263-4fef-a33d-6780d33c78c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:32.207911 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f3228-f263-4fef-a33d-6780d33c78c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:32.208194 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f3228-f263-4fef-a33d-6780d33c78c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:32.208460 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f3228-f263-4fef-a33d-6780d33c78c7 admin admin] PATH_INFO: `/v3/projects/fa4e863aca384572a8c67b4ae657b021` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:32.209839 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f3228-f263-4fef-a33d-6780d33c78c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4e863aca384572a8c67b4ae657b021)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:32.211923 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f3228-f263-4fef-a33d-6780d33c78c7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:32.213549 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 574/1120] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:36:32 2022] GET /identity/v3/projects/fa4e863aca384572a8c67b4ae657b021 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:32.222675 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9a5d1-b1a3-4e8d-9b01-7d2f47826698 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:32.235377 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9a5d1-b1a3-4e8d-9b01-7d2f47826698 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:32.241132 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ded296-b61a-4b27-a1e7-a6ad16a65433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:32.241981 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ded296-b61a-4b27-a1e7-a6ad16a65433 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:32.242290 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ded296-b61a-4b27-a1e7-a6ad16a65433 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:32.242672 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ded296-b61a-4b27-a1e7-a6ad16a65433 admin admin] PATH_INFO: `/v3/projects/fa4e863aca384572a8c67b4ae657b021/users/68a6e4f18aa3467da83f5dc1e0d7626c/roles/6d59759e4d584ea688a6c0883ef5d9c6` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:32.245373 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ded296-b61a-4b27-a1e7-a6ad16a65433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4e863aca384572a8c67b4ae657b021, user_id=68a6e4f18aa3467da83f5dc1e0d7626c, role_id=6d59759e4d584ea688a6c0883ef5d9c6)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:32.248003 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ded296-b61a-4b27-a1e7-a6ad16a65433 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:32.265324 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 547/1121] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:36:32 2022] PUT /identity/v3/projects/fa4e863aca384572a8c67b4ae657b021/users/68a6e4f18aa3467da83f5dc1e0d7626c/roles/6d59759e4d584ea688a6c0883ef5d9c6 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:36:34.626103 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a11859-ce96-4af0-ba56-e20c45be0ec4 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:34.626668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a11859-ce96-4af0-ba56-e20c45be0ec4 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:34.626668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a11859-ce96-4af0-ba56-e20c45be0ec4 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:34.629590 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 575/1122] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:34.637406 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83850d13-739f-43de-a29a-8d990c89e4ef None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:34.637808 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83850d13-739f-43de-a29a-8d990c89e4ef None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:34.637980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83850d13-739f-43de-a29a-8d990c89e4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:34.666554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-83850d13-739f-43de-a29a-8d990c89e4ef None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:34.667749 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-83850d13-739f-43de-a29a-8d990c89e4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:34.730864 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 548/1123] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:34 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:34.756846 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a11859-ce96-4af0-ba56-e20c45be0ec4 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:34.770626 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a11859-ce96-4af0-ba56-e20c45be0ec4 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:34.776423 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd171f-0560-424c-93cc-c89e2fe13d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:34.777439 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd171f-0560-424c-93cc-c89e2fe13d37 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:34.777584 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd171f-0560-424c-93cc-c89e2fe13d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:34.777785 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd171f-0560-424c-93cc-c89e2fe13d37 admin admin] PATH_INFO: `/v3/roles/6d59759e4d584ea688a6c0883ef5d9c6` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:34.779285 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd171f-0560-424c-93cc-c89e2fe13d37 admin admin] RBAC: Authorizing `identity:get_role(role_id=6d59759e4d584ea688a6c0883ef5d9c6)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:34.780926 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd171f-0560-424c-93cc-c89e2fe13d37 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:34.782271 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 576/1124] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:36:34 2022] GET /identity/v3/roles/6d59759e4d584ea688a6c0883ef5d9c6 => generated 223 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:34.788703 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83850d13-739f-43de-a29a-8d990c89e4ef None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:34.802247 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83850d13-739f-43de-a29a-8d990c89e4ef None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:34.809244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdf8bb-a233-4dce-9389-d85f92ddfe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:34.810114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdf8bb-a233-4dce-9389-d85f92ddfe29 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:34.810390 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdf8bb-a233-4dce-9389-d85f92ddfe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:34.810656 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afdf8bb-a233-4dce-9389-d85f92ddfe29 admin admin] PATH_INFO: `/v3/users/68a6e4f18aa3467da83f5dc1e0d7626c` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:34.812052 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afdf8bb-a233-4dce-9389-d85f92ddfe29 admin admin] RBAC: Authorizing `identity:get_user(user_id=68a6e4f18aa3467da83f5dc1e0d7626c)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:34.814187 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afdf8bb-a233-4dce-9389-d85f92ddfe29 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:34.816213 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 549/1125] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:36:34 2022] GET /identity/v3/users/68a6e4f18aa3467da83f5dc1e0d7626c => generated 286 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:34.822038 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd171f-0560-424c-93cc-c89e2fe13d37 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:34.831690 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd171f-0560-424c-93cc-c89e2fe13d37 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:34.837308 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda72a9c-f924-4a90-a41f-ca6c224d25ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:34.837929 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda72a9c-f924-4a90-a41f-ca6c224d25ab admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:34.838203 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda72a9c-f924-4a90-a41f-ca6c224d25ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:34.838470 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda72a9c-f924-4a90-a41f-ca6c224d25ab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:34.846320 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda72a9c-f924-4a90-a41f-ca6c224d25ab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:34.848075 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda72a9c-f924-4a90-a41f-ca6c224d25ab admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:34.857279 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 577/1126] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:36:34 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:36:34.863010 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdf8bb-a233-4dce-9389-d85f92ddfe29 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:34.873715 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afdf8bb-a233-4dce-9389-d85f92ddfe29 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:34.880388 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc6ebe-81f8-4714-8a51-f0c2b83213d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:34.881146 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc6ebe-81f8-4714-8a51-f0c2b83213d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:34.881420 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc6ebe-81f8-4714-8a51-f0c2b83213d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:34.881688 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc6ebe-81f8-4714-8a51-f0c2b83213d5 admin admin] PATH_INFO: `/v3/projects/fa4e863aca384572a8c67b4ae657b021` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:34.883071 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc6ebe-81f8-4714-8a51-f0c2b83213d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=fa4e863aca384572a8c67b4ae657b021)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:34.885116 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc6ebe-81f8-4714-8a51-f0c2b83213d5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:34.886725 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 550/1127] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:36:34 2022] GET /identity/v3/projects/fa4e863aca384572a8c67b4ae657b021 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:34.892549 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda72a9c-f924-4a90-a41f-ca6c224d25ab admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:34.901581 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda72a9c-f924-4a90-a41f-ca6c224d25ab admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:34.906988 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8c7ff-af45-43db-af52-811457811ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:34.907592 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8c7ff-af45-43db-af52-811457811ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:34.907870 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8c7ff-af45-43db-af52-811457811ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:34.908135 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8c7ff-af45-43db-af52-811457811ed1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:34.908950 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8c7ff-af45-43db-af52-811457811ed1 admin admin] RBAC: Adding query filter params (role.id=6d59759e4d584ea688a6c0883ef5d9c6, scope.project.id=fa4e863aca384572a8c67b4ae657b021, user.id=68a6e4f18aa3467da83f5dc1e0d7626c) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:34.909255 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8c7ff-af45-43db-af52-811457811ed1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:34.911037 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8c7ff-af45-43db-af52-811457811ed1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:34.917127 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 578/1128] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:36:34 2022] GET /identity/v3/role_assignments?user.id=68a6e4f18aa3467da83f5dc1e0d7626c&scope.project.id=fa4e863aca384572a8c67b4ae657b021&role.id=6d59759e4d584ea688a6c0883ef5d9c6 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:36:37.316105 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741416c7-1fc4-4ad8-b22b-fd090f2c9463 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:37.316974 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741416c7-1fc4-4ad8-b22b-fd090f2c9463 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:37.316974 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741416c7-1fc4-4ad8-b22b-fd090f2c9463 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:37.319766 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 551/1129] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:37.325827 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4343c-d367-4dc9-8ef6-f311fd6b4db8 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:37.326263 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4343c-d367-4dc9-8ef6-f311fd6b4db8 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:37.326353 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4343c-d367-4dc9-8ef6-f311fd6b4db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:37.345733 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-dac4343c-d367-4dc9-8ef6-f311fd6b4db8 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:37.346917 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-dac4343c-d367-4dc9-8ef6-f311fd6b4db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:37.355791 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 579/1130] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:37 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:37.382167 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741416c7-1fc4-4ad8-b22b-fd090f2c9463 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:37.404874 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741416c7-1fc4-4ad8-b22b-fd090f2c9463 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:37.414081 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8393ce24-a958-4f7f-98e7-144732447a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:37.415259 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393ce24-a958-4f7f-98e7-144732447a20 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:37.415553 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393ce24-a958-4f7f-98e7-144732447a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:37.415823 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8393ce24-a958-4f7f-98e7-144732447a20 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:37.417201 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393ce24-a958-4f7f-98e7-144732447a20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:37.418883 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8393ce24-a958-4f7f-98e7-144732447a20 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:37.420491 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 552/1131] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:36:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:37.429332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4343c-d367-4dc9-8ef6-f311fd6b4db8 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:37.444728 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4343c-d367-4dc9-8ef6-f311fd6b4db8 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:37.451030 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b65c1d-1c17-4bc8-ad83-321813e0b62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:37.451721 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b65c1d-1c17-4bc8-ad83-321813e0b62c admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:37.451989 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b65c1d-1c17-4bc8-ad83-321813e0b62c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:37.452270 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b65c1d-1c17-4bc8-ad83-321813e0b62c admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:37.453000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b65c1d-1c17-4bc8-ad83-321813e0b62c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:37.454886 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b65c1d-1c17-4bc8-ad83-321813e0b62c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:37.484001 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 580/1132] 10.222.0.13 () {60 vars in 1162 bytes} [Mon Jan 10 12:36:37 2022] POST /identity/v3/projects => generated 311 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:36:39.903322 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8a027-bf88-4422-9c4d-4a348345f4c6 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:39.904291 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8a027-bf88-4422-9c4d-4a348345f4c6 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:39.904291 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8a027-bf88-4422-9c4d-4a348345f4c6 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:39.907131 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 553/1133] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:39.912562 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58145c35-0597-436d-a288-b148817b6c98 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:39.913004 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58145c35-0597-436d-a288-b148817b6c98 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:39.913101 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58145c35-0597-436d-a288-b148817b6c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:39.932612 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-58145c35-0597-436d-a288-b148817b6c98 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:39.933793 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-58145c35-0597-436d-a288-b148817b6c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:39.992274 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 581/1134] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:39 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:40.019710 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8a027-bf88-4422-9c4d-4a348345f4c6 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:40.036665 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8a027-bf88-4422-9c4d-4a348345f4c6 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:40.043568 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c105a20-15cf-4a5a-95a1-a9ace19739a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:40.044369 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c105a20-15cf-4a5a-95a1-a9ace19739a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:40.044640 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c105a20-15cf-4a5a-95a1-a9ace19739a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:40.044901 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c105a20-15cf-4a5a-95a1-a9ace19739a6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:40.046347 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c105a20-15cf-4a5a-95a1-a9ace19739a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:40.048074 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c105a20-15cf-4a5a-95a1-a9ace19739a6 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:40.049657 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 554/1135] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:36:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:40.057612 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58145c35-0597-436d-a288-b148817b6c98 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:40.067190 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58145c35-0597-436d-a288-b148817b6c98 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:40.073318 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794feead-4b06-4516-b81b-0c7e0c37f75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:40.073974 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794feead-4b06-4516-b81b-0c7e0c37f75b admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:40.074249 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794feead-4b06-4516-b81b-0c7e0c37f75b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:40.074513 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794feead-4b06-4516-b81b-0c7e0c37f75b admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:40.075236 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794feead-4b06-4516-b81b-0c7e0c37f75b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:40.077230 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794feead-4b06-4516-b81b-0c7e0c37f75b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:40.105180 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 582/1136] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Jan 10 12:36:40 2022] POST /identity/v3/users => generated 286 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:36:42.550022 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dc083-61c8-42d4-9055-b20eb43d0bea None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:42.550927 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dc083-61c8-42d4-9055-b20eb43d0bea None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:42.550927 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dc083-61c8-42d4-9055-b20eb43d0bea None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:42.553787 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 555/1137] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:42.560929 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f070b0-d025-4582-b43e-54d2f792d497 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:42.561498 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f070b0-d025-4582-b43e-54d2f792d497 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:42.561865 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f070b0-d025-4582-b43e-54d2f792d497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:42.589666 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-34f070b0-d025-4582-b43e-54d2f792d497 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:42.591582 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-34f070b0-d025-4582-b43e-54d2f792d497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:42.604967 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 583/1138] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:42 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:42.630837 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124dc083-61c8-42d4-9055-b20eb43d0bea None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:42.645625 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124dc083-61c8-42d4-9055-b20eb43d0bea None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:42.651145 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012e8f5-7250-4a69-8886-919699391546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:42.651956 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012e8f5-7250-4a69-8886-919699391546 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:42.652235 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012e8f5-7250-4a69-8886-919699391546 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:42.652501 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012e8f5-7250-4a69-8886-919699391546 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:42.663164 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012e8f5-7250-4a69-8886-919699391546 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:36:42.669900 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-3012e8f5-7250-4a69-8886-919699391546 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:36:42.671041 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 556/1139] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:36:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:42.681562 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f070b0-d025-4582-b43e-54d2f792d497 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:42.696341 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f070b0-d025-4582-b43e-54d2f792d497 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:42.702168 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6df509-2ff5-48c8-a9db-52d0df85cb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:42.702824 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6df509-2ff5-48c8-a9db-52d0df85cb43 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:42.703093 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6df509-2ff5-48c8-a9db-52d0df85cb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:42.703354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6df509-2ff5-48c8-a9db-52d0df85cb43 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:42.704148 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6df509-2ff5-48c8-a9db-52d0df85cb43 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:42.704445 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6df509-2ff5-48c8-a9db-52d0df85cb43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:42.706042 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6df509-2ff5-48c8-a9db-52d0df85cb43 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:42.715270 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 584/1140] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:36:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:42.721048 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012e8f5-7250-4a69-8886-919699391546 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:42.731706 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012e8f5-7250-4a69-8886-919699391546 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:42.737685 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589595a-b190-4334-8f4b-3af2f220b6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:42.738534 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589595a-b190-4334-8f4b-3af2f220b6ee admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:42.738807 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589595a-b190-4334-8f4b-3af2f220b6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:42.739069 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589595a-b190-4334-8f4b-3af2f220b6ee admin admin] PATH_INFO: `/v3/users/1fbf401371dd406ea67397a30377003f` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:42.754412 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589595a-b190-4334-8f4b-3af2f220b6ee admin admin] RBAC: Authorizing `identity:get_user(user_id=1fbf401371dd406ea67397a30377003f)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:42.756568 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589595a-b190-4334-8f4b-3af2f220b6ee admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:42.758488 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 557/1141] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:36:42 2022] GET /identity/v3/users/1fbf401371dd406ea67397a30377003f => generated 286 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:42.764358 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6df509-2ff5-48c8-a9db-52d0df85cb43 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:42.775050 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6df509-2ff5-48c8-a9db-52d0df85cb43 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:42.781105 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbce0e1-a6e4-4487-9047-9b7a9869e183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:42.781731 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbce0e1-a6e4-4487-9047-9b7a9869e183 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:42.782004 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbce0e1-a6e4-4487-9047-9b7a9869e183 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:42.782266 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbce0e1-a6e4-4487-9047-9b7a9869e183 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:42.791093 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbce0e1-a6e4-4487-9047-9b7a9869e183 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:42.792930 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbce0e1-a6e4-4487-9047-9b7a9869e183 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:42.806956 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 585/1142] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:36:42 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:36:42.813611 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589595a-b190-4334-8f4b-3af2f220b6ee admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:42.827121 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589595a-b190-4334-8f4b-3af2f220b6ee admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:42.832880 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ee5c0-c5f0-4f41-8c99-9e553e86a4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:42.833724 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ee5c0-c5f0-4f41-8c99-9e553e86a4ac admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:42.833996 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ee5c0-c5f0-4f41-8c99-9e553e86a4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:42.834259 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ee5c0-c5f0-4f41-8c99-9e553e86a4ac admin admin] PATH_INFO: `/v3/projects/f6252e7f32eb4c43b4191d9debb9a393` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:42.835612 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ee5c0-c5f0-4f41-8c99-9e553e86a4ac admin admin] RBAC: Authorizing `identity:get_project(project_id=f6252e7f32eb4c43b4191d9debb9a393)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:42.837935 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ee5c0-c5f0-4f41-8c99-9e553e86a4ac admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:42.839573 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 558/1143] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:36:42 2022] GET /identity/v3/projects/f6252e7f32eb4c43b4191d9debb9a393 => generated 311 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:36:42.845594 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbce0e1-a6e4-4487-9047-9b7a9869e183 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:42.854851 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbce0e1-a6e4-4487-9047-9b7a9869e183 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:42.860723 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c242863-cb34-41ff-ae78-ead079c69a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:42.861361 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c242863-cb34-41ff-ae78-ead079c69a18 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:42.861639 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c242863-cb34-41ff-ae78-ead079c69a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:42.861904 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c242863-cb34-41ff-ae78-ead079c69a18 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:42.862782 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c242863-cb34-41ff-ae78-ead079c69a18 admin admin] RBAC: Adding query filter params (role.id=9d097c033f454263a874fbafe92c9aea, scope.project.id=f6252e7f32eb4c43b4191d9debb9a393, user.id=1fbf401371dd406ea67397a30377003f) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:42.863120 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c242863-cb34-41ff-ae78-ead079c69a18 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:42.865002 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c242863-cb34-41ff-ae78-ead079c69a18 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:42.870792 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 586/1144] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:36:42 2022] GET /identity/v3/role_assignments?user.id=1fbf401371dd406ea67397a30377003f&scope.project.id=f6252e7f32eb4c43b4191d9debb9a393&role.id=9d097c033f454263a874fbafe92c9aea => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:45.205327 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cbe10-425c-4183-9b65-92dafa44ccc2 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:45.205895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cbe10-425c-4183-9b65-92dafa44ccc2 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:45.205895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cbe10-425c-4183-9b65-92dafa44ccc2 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:45.207665 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 559/1145] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:45.214126 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1d7dd-f317-4c7f-ae96-a52600cd39cb None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:45.214849 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1d7dd-f317-4c7f-ae96-a52600cd39cb None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:45.215000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1d7dd-f317-4c7f-ae96-a52600cd39cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:45.243470 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-faf1d7dd-f317-4c7f-ae96-a52600cd39cb None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:45.244664 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-faf1d7dd-f317-4c7f-ae96-a52600cd39cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:45.252783 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 587/1146] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:45 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:45.277730 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19cbe10-425c-4183-9b65-92dafa44ccc2 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:45.300232 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19cbe10-425c-4183-9b65-92dafa44ccc2 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:45.307794 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9123e9-a0e2-4775-9686-0f5d712837c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:45.308573 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9123e9-a0e2-4775-9686-0f5d712837c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:45.308852 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9123e9-a0e2-4775-9686-0f5d712837c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:45.309113 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9123e9-a0e2-4775-9686-0f5d712837c5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:45.320782 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9123e9-a0e2-4775-9686-0f5d712837c5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:36:45.327421 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-5a9123e9-a0e2-4775-9686-0f5d712837c5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:36:45.328589 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 560/1147] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:36:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:45.334874 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1d7dd-f317-4c7f-ae96-a52600cd39cb None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:45.344528 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1d7dd-f317-4c7f-ae96-a52600cd39cb None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:45.350294 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42a449-8445-4fc7-b0f9-b8ef3dae94cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:45.350952 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42a449-8445-4fc7-b0f9-b8ef3dae94cc admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:45.351222 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42a449-8445-4fc7-b0f9-b8ef3dae94cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:45.351571 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42a449-8445-4fc7-b0f9-b8ef3dae94cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:45.352674 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42a449-8445-4fc7-b0f9-b8ef3dae94cc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:45.352976 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42a449-8445-4fc7-b0f9-b8ef3dae94cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:45.354576 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42a449-8445-4fc7-b0f9-b8ef3dae94cc admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:45.362974 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 588/1148] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:36:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:45.369360 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9123e9-a0e2-4775-9686-0f5d712837c5 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:45.380351 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9123e9-a0e2-4775-9686-0f5d712837c5 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:45.385826 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75056743-d7b4-4206-a231-3c1aefd6756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:45.386650 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75056743-d7b4-4206-a231-3c1aefd6756b admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:45.386924 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75056743-d7b4-4206-a231-3c1aefd6756b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:45.387191 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75056743-d7b4-4206-a231-3c1aefd6756b admin admin] PATH_INFO: `/v3/users/1fbf401371dd406ea67397a30377003f` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:45.388479 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75056743-d7b4-4206-a231-3c1aefd6756b admin admin] RBAC: Authorizing `identity:get_user(user_id=1fbf401371dd406ea67397a30377003f)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:45.390575 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75056743-d7b4-4206-a231-3c1aefd6756b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:45.392173 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 561/1149] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:36:45 2022] GET /identity/v3/users/1fbf401371dd406ea67397a30377003f => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:36:45.397469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42a449-8445-4fc7-b0f9-b8ef3dae94cc admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:45.407304 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42a449-8445-4fc7-b0f9-b8ef3dae94cc admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:45.412252 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc3599-d51b-44a7-a41e-df19704eb6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:45.413070 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc3599-d51b-44a7-a41e-df19704eb6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:45.413345 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc3599-d51b-44a7-a41e-df19704eb6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:45.413604 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc3599-d51b-44a7-a41e-df19704eb6f7 admin admin] PATH_INFO: `/v3/projects/f6252e7f32eb4c43b4191d9debb9a393` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:45.415094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc3599-d51b-44a7-a41e-df19704eb6f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6252e7f32eb4c43b4191d9debb9a393)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:45.417119 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc3599-d51b-44a7-a41e-df19704eb6f7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:45.418717 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 589/1150] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:36:45 2022] GET /identity/v3/projects/f6252e7f32eb4c43b4191d9debb9a393 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:45.424065 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75056743-d7b4-4206-a231-3c1aefd6756b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:45.433699 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75056743-d7b4-4206-a231-3c1aefd6756b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:45.439395 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ba256-ed61-4fd2-a6f2-59c233906e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:45.440657 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ba256-ed61-4fd2-a6f2-59c233906e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:45.440921 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ba256-ed61-4fd2-a6f2-59c233906e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:45.441181 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ba256-ed61-4fd2-a6f2-59c233906e7d admin admin] PATH_INFO: `/v3/projects/f6252e7f32eb4c43b4191d9debb9a393/users/1fbf401371dd406ea67397a30377003f/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:45.443263 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ba256-ed61-4fd2-a6f2-59c233906e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6252e7f32eb4c43b4191d9debb9a393, user_id=1fbf401371dd406ea67397a30377003f, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:45.446115 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ba256-ed61-4fd2-a6f2-59c233906e7d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:45.463741 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 562/1151] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:36:45 2022] PUT /identity/v3/projects/f6252e7f32eb4c43b4191d9debb9a393/users/1fbf401371dd406ea67397a30377003f/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:36:47.832329 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55005da-cc81-4b01-932b-f4a798da18bc None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:47.833212 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55005da-cc81-4b01-932b-f4a798da18bc None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:47.833212 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55005da-cc81-4b01-932b-f4a798da18bc None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:47.836445 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 590/1152] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:47.845154 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2bd46-5692-4ea0-9da2-763dc8d270dc None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:47.845604 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2bd46-5692-4ea0-9da2-763dc8d270dc None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:47.845704 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2bd46-5692-4ea0-9da2-763dc8d270dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:47.864150 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-efd2bd46-5692-4ea0-9da2-763dc8d270dc None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:47.865327 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-efd2bd46-5692-4ea0-9da2-763dc8d270dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:47.924115 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 563/1153] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:47 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:47.950553 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55005da-cc81-4b01-932b-f4a798da18bc None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:47.964982 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55005da-cc81-4b01-932b-f4a798da18bc None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:47.970536 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2925b7-4b3b-4b35-9df4-3fdfbfc6cf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:47.971317 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2925b7-4b3b-4b35-9df4-3fdfbfc6cf37 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:47.971641 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2925b7-4b3b-4b35-9df4-3fdfbfc6cf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:47.971914 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2925b7-4b3b-4b35-9df4-3fdfbfc6cf37 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:47.983729 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2925b7-4b3b-4b35-9df4-3fdfbfc6cf37 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:36:47.990275 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-6f2925b7-4b3b-4b35-9df4-3fdfbfc6cf37 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:36:47.991416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 591/1154] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:36:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:47.997497 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2bd46-5692-4ea0-9da2-763dc8d270dc None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:48.007287 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2bd46-5692-4ea0-9da2-763dc8d270dc None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:48.013215 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d52b36-1376-45f4-b503-eba44d765962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:48.013874 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d52b36-1376-45f4-b503-eba44d765962 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:48.014149 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d52b36-1376-45f4-b503-eba44d765962 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:48.014418 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d52b36-1376-45f4-b503-eba44d765962 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:48.015185 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d52b36-1376-45f4-b503-eba44d765962 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:48.015490 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d52b36-1376-45f4-b503-eba44d765962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:48.017140 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d52b36-1376-45f4-b503-eba44d765962 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:48.026590 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 564/1155] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:36:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:48.032393 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2925b7-4b3b-4b35-9df4-3fdfbfc6cf37 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:48.043123 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2925b7-4b3b-4b35-9df4-3fdfbfc6cf37 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:48.048115 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f7e12-769d-46e6-b7eb-9a8ac2a66a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:48.048939 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f7e12-769d-46e6-b7eb-9a8ac2a66a6d admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:48.049227 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f7e12-769d-46e6-b7eb-9a8ac2a66a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:48.049496 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f7e12-769d-46e6-b7eb-9a8ac2a66a6d admin admin] PATH_INFO: `/v3/users/1fbf401371dd406ea67397a30377003f` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:48.050753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f7e12-769d-46e6-b7eb-9a8ac2a66a6d admin admin] RBAC: Authorizing `identity:get_user(user_id=1fbf401371dd406ea67397a30377003f)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:48.052913 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f7e12-769d-46e6-b7eb-9a8ac2a66a6d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:48.054500 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 592/1156] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:36:48 2022] GET /identity/v3/users/1fbf401371dd406ea67397a30377003f => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:48.060321 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d52b36-1376-45f4-b503-eba44d765962 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:48.070657 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d52b36-1376-45f4-b503-eba44d765962 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:48.076148 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbee35-04e1-49a3-84cb-1c7efbe54d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:48.076762 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbee35-04e1-49a3-84cb-1c7efbe54d49 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:48.077041 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbee35-04e1-49a3-84cb-1c7efbe54d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:48.077307 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbee35-04e1-49a3-84cb-1c7efbe54d49 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:48.085523 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbee35-04e1-49a3-84cb-1c7efbe54d49 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:48.087313 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbee35-04e1-49a3-84cb-1c7efbe54d49 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:48.096323 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 565/1157] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:36:48 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:36:48.103021 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f7e12-769d-46e6-b7eb-9a8ac2a66a6d admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:48.119588 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f7e12-769d-46e6-b7eb-9a8ac2a66a6d admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:48.128724 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde277a-2832-46a2-bfdf-4b6ac8bc0044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:48.129930 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde277a-2832-46a2-bfdf-4b6ac8bc0044 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:48.130220 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde277a-2832-46a2-bfdf-4b6ac8bc0044 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:48.130491 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde277a-2832-46a2-bfdf-4b6ac8bc0044 admin admin] PATH_INFO: `/v3/projects/f6252e7f32eb4c43b4191d9debb9a393` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:48.132543 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde277a-2832-46a2-bfdf-4b6ac8bc0044 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6252e7f32eb4c43b4191d9debb9a393)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:48.134777 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde277a-2832-46a2-bfdf-4b6ac8bc0044 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:48.136452 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 593/1158] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:36:48 2022] GET /identity/v3/projects/f6252e7f32eb4c43b4191d9debb9a393 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:48.143329 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbee35-04e1-49a3-84cb-1c7efbe54d49 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:48.157896 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbee35-04e1-49a3-84cb-1c7efbe54d49 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:48.165938 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae27e3-5366-4708-b15c-5bc20910f325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:48.166553 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae27e3-5366-4708-b15c-5bc20910f325 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:48.166830 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae27e3-5366-4708-b15c-5bc20910f325 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:48.167096 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae27e3-5366-4708-b15c-5bc20910f325 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:48.167971 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae27e3-5366-4708-b15c-5bc20910f325 admin admin] RBAC: Adding query filter params (role.id=9d097c033f454263a874fbafe92c9aea, scope.project.id=f6252e7f32eb4c43b4191d9debb9a393, user.id=1fbf401371dd406ea67397a30377003f) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:48.168276 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae27e3-5366-4708-b15c-5bc20910f325 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:48.170073 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae27e3-5366-4708-b15c-5bc20910f325 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:48.176260 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 566/1159] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:36:48 2022] GET /identity/v3/role_assignments?user.id=1fbf401371dd406ea67397a30377003f&scope.project.id=f6252e7f32eb4c43b4191d9debb9a393&role.id=9d097c033f454263a874fbafe92c9aea => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:50.572785 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330ac08-d367-46e8-a63a-b47598d6a636 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:50.573393 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330ac08-d367-46e8-a63a-b47598d6a636 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:50.573393 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330ac08-d367-46e8-a63a-b47598d6a636 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:50.575126 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 594/1160] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:50.582804 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abac6d7-e9aa-4919-9af2-d537f2cfd842 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:50.583556 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abac6d7-e9aa-4919-9af2-d537f2cfd842 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:50.583715 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abac6d7-e9aa-4919-9af2-d537f2cfd842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:50.606116 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-6abac6d7-e9aa-4919-9af2-d537f2cfd842 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:50.607323 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-6abac6d7-e9aa-4919-9af2-d537f2cfd842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:50.617888 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 567/1161] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:50 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:50.653918 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330ac08-d367-46e8-a63a-b47598d6a636 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:50.667914 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330ac08-d367-46e8-a63a-b47598d6a636 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:50.673196 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dad03-6018-486c-b3be-35083c8cc578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:50.673839 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dad03-6018-486c-b3be-35083c8cc578 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:50.674119 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dad03-6018-486c-b3be-35083c8cc578 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:50.674388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dad03-6018-486c-b3be-35083c8cc578 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:50.683263 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363dad03-6018-486c-b3be-35083c8cc578 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:50.685087 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363dad03-6018-486c-b3be-35083c8cc578 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:50.695135 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 595/1162] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:36:50 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:36:50.704641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abac6d7-e9aa-4919-9af2-d537f2cfd842 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:50.716407 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abac6d7-e9aa-4919-9af2-d537f2cfd842 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:50.722029 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556957c9-9b35-4384-8da7-83350bde1f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:50.722826 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556957c9-9b35-4384-8da7-83350bde1f2c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:50.723101 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556957c9-9b35-4384-8da7-83350bde1f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:50.723371 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556957c9-9b35-4384-8da7-83350bde1f2c admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:50.731011 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556957c9-9b35-4384-8da7-83350bde1f2c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:50.732874 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556957c9-9b35-4384-8da7-83350bde1f2c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:50.747908 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-556957c9-9b35-4384-8da7-83350bde1f2c admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jan 10 12:36:50.749112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 568/1163] 10.222.0.13 () {56 vars in 1138 bytes} [Mon Jan 10 12:36:50 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:36:50.755783 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dad03-6018-486c-b3be-35083c8cc578 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:50.769978 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dad03-6018-486c-b3be-35083c8cc578 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:50.777472 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2406f1-c776-47dd-95b3-428bc4c29be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:50.778132 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2406f1-c776-47dd-95b3-428bc4c29be6 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:50.778406 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2406f1-c776-47dd-95b3-428bc4c29be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:50.778673 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2406f1-c776-47dd-95b3-428bc4c29be6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:50.779416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2406f1-c776-47dd-95b3-428bc4c29be6 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:36:50.779751 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2406f1-c776-47dd-95b3-428bc4c29be6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:50.781351 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2406f1-c776-47dd-95b3-428bc4c29be6 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:50.789292 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 596/1164] 10.222.0.13 () {56 vars in 1136 bytes} [Mon Jan 10 12:36:50 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:53.405219 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be0ecb-640e-4f72-b495-ac083bf9b0f3 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:53.406117 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be0ecb-640e-4f72-b495-ac083bf9b0f3 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:53.406117 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be0ecb-640e-4f72-b495-ac083bf9b0f3 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:53.409022 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 569/1165] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:53.414722 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20152f-35bd-4b8f-834c-00d6c625c0f1 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:53.415161 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20152f-35bd-4b8f-834c-00d6c625c0f1 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:53.415254 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20152f-35bd-4b8f-834c-00d6c625c0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:53.435428 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-1b20152f-35bd-4b8f-834c-00d6c625c0f1 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:53.436626 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-1b20152f-35bd-4b8f-834c-00d6c625c0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:53.445980 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 597/1166] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:53 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:53.474091 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be0ecb-640e-4f72-b495-ac083bf9b0f3 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:53.495954 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be0ecb-640e-4f72-b495-ac083bf9b0f3 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:53.505314 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd70eb-a36f-44a2-9ec6-07802a04d4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:53.506321 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd70eb-a36f-44a2-9ec6-07802a04d4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:53.506756 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd70eb-a36f-44a2-9ec6-07802a04d4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:53.507172 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd70eb-a36f-44a2-9ec6-07802a04d4f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:53.508427 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd70eb-a36f-44a2-9ec6-07802a04d4f5 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:53.510175 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-e1cd70eb-a36f-44a2-9ec6-07802a04d4f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:36:53.510175 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:36:53.510175 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:36:53.511545 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd70eb-a36f-44a2-9ec6-07802a04d4f5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:53.533976 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 570/1167] 10.222.0.13 () {60 vars in 1159 bytes} [Mon Jan 10 12:36:53 2022] POST /identity/v3/domains => generated 267 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:36:55.982702 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce5e4a-f6e5-469e-825b-de98e92c3567 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:55.983419 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce5e4a-f6e5-469e-825b-de98e92c3567 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:55.983419 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce5e4a-f6e5-469e-825b-de98e92c3567 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:55.985037 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 598/1168] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:55.991389 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7a087-889b-4dff-ac01-6acfe83c895f None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:55.992270 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7a087-889b-4dff-ac01-6acfe83c895f None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:55.992456 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7a087-889b-4dff-ac01-6acfe83c895f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:56.012671 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-fde7a087-889b-4dff-ac01-6acfe83c895f None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:56.013833 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-fde7a087-889b-4dff-ac01-6acfe83c895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:56.074316 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 571/1169] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:55 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:56.110628 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce5e4a-f6e5-469e-825b-de98e92c3567 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:56.125565 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce5e4a-f6e5-469e-825b-de98e92c3567 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:56.131210 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62289c2a-39d2-4f27-adb5-663cf9e361e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:56.132084 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62289c2a-39d2-4f27-adb5-663cf9e361e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:56.132360 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62289c2a-39d2-4f27-adb5-663cf9e361e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:56.132625 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62289c2a-39d2-4f27-adb5-663cf9e361e8 admin admin] PATH_INFO: `/v3/domains/4e2d8985aafd474fad028676e2f533fd` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:56.144689 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62289c2a-39d2-4f27-adb5-663cf9e361e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=4e2d8985aafd474fad028676e2f533fd)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:56.146664 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62289c2a-39d2-4f27-adb5-663cf9e361e8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:56.148271 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 599/1170] 10.222.0.13 () {56 vars in 1204 bytes} [Mon Jan 10 12:36:56 2022] GET /identity/v3/domains/4e2d8985aafd474fad028676e2f533fd => generated 267 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:56.154858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7a087-889b-4dff-ac01-6acfe83c895f None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:56.168336 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7a087-889b-4dff-ac01-6acfe83c895f None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:56.174110 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40e3e6-f325-4a9f-8fdc-4e0035cf5015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:56.175672 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40e3e6-f325-4a9f-8fdc-4e0035cf5015 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:56.175672 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40e3e6-f325-4a9f-8fdc-4e0035cf5015 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:56.175672 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40e3e6-f325-4a9f-8fdc-4e0035cf5015 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:56.176035 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40e3e6-f325-4a9f-8fdc-4e0035cf5015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:56.177969 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-fc40e3e6-f325-4a9f-8fdc-4e0035cf5015 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:36:56.177969 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:36:56.177969 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:36:56.178243 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40e3e6-f325-4a9f-8fdc-4e0035cf5015 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:56.213997 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 572/1171] 10.222.0.13 () {60 vars in 1162 bytes} [Mon Jan 10 12:36:56 2022] POST /identity/v3/projects => generated 361 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:36:58.714432 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29692c-040c-4ed3-a8e4-f77e1068639e None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:58.715028 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29692c-040c-4ed3-a8e4-f77e1068639e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:58.715028 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29692c-040c-4ed3-a8e4-f77e1068639e None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:58.716807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 600/1172] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:36:58.722182 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9460ec-7625-46bb-ba0c-30bcc6e71203 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:58.722629 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9460ec-7625-46bb-ba0c-30bcc6e71203 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:58.722726 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9460ec-7625-46bb-ba0c-30bcc6e71203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:58.745701 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-7e9460ec-7625-46bb-ba0c-30bcc6e71203 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:36:58.746899 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-7e9460ec-7625-46bb-ba0c-30bcc6e71203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:36:58.822196 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 573/1173] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:36:58 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:36:58.848842 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29692c-040c-4ed3-a8e4-f77e1068639e None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:58.862793 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29692c-040c-4ed3-a8e4-f77e1068639e None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:58.868218 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbb6c0-f957-421f-a8dc-1a55b4ffd518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:58.869059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbb6c0-f957-421f-a8dc-1a55b4ffd518 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:58.869328 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbb6c0-f957-421f-a8dc-1a55b4ffd518 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:58.869589 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbb6c0-f957-421f-a8dc-1a55b4ffd518 admin admin] PATH_INFO: `/v3/domains/4e2d8985aafd474fad028676e2f533fd` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:58.870938 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbb6c0-f957-421f-a8dc-1a55b4ffd518 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=4e2d8985aafd474fad028676e2f533fd)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:58.872911 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbb6c0-f957-421f-a8dc-1a55b4ffd518 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:58.874462 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 601/1174] 10.222.0.13 () {56 vars in 1204 bytes} [Mon Jan 10 12:36:58 2022] GET /identity/v3/domains/4e2d8985aafd474fad028676e2f533fd => generated 267 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:36:58.880022 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9460ec-7625-46bb-ba0c-30bcc6e71203 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:36:58.889415 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9460ec-7625-46bb-ba0c-30bcc6e71203 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:36:58.894662 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636c8ba-003e-49e9-898b-6f2160314eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:36:58.895310 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c8ba-003e-49e9-898b-6f2160314eed admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:36:58.895617 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c8ba-003e-49e9-898b-6f2160314eed admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:36:58.895879 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c8ba-003e-49e9-898b-6f2160314eed admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:36:58.896605 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636c8ba-003e-49e9-898b-6f2160314eed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:36:58.898637 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636c8ba-003e-49e9-898b-6f2160314eed admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:36:58.923024 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 574/1175] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Jan 10 12:36:58 2022] POST /identity/v3/users => generated 311 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:37:01.345649 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd7ccb-65c0-47b4-b491-5c8d85cc610c None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:01.346550 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd7ccb-65c0-47b4-b491-5c8d85cc610c None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:01.346550 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd7ccb-65c0-47b4-b491-5c8d85cc610c None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:01.349440 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 602/1176] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:37:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:37:01.355829 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63ce53-1e90-4704-af48-c13f52d21c98 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:01.356346 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63ce53-1e90-4704-af48-c13f52d21c98 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:01.356444 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63ce53-1e90-4704-af48-c13f52d21c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:01.385737 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-df63ce53-1e90-4704-af48-c13f52d21c98 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:37:01.386909 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-df63ce53-1e90-4704-af48-c13f52d21c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:37:01.396245 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 575/1177] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:37:01 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:37:01.422025 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd7ccb-65c0-47b4-b491-5c8d85cc610c None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:37:01.436992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd7ccb-65c0-47b4-b491-5c8d85cc610c None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:37:01.442332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e8378-a188-4cf4-9b1d-04437e6b4803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:37:01.443106 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e8378-a188-4cf4-9b1d-04437e6b4803 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:01.443385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e8378-a188-4cf4-9b1d-04437e6b4803 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:01.443679 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e8378-a188-4cf4-9b1d-04437e6b4803 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:01.454966 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e8378-a188-4cf4-9b1d-04437e6b4803 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:37:01.461786 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-010e8378-a188-4cf4-9b1d-04437e6b4803 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:37:01.462955 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 603/1178] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:37:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:37:01.469346 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63ce53-1e90-4704-af48-c13f52d21c98 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:37:01.481475 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63ce53-1e90-4704-af48-c13f52d21c98 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:37:01.487724 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6bf13-fab2-4e9f-8734-1b2ebcf1e0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:37:01.488379 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6bf13-fab2-4e9f-8734-1b2ebcf1e0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:01.488650 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6bf13-fab2-4e9f-8734-1b2ebcf1e0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:01.488912 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6bf13-fab2-4e9f-8734-1b2ebcf1e0e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:01.489668 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6bf13-fab2-4e9f-8734-1b2ebcf1e0e4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:37:01.489963 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6bf13-fab2-4e9f-8734-1b2ebcf1e0e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:37:01.491560 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6bf13-fab2-4e9f-8734-1b2ebcf1e0e4 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:37:01.500526 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 576/1179] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:37:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:37:01.509972 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e8378-a188-4cf4-9b1d-04437e6b4803 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:37:01.525702 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e8378-a188-4cf4-9b1d-04437e6b4803 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:37:01.535219 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327c092-8fae-47b6-a383-b026d1c56b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:37:01.536608 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327c092-8fae-47b6-a383-b026d1c56b62 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:01.537053 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327c092-8fae-47b6-a383-b026d1c56b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:01.537478 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327c092-8fae-47b6-a383-b026d1c56b62 admin admin] PATH_INFO: `/v3/users/db65d53818cc402d88b2c65b4e542158` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:01.554491 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327c092-8fae-47b6-a383-b026d1c56b62 admin admin] RBAC: Authorizing `identity:get_user(user_id=db65d53818cc402d88b2c65b4e542158)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:37:01.556622 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327c092-8fae-47b6-a383-b026d1c56b62 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:37:01.558281 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 604/1180] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:37:01 2022] GET /identity/v3/users/db65d53818cc402d88b2c65b4e542158 => generated 311 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:37:01.565286 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6bf13-fab2-4e9f-8734-1b2ebcf1e0e4 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:37:01.577320 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6bf13-fab2-4e9f-8734-1b2ebcf1e0e4 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:37:01.583403 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e8b1d-03bb-4ca9-8433-00ded6a3ced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:37:01.584068 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e8b1d-03bb-4ca9-8433-00ded6a3ced3 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:01.584345 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e8b1d-03bb-4ca9-8433-00ded6a3ced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:01.584612 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e8b1d-03bb-4ca9-8433-00ded6a3ced3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:01.592972 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e8b1d-03bb-4ca9-8433-00ded6a3ced3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:37:01.594741 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e8b1d-03bb-4ca9-8433-00ded6a3ced3 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:37:01.603766 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 577/1181] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:37:01 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:37:01.612394 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327c092-8fae-47b6-a383-b026d1c56b62 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:37:01.629239 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327c092-8fae-47b6-a383-b026d1c56b62 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:37:01.637140 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597df42-1f44-484a-81dc-201540f08c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:37:01.637964 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597df42-1f44-484a-81dc-201540f08c43 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:01.638234 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597df42-1f44-484a-81dc-201540f08c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:01.638494 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597df42-1f44-484a-81dc-201540f08c43 admin admin] PATH_INFO: `/v3/projects/1f98b0f2cdbd4d9fa7a7324ffadf7e7d` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:01.639839 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597df42-1f44-484a-81dc-201540f08c43 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f98b0f2cdbd4d9fa7a7324ffadf7e7d)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:37:01.641847 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597df42-1f44-484a-81dc-201540f08c43 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:37:01.643452 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 605/1182] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:37:01 2022] GET /identity/v3/projects/1f98b0f2cdbd4d9fa7a7324ffadf7e7d => generated 361 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:37:01.649840 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e8b1d-03bb-4ca9-8433-00ded6a3ced3 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:37:01.659442 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e8b1d-03bb-4ca9-8433-00ded6a3ced3 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:37:01.666068 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576f601-3232-4460-9568-588b52e499a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:37:01.666690 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576f601-3232-4460-9568-588b52e499a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:01.666963 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576f601-3232-4460-9568-588b52e499a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:01.667222 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576f601-3232-4460-9568-588b52e499a5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:01.668092 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576f601-3232-4460-9568-588b52e499a5 admin admin] RBAC: Adding query filter params (role.id=9d097c033f454263a874fbafe92c9aea, scope.project.id=1f98b0f2cdbd4d9fa7a7324ffadf7e7d, user.id=db65d53818cc402d88b2c65b4e542158) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:37:01.668390 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576f601-3232-4460-9568-588b52e499a5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:37:01.670193 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576f601-3232-4460-9568-588b52e499a5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:37:01.676013 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 578/1183] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:37:01 2022] GET /identity/v3/role_assignments?user.id=db65d53818cc402d88b2c65b4e542158&scope.project.id=1f98b0f2cdbd4d9fa7a7324ffadf7e7d&role.id=9d097c033f454263a874fbafe92c9aea => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:37:04.040935 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d274aa6-b3b2-464e-9f6b-077e26bb6411 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:04.041770 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d274aa6-b3b2-464e-9f6b-077e26bb6411 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:04.041770 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d274aa6-b3b2-464e-9f6b-077e26bb6411 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:04.044563 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 606/1184] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:37:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:37:04.050934 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ff274-33b1-4ca8-8ae4-2c068d087304 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:04.051398 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ff274-33b1-4ca8-8ae4-2c068d087304 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:04.051499 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ff274-33b1-4ca8-8ae4-2c068d087304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:04.071229 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-dd9ff274-33b1-4ca8-8ae4-2c068d087304 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:37:04.072447 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-dd9ff274-33b1-4ca8-8ae4-2c068d087304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:37:04.081003 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 579/1185] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:37:04 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:37:04.107332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d274aa6-b3b2-464e-9f6b-077e26bb6411 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:37:04.124396 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d274aa6-b3b2-464e-9f6b-077e26bb6411 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:37:04.129817 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e5241-cfee-4ba1-ba25-bf9e2af3ad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:37:04.130596 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5241-cfee-4ba1-ba25-bf9e2af3ad54 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:04.130873 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5241-cfee-4ba1-ba25-bf9e2af3ad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:04.131136 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5241-cfee-4ba1-ba25-bf9e2af3ad54 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:04.141603 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e5241-cfee-4ba1-ba25-bf9e2af3ad54 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:37:04.148303 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-5f9e5241-cfee-4ba1-ba25-bf9e2af3ad54 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:37:04.149691 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 607/1186] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:37:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:37:04.158698 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ff274-33b1-4ca8-8ae4-2c068d087304 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:37:04.173905 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ff274-33b1-4ca8-8ae4-2c068d087304 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:37:04.181858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411b82f-c886-4257-8e37-b9f639064804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:37:04.182511 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411b82f-c886-4257-8e37-b9f639064804 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:04.182786 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411b82f-c886-4257-8e37-b9f639064804 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:04.183051 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411b82f-c886-4257-8e37-b9f639064804 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:04.183883 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411b82f-c886-4257-8e37-b9f639064804 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:37:04.184181 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411b82f-c886-4257-8e37-b9f639064804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:37:04.185777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411b82f-c886-4257-8e37-b9f639064804 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:37:04.194874 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 580/1187] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:37:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:37:04.203081 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e5241-cfee-4ba1-ba25-bf9e2af3ad54 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:37:04.213101 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e5241-cfee-4ba1-ba25-bf9e2af3ad54 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:37:04.218216 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcbcc1-a2ef-4b49-8991-09e43fdb8f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:37:04.219047 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcbcc1-a2ef-4b49-8991-09e43fdb8f67 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:04.219318 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcbcc1-a2ef-4b49-8991-09e43fdb8f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:04.219614 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcbcc1-a2ef-4b49-8991-09e43fdb8f67 admin admin] PATH_INFO: `/v3/users/db65d53818cc402d88b2c65b4e542158` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:04.220880 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afcbcc1-a2ef-4b49-8991-09e43fdb8f67 admin admin] RBAC: Authorizing `identity:get_user(user_id=db65d53818cc402d88b2c65b4e542158)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:37:04.222994 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afcbcc1-a2ef-4b49-8991-09e43fdb8f67 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:37:04.224670 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 608/1188] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:37:04 2022] GET /identity/v3/users/db65d53818cc402d88b2c65b4e542158 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:37:04.230072 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411b82f-c886-4257-8e37-b9f639064804 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:37:04.239573 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411b82f-c886-4257-8e37-b9f639064804 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:37:04.244626 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e8849-6fa1-468c-92e4-2b6b5a363a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:37:04.245457 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e8849-6fa1-468c-92e4-2b6b5a363a64 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:04.245731 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e8849-6fa1-468c-92e4-2b6b5a363a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:04.245996 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e8849-6fa1-468c-92e4-2b6b5a363a64 admin admin] PATH_INFO: `/v3/projects/1f98b0f2cdbd4d9fa7a7324ffadf7e7d` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:04.247229 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e8849-6fa1-468c-92e4-2b6b5a363a64 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f98b0f2cdbd4d9fa7a7324ffadf7e7d)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:37:04.249277 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e8849-6fa1-468c-92e4-2b6b5a363a64 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:37:04.250894 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 581/1189] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:37:04 2022] GET /identity/v3/projects/1f98b0f2cdbd4d9fa7a7324ffadf7e7d => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:37:04.256321 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcbcc1-a2ef-4b49-8991-09e43fdb8f67 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:37:04.266076 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcbcc1-a2ef-4b49-8991-09e43fdb8f67 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:37:04.274244 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7178f0-d6a1-463f-bf2c-3208e614dfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:37:04.275106 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7178f0-d6a1-463f-bf2c-3208e614dfdd admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:04.275382 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7178f0-d6a1-463f-bf2c-3208e614dfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:04.275683 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7178f0-d6a1-463f-bf2c-3208e614dfdd admin admin] PATH_INFO: `/v3/projects/1f98b0f2cdbd4d9fa7a7324ffadf7e7d/users/db65d53818cc402d88b2c65b4e542158/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:04.278041 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7178f0-d6a1-463f-bf2c-3208e614dfdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f98b0f2cdbd4d9fa7a7324ffadf7e7d, user_id=db65d53818cc402d88b2c65b4e542158, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:37:04.280677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7178f0-d6a1-463f-bf2c-3208e614dfdd admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:37:04.298085 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 609/1190] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:37:04 2022] PUT /identity/v3/projects/1f98b0f2cdbd4d9fa7a7324ffadf7e7d/users/db65d53818cc402d88b2c65b4e542158/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:37:06.650853 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe08f9-f744-4929-9b08-059be74e75bd None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:06.651740 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe08f9-f744-4929-9b08-059be74e75bd None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:06.652415 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe08f9-f744-4929-9b08-059be74e75bd None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:06.656770 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 582/1191] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:37:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:37:06.667895 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9e5d3-5131-4fbe-bd67-b9de8e1f4af0 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:06.668444 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9e5d3-5131-4fbe-bd67-b9de8e1f4af0 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:06.668575 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9e5d3-5131-4fbe-bd67-b9de8e1f4af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:06.696873 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-ebc9e5d3-5131-4fbe-bd67-b9de8e1f4af0 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:37:06.698037 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ebc9e5d3-5131-4fbe-bd67-b9de8e1f4af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:37:06.769106 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 610/1192] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:37:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:37:06.802702 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe08f9-f744-4929-9b08-059be74e75bd None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:37:06.823375 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe08f9-f744-4929-9b08-059be74e75bd None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:37:06.828794 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac19f9-e4cb-49e1-9d05-48f5e195e999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:37:06.829577 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac19f9-e4cb-49e1-9d05-48f5e195e999 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:06.829857 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac19f9-e4cb-49e1-9d05-48f5e195e999 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:06.830125 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac19f9-e4cb-49e1-9d05-48f5e195e999 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:06.842345 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac19f9-e4cb-49e1-9d05-48f5e195e999 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:37:06.849086 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-92ac19f9-e4cb-49e1-9d05-48f5e195e999 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:37:06.850235 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 583/1193] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:37:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:37:06.857250 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9e5d3-5131-4fbe-bd67-b9de8e1f4af0 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:37:06.871273 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9e5d3-5131-4fbe-bd67-b9de8e1f4af0 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:37:06.880687 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be1d76-b1a1-4950-a67e-e3a0ddafd8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:37:06.881790 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be1d76-b1a1-4950-a67e-e3a0ddafd8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:06.882217 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be1d76-b1a1-4950-a67e-e3a0ddafd8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:06.882653 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be1d76-b1a1-4950-a67e-e3a0ddafd8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:06.883425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be1d76-b1a1-4950-a67e-e3a0ddafd8f7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:37:06.883763 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be1d76-b1a1-4950-a67e-e3a0ddafd8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:37:06.885381 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be1d76-b1a1-4950-a67e-e3a0ddafd8f7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:37:06.893895 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 611/1194] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:37:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:37:06.899868 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac19f9-e4cb-49e1-9d05-48f5e195e999 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:37:06.910831 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac19f9-e4cb-49e1-9d05-48f5e195e999 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:37:06.918418 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41014193-c4b8-47f2-af4b-be712ed55d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:37:06.919587 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41014193-c4b8-47f2-af4b-be712ed55d51 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:06.919947 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41014193-c4b8-47f2-af4b-be712ed55d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:06.920242 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41014193-c4b8-47f2-af4b-be712ed55d51 admin admin] PATH_INFO: `/v3/users/db65d53818cc402d88b2c65b4e542158` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:06.922258 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41014193-c4b8-47f2-af4b-be712ed55d51 admin admin] RBAC: Authorizing `identity:get_user(user_id=db65d53818cc402d88b2c65b4e542158)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:37:06.925590 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41014193-c4b8-47f2-af4b-be712ed55d51 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:37:06.927992 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 584/1195] 10.222.0.13 () {56 vars in 1198 bytes} [Mon Jan 10 12:37:06 2022] GET /identity/v3/users/db65d53818cc402d88b2c65b4e542158 => generated 311 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:37:06.933628 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be1d76-b1a1-4950-a67e-e3a0ddafd8f7 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:37:06.944057 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be1d76-b1a1-4950-a67e-e3a0ddafd8f7 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:37:06.949970 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9723d-64ea-48d3-b0f5-c0c2afd87d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:37:06.950603 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9723d-64ea-48d3-b0f5-c0c2afd87d0d admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:06.950878 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9723d-64ea-48d3-b0f5-c0c2afd87d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:06.951152 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9723d-64ea-48d3-b0f5-c0c2afd87d0d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:06.959542 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9723d-64ea-48d3-b0f5-c0c2afd87d0d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:37:06.961405 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9723d-64ea-48d3-b0f5-c0c2afd87d0d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:37:06.970299 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 612/1196] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:37:06 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:37:06.975968 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41014193-c4b8-47f2-af4b-be712ed55d51 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:37:06.986171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41014193-c4b8-47f2-af4b-be712ed55d51 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:37:06.991545 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db337af1-eb85-4c0e-a09b-150cfe81aac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:37:06.992417 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db337af1-eb85-4c0e-a09b-150cfe81aac4 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:06.992694 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db337af1-eb85-4c0e-a09b-150cfe81aac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:06.992964 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db337af1-eb85-4c0e-a09b-150cfe81aac4 admin admin] PATH_INFO: `/v3/projects/1f98b0f2cdbd4d9fa7a7324ffadf7e7d` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:06.994208 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db337af1-eb85-4c0e-a09b-150cfe81aac4 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f98b0f2cdbd4d9fa7a7324ffadf7e7d)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:37:06.996252 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db337af1-eb85-4c0e-a09b-150cfe81aac4 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:37:06.997864 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 585/1197] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:37:06 2022] GET /identity/v3/projects/1f98b0f2cdbd4d9fa7a7324ffadf7e7d => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:37:07.003706 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9723d-64ea-48d3-b0f5-c0c2afd87d0d admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:37:07.013531 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9723d-64ea-48d3-b0f5-c0c2afd87d0d admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:37:07.019240 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1156c41-083d-41df-9445-86c69fc63624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:37:07.019896 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1156c41-083d-41df-9445-86c69fc63624 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:37:07.020177 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1156c41-083d-41df-9445-86c69fc63624 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:37:07.020449 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1156c41-083d-41df-9445-86c69fc63624 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:37:07.021276 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1156c41-083d-41df-9445-86c69fc63624 admin admin] RBAC: Adding query filter params (role.id=9d097c033f454263a874fbafe92c9aea, scope.project.id=1f98b0f2cdbd4d9fa7a7324ffadf7e7d, user.id=db65d53818cc402d88b2c65b4e542158) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:37:07.021588 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1156c41-083d-41df-9445-86c69fc63624 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:37:07.023538 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1156c41-083d-41df-9445-86c69fc63624 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:37:07.030208 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 613/1198] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:37:07 2022] GET /identity/v3/role_assignments?user.id=db65d53818cc402d88b2c65b4e542158&scope.project.id=1f98b0f2cdbd4d9fa7a7324ffadf7e7d&role.id=9d097c033f454263a874fbafe92c9aea => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:07.824885 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46709820-c334-449c-9296-432d7c93c3f3 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:07.825467 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46709820-c334-449c-9296-432d7c93c3f3 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:07.825659 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46709820-c334-449c-9296-432d7c93c3f3 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:07.827910 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 586/1199] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:38:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:38:07.833012 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badf1fa-8563-4cf2-af2c-dccaffb1f59f None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:07.833491 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badf1fa-8563-4cf2-af2c-dccaffb1f59f None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:07.833582 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7badf1fa-8563-4cf2-af2c-dccaffb1f59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:07.855433 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-7badf1fa-8563-4cf2-af2c-dccaffb1f59f None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:38:07.856659 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-7badf1fa-8563-4cf2-af2c-dccaffb1f59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:38:07.864823 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 614/1200] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:38:07 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:38:07.894944 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46709820-c334-449c-9296-432d7c93c3f3 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:07.909607 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46709820-c334-449c-9296-432d7c93c3f3 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:07.919218 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd38f1-495a-4e09-badb-678395717a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:07.920277 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd38f1-495a-4e09-badb-678395717a8f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:07.920563 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd38f1-495a-4e09-badb-678395717a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:07.920895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd38f1-495a-4e09-badb-678395717a8f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:07.935653 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd38f1-495a-4e09-badb-678395717a8f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:07.937904 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd38f1-495a-4e09-badb-678395717a8f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:07.962934 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-03cd38f1-495a-4e09-badb-678395717a8f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:38:07.964496 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 587/1201] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:07.975355 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badf1fa-8563-4cf2-af2c-dccaffb1f59f None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:07.985849 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7badf1fa-8563-4cf2-af2c-dccaffb1f59f None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:07.994995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664770b0-6c1a-46b4-9750-e7f6351e6307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:07.995756 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664770b0-6c1a-46b4-9750-e7f6351e6307 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:07.996147 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664770b0-6c1a-46b4-9750-e7f6351e6307 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:07.996309 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664770b0-6c1a-46b4-9750-e7f6351e6307 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:07.997145 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664770b0-6c1a-46b4-9750-e7f6351e6307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:07.997482 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664770b0-6c1a-46b4-9750-e7f6351e6307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:07.999262 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664770b0-6c1a-46b4-9750-e7f6351e6307 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:08.015545 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 615/1202] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:38:08.019874 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd38f1-495a-4e09-badb-678395717a8f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:08.030712 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd38f1-495a-4e09-badb-678395717a8f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:08.036171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03af172-b135-49f1-a668-3b416114ac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:08.036959 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03af172-b135-49f1-a668-3b416114ac20 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:08.037239 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03af172-b135-49f1-a668-3b416114ac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:08.037532 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03af172-b135-49f1-a668-3b416114ac20 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:08.038284 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03af172-b135-49f1-a668-3b416114ac20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:08.040404 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03af172-b135-49f1-a668-3b416114ac20 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:08.064580 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 588/1203] 10.222.0.13 () {60 vars in 1153 bytes} [Mon Jan 10 12:38:08 2022] POST /identity/v3/users => generated 251 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:38:10.705301 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c293dec-9887-44c9-b959-63a200236efd None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:10.705910 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c293dec-9887-44c9-b959-63a200236efd None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:10.705910 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c293dec-9887-44c9-b959-63a200236efd None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:10.707929 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 616/1204] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:38:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:38:10.713837 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abd046-a90f-41fd-a01f-d66a7000e3b0 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:10.714346 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abd046-a90f-41fd-a01f-d66a7000e3b0 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:10.714479 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abd046-a90f-41fd-a01f-d66a7000e3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:10.735963 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-a7abd046-a90f-41fd-a01f-d66a7000e3b0 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:38:10.735963 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-a7abd046-a90f-41fd-a01f-d66a7000e3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:38:10.748509 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 589/1205] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:38:10 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:38:10.776312 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c293dec-9887-44c9-b959-63a200236efd None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:10.790161 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c293dec-9887-44c9-b959-63a200236efd None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:10.795357 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fc4f5-2ed2-41cb-ba59-7b7cf52e654a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:10.796286 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fc4f5-2ed2-41cb-ba59-7b7cf52e654a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:10.796632 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fc4f5-2ed2-41cb-ba59-7b7cf52e654a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:10.796926 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333fc4f5-2ed2-41cb-ba59-7b7cf52e654a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:10.809623 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333fc4f5-2ed2-41cb-ba59-7b7cf52e654a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:38:10.817448 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-333fc4f5-2ed2-41cb-ba59-7b7cf52e654a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:38:10.823547 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 617/1206] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:38:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:38:10.826289 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abd046-a90f-41fd-a01f-d66a7000e3b0 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:10.836777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abd046-a90f-41fd-a01f-d66a7000e3b0 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:10.842136 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865703f-e78a-4912-8433-6b4558a5a0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:10.844619 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865703f-e78a-4912-8433-6b4558a5a0fb admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:10.844619 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865703f-e78a-4912-8433-6b4558a5a0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:10.844619 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865703f-e78a-4912-8433-6b4558a5a0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:10.844619 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865703f-e78a-4912-8433-6b4558a5a0fb admin admin] RBAC: Adding query filter params (name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:10.844619 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865703f-e78a-4912-8433-6b4558a5a0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:10.846050 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865703f-e78a-4912-8433-6b4558a5a0fb admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:10.860603 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 590/1207] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:38:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:10.862016 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fc4f5-2ed2-41cb-ba59-7b7cf52e654a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:10.872753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333fc4f5-2ed2-41cb-ba59-7b7cf52e654a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:10.877478 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cce385-2f1a-4b6f-b675-80d57d917342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:10.878339 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cce385-2f1a-4b6f-b675-80d57d917342 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:10.878626 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cce385-2f1a-4b6f-b675-80d57d917342 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:10.878921 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cce385-2f1a-4b6f-b675-80d57d917342 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:10.894213 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cce385-2f1a-4b6f-b675-80d57d917342 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:10.896190 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cce385-2f1a-4b6f-b675-80d57d917342 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:10.916527 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-23cce385-2f1a-4b6f-b675-80d57d917342 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:38:10.918981 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 618/1208] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:10.925001 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865703f-e78a-4912-8433-6b4558a5a0fb admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:10.937019 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865703f-e78a-4912-8433-6b4558a5a0fb admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:10.942893 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e6a11-cb49-404d-ba9f-a7420a98f024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:10.944323 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e6a11-cb49-404d-ba9f-a7420a98f024 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:10.944323 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e6a11-cb49-404d-ba9f-a7420a98f024 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:10.944323 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e6a11-cb49-404d-ba9f-a7420a98f024 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:10.945222 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e6a11-cb49-404d-ba9f-a7420a98f024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:10.945787 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e6a11-cb49-404d-ba9f-a7420a98f024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:10.947590 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e6a11-cb49-404d-ba9f-a7420a98f024 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:10.970181 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 591/1209] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:10.970400 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cce385-2f1a-4b6f-b675-80d57d917342 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:10.982958 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cce385-2f1a-4b6f-b675-80d57d917342 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:10.987826 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915bda6-2f19-41f3-9d55-9a7f2146b481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:10.988707 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915bda6-2f19-41f3-9d55-9a7f2146b481 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:10.988981 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915bda6-2f19-41f3-9d55-9a7f2146b481 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:10.989279 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915bda6-2f19-41f3-9d55-9a7f2146b481 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:10.997947 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915bda6-2f19-41f3-9d55-9a7f2146b481 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:11.001352 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915bda6-2f19-41f3-9d55-9a7f2146b481 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:11.016792 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-7915bda6-2f19-41f3-9d55-9a7f2146b481 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 10 12:38:11.018301 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 619/1210] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:38:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:11.024850 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e6a11-cb49-404d-ba9f-a7420a98f024 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:11.035282 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e6a11-cb49-404d-ba9f-a7420a98f024 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:11.040862 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34654040-6fdb-4455-b8a9-d0dc0c6b2933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:11.041499 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34654040-6fdb-4455-b8a9-d0dc0c6b2933 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:11.041774 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34654040-6fdb-4455-b8a9-d0dc0c6b2933 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:11.042036 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34654040-6fdb-4455-b8a9-d0dc0c6b2933 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:11.042886 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34654040-6fdb-4455-b8a9-d0dc0c6b2933 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:11.043190 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34654040-6fdb-4455-b8a9-d0dc0c6b2933 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:11.045263 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34654040-6fdb-4455-b8a9-d0dc0c6b2933 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:11.071546 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 592/1211] 10.222.0.13 () {56 vars in 1164 bytes} [Mon Jan 10 12:38:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:11.074795 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915bda6-2f19-41f3-9d55-9a7f2146b481 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:11.086797 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915bda6-2f19-41f3-9d55-9a7f2146b481 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:11.092064 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d2673-20fb-4a3f-95b4-cc6ad48ec1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:11.092741 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d2673-20fb-4a3f-95b4-cc6ad48ec1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:11.093082 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d2673-20fb-4a3f-95b4-cc6ad48ec1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:11.093330 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d2673-20fb-4a3f-95b4-cc6ad48ec1f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:11.102022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d2673-20fb-4a3f-95b4-cc6ad48ec1f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:11.104066 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d2673-20fb-4a3f-95b4-cc6ad48ec1f8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:11.114193 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 620/1212] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:38:11 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:38:11.121171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34654040-6fdb-4455-b8a9-d0dc0c6b2933 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:11.133972 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34654040-6fdb-4455-b8a9-d0dc0c6b2933 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:11.139379 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e2e3d-c12a-44d1-a0dd-3a6e899b3a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:11.140331 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e2e3d-c12a-44d1-a0dd-3a6e899b3a98 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:11.140788 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e2e3d-c12a-44d1-a0dd-3a6e899b3a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:11.140976 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e2e3d-c12a-44d1-a0dd-3a6e899b3a98 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:11.155055 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e2e3d-c12a-44d1-a0dd-3a6e899b3a98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:11.157309 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e2e3d-c12a-44d1-a0dd-3a6e899b3a98 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:11.178183 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-d41e2e3d-c12a-44d1-a0dd-3a6e899b3a98 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:38:11.185220 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 593/1213] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:11.186952 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d2673-20fb-4a3f-95b4-cc6ad48ec1f8 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:11.197787 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d2673-20fb-4a3f-95b4-cc6ad48ec1f8 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:11.204051 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71c738-ee36-4045-8882-ccf09eb70e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:11.204925 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71c738-ee36-4045-8882-ccf09eb70e77 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:11.205399 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71c738-ee36-4045-8882-ccf09eb70e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:11.206868 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71c738-ee36-4045-8882-ccf09eb70e77 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:11.206868 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71c738-ee36-4045-8882-ccf09eb70e77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:11.207045 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71c738-ee36-4045-8882-ccf09eb70e77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:11.208768 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71c738-ee36-4045-8882-ccf09eb70e77 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:11.225095 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 621/1214] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:11.232388 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e2e3d-c12a-44d1-a0dd-3a6e899b3a98 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:11.245935 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e2e3d-c12a-44d1-a0dd-3a6e899b3a98 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:11.251458 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51cc2d-f64b-40c0-8451-2d0dbec024ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:11.252365 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51cc2d-f64b-40c0-8451-2d0dbec024ab admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:11.252710 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51cc2d-f64b-40c0-8451-2d0dbec024ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:11.253077 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51cc2d-f64b-40c0-8451-2d0dbec024ab admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:11.261039 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51cc2d-f64b-40c0-8451-2d0dbec024ab admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:11.263251 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51cc2d-f64b-40c0-8451-2d0dbec024ab admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:11.277861 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-3e51cc2d-f64b-40c0-8451-2d0dbec024ab admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:38:11.284044 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 594/1215] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:38:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:11.285606 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71c738-ee36-4045-8882-ccf09eb70e77 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:11.296775 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71c738-ee36-4045-8882-ccf09eb70e77 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:11.304837 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04ad3e-7340-4463-b7a3-458b1eb76ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:11.304837 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04ad3e-7340-4463-b7a3-458b1eb76ade admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:11.304837 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04ad3e-7340-4463-b7a3-458b1eb76ade admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:11.304837 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04ad3e-7340-4463-b7a3-458b1eb76ade admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:11.305727 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04ad3e-7340-4463-b7a3-458b1eb76ade admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:11.306034 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04ad3e-7340-4463-b7a3-458b1eb76ade admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:11.307953 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba04ad3e-7340-4463-b7a3-458b1eb76ade admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:11.322623 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 622/1216] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:38:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:11.329691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51cc2d-f64b-40c0-8451-2d0dbec024ab admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:11.340542 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51cc2d-f64b-40c0-8451-2d0dbec024ab admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:11.345572 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166df800-69c9-4171-8f08-27636708c9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:11.346349 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166df800-69c9-4171-8f08-27636708c9ea admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:11.346751 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166df800-69c9-4171-8f08-27636708c9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:11.347148 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166df800-69c9-4171-8f08-27636708c9ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:11.348276 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166df800-69c9-4171-8f08-27636708c9ea admin admin] RBAC: Adding query filter params (role.id=3c723eddb93e4ab6b44d5fe4ed5877a7, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=c6aa01ebd7314f30a1c729ff2b50c975) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:11.348732 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166df800-69c9-4171-8f08-27636708c9ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:11.350647 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166df800-69c9-4171-8f08-27636708c9ea admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:11.358147 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 595/1217] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:38:11 2022] GET /identity/v3/role_assignments?user.id=c6aa01ebd7314f30a1c729ff2b50c975&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:38:13.927684 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebd91f-aa86-4a2c-a0eb-6220583dcc81 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:13.928333 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebd91f-aa86-4a2c-a0eb-6220583dcc81 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:13.928333 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebd91f-aa86-4a2c-a0eb-6220583dcc81 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:13.930288 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 623/1218] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:38:13.936449 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a10ab-9de5-4615-9ed3-d88894d36324 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:13.937004 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a10ab-9de5-4615-9ed3-d88894d36324 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:13.937004 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a10ab-9de5-4615-9ed3-d88894d36324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:13.959495 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-465a10ab-9de5-4615-9ed3-d88894d36324 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:38:13.961022 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-465a10ab-9de5-4615-9ed3-d88894d36324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:38:13.970879 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 596/1219] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:38:13 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:38:14.003603 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebd91f-aa86-4a2c-a0eb-6220583dcc81 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:14.018590 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebd91f-aa86-4a2c-a0eb-6220583dcc81 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:14.023800 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4ba0f-443f-40af-8bb9-cce231de4cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:14.024570 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4ba0f-443f-40af-8bb9-cce231de4cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:14.024842 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4ba0f-443f-40af-8bb9-cce231de4cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:14.025104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4ba0f-443f-40af-8bb9-cce231de4cc6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:14.037623 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4ba0f-443f-40af-8bb9-cce231de4cc6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:38:14.047993 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-9ef4ba0f-443f-40af-8bb9-cce231de4cc6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:38:14.051570 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 624/1220] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:38:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:38:14.058026 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a10ab-9de5-4615-9ed3-d88894d36324 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:14.069634 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a10ab-9de5-4615-9ed3-d88894d36324 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:14.075650 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba76a14-4a47-437f-bcef-25891c1da7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:14.076327 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba76a14-4a47-437f-bcef-25891c1da7cc admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:14.076604 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba76a14-4a47-437f-bcef-25891c1da7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:14.076878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba76a14-4a47-437f-bcef-25891c1da7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:14.077650 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba76a14-4a47-437f-bcef-25891c1da7cc admin admin] RBAC: Adding query filter params (name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:14.077955 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba76a14-4a47-437f-bcef-25891c1da7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:14.079590 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba76a14-4a47-437f-bcef-25891c1da7cc admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:14.088261 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 597/1221] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:38:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:14.093992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4ba0f-443f-40af-8bb9-cce231de4cc6 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:14.104842 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4ba0f-443f-40af-8bb9-cce231de4cc6 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:14.109694 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d6a79-b495-473d-b6b5-961ef09a7444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:14.110552 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d6a79-b495-473d-b6b5-961ef09a7444 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:14.110857 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d6a79-b495-473d-b6b5-961ef09a7444 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:14.111150 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d6a79-b495-473d-b6b5-961ef09a7444 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:14.122629 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d6a79-b495-473d-b6b5-961ef09a7444 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:14.124711 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d6a79-b495-473d-b6b5-961ef09a7444 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:14.144286 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-896d6a79-b495-473d-b6b5-961ef09a7444 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:38:14.145593 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 625/1222] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:14.152228 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba76a14-4a47-437f-bcef-25891c1da7cc admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:14.162901 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba76a14-4a47-437f-bcef-25891c1da7cc admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:14.167861 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576dcc4-e5a6-4bf8-b1d4-849c5ac4a88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:14.168590 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576dcc4-e5a6-4bf8-b1d4-849c5ac4a88a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:14.168894 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576dcc4-e5a6-4bf8-b1d4-849c5ac4a88a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:14.169166 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576dcc4-e5a6-4bf8-b1d4-849c5ac4a88a admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:14.169907 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576dcc4-e5a6-4bf8-b1d4-849c5ac4a88a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:14.170201 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576dcc4-e5a6-4bf8-b1d4-849c5ac4a88a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:14.172154 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576dcc4-e5a6-4bf8-b1d4-849c5ac4a88a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:14.185971 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 598/1223] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:38:14.192391 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d6a79-b495-473d-b6b5-961ef09a7444 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:14.203425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d6a79-b495-473d-b6b5-961ef09a7444 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:14.208450 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c778b-9f07-4772-b5ef-5bd3b8bd6b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:14.209248 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c778b-9f07-4772-b5ef-5bd3b8bd6b31 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:14.209561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c778b-9f07-4772-b5ef-5bd3b8bd6b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:14.209913 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c778b-9f07-4772-b5ef-5bd3b8bd6b31 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:14.219205 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c778b-9f07-4772-b5ef-5bd3b8bd6b31 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:14.221532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c778b-9f07-4772-b5ef-5bd3b8bd6b31 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:14.236831 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-a66c778b-9f07-4772-b5ef-5bd3b8bd6b31 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 10 12:38:14.238136 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 626/1224] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:38:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:38:14.244352 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576dcc4-e5a6-4bf8-b1d4-849c5ac4a88a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:14.254506 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576dcc4-e5a6-4bf8-b1d4-849c5ac4a88a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:14.260183 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c009c-8333-4232-a275-4a984d73c311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:14.260938 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c009c-8333-4232-a275-4a984d73c311 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:14.261254 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c009c-8333-4232-a275-4a984d73c311 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:14.261496 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c009c-8333-4232-a275-4a984d73c311 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:14.262352 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c009c-8333-4232-a275-4a984d73c311 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:14.262663 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c009c-8333-4232-a275-4a984d73c311 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:14.264570 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c009c-8333-4232-a275-4a984d73c311 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:14.290212 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 599/1225] 10.222.0.13 () {56 vars in 1164 bytes} [Mon Jan 10 12:38:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:14.291668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c778b-9f07-4772-b5ef-5bd3b8bd6b31 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:14.303595 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c778b-9f07-4772-b5ef-5bd3b8bd6b31 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:14.310204 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869901d-6461-4d0c-9a3b-0d0c6915f9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:14.310989 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869901d-6461-4d0c-9a3b-0d0c6915f9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:14.311261 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869901d-6461-4d0c-9a3b-0d0c6915f9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:14.311537 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869901d-6461-4d0c-9a3b-0d0c6915f9e9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:14.324062 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869901d-6461-4d0c-9a3b-0d0c6915f9e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:14.326557 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869901d-6461-4d0c-9a3b-0d0c6915f9e9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:14.345063 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-4869901d-6461-4d0c-9a3b-0d0c6915f9e9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:38:14.346260 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 627/1226] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:38:14.353144 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c009c-8333-4232-a275-4a984d73c311 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:14.362918 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c009c-8333-4232-a275-4a984d73c311 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:14.368851 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa3273-0373-40e8-a706-370e9d31105a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:14.369671 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa3273-0373-40e8-a706-370e9d31105a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:14.369967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa3273-0373-40e8-a706-370e9d31105a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:14.370244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa3273-0373-40e8-a706-370e9d31105a admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:14.370986 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa3273-0373-40e8-a706-370e9d31105a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:14.371291 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa3273-0373-40e8-a706-370e9d31105a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:14.373082 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa3273-0373-40e8-a706-370e9d31105a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:14.385874 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 600/1227] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:14.391738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869901d-6461-4d0c-9a3b-0d0c6915f9e9 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:14.401931 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869901d-6461-4d0c-9a3b-0d0c6915f9e9 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:14.407492 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b56a6-9ea4-4938-9b39-ccbf735ff381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:14.408735 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b56a6-9ea4-4938-9b39-ccbf735ff381 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:14.409021 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b56a6-9ea4-4938-9b39-ccbf735ff381 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:14.409294 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b56a6-9ea4-4938-9b39-ccbf735ff381 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:14.417067 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b56a6-9ea4-4938-9b39-ccbf735ff381 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:14.419869 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b56a6-9ea4-4938-9b39-ccbf735ff381 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:14.432472 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-f67b56a6-9ea4-4938-9b39-ccbf735ff381 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:38:14.433799 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 628/1228] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:38:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:14.441051 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa3273-0373-40e8-a706-370e9d31105a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:14.454849 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa3273-0373-40e8-a706-370e9d31105a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:14.461754 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbaac5-60af-44a0-a9d8-b80a82e62409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:14.462722 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbaac5-60af-44a0-a9d8-b80a82e62409 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:14.463339 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbaac5-60af-44a0-a9d8-b80a82e62409 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:14.463644 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbaac5-60af-44a0-a9d8-b80a82e62409 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:14.464714 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbaac5-60af-44a0-a9d8-b80a82e62409 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:14.465122 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbaac5-60af-44a0-a9d8-b80a82e62409 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:14.467820 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbaac5-60af-44a0-a9d8-b80a82e62409 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:14.483413 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 601/1229] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:38:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:14.489797 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b56a6-9ea4-4938-9b39-ccbf735ff381 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:14.500812 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b56a6-9ea4-4938-9b39-ccbf735ff381 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:14.505748 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80316e50-7403-4247-b9b0-5da7379a7cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:14.506845 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80316e50-7403-4247-b9b0-5da7379a7cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:14.507121 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80316e50-7403-4247-b9b0-5da7379a7cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:14.507390 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80316e50-7403-4247-b9b0-5da7379a7cf8 admin admin] PATH_INFO: `/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/c6aa01ebd7314f30a1c729ff2b50c975/roles/3c723eddb93e4ab6b44d5fe4ed5877a7` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:14.522530 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80316e50-7403-4247-b9b0-5da7379a7cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0105f8c08c84f538cd7ba86fcd26b62, user_id=c6aa01ebd7314f30a1c729ff2b50c975, role_id=3c723eddb93e4ab6b44d5fe4ed5877a7)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:14.527208 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80316e50-7403-4247-b9b0-5da7379a7cf8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:14.540717 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 629/1230] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:38:14 2022] PUT /identity/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/c6aa01ebd7314f30a1c729ff2b50c975/roles/3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:38:16.946322 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e1a7d-e5d3-4ec3-b885-a70e38732a7b None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:16.946898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e1a7d-e5d3-4ec3-b885-a70e38732a7b None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:16.946898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e1a7d-e5d3-4ec3-b885-a70e38732a7b None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:16.948763 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 602/1231] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:38:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:38:16.955049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9a899-0bbc-41cf-94d2-62e374982d92 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:16.955578 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9a899-0bbc-41cf-94d2-62e374982d92 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:16.955699 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9a899-0bbc-41cf-94d2-62e374982d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:16.974416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-daf9a899-0bbc-41cf-94d2-62e374982d92 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:38:16.975680 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-daf9a899-0bbc-41cf-94d2-62e374982d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:38:17.039600 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 630/1232] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:38:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:38:17.063406 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e1a7d-e5d3-4ec3-b885-a70e38732a7b None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:17.076386 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e1a7d-e5d3-4ec3-b885-a70e38732a7b None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:17.080678 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be9026-aa13-4c46-be63-f82fc6c1ba0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:17.081464 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be9026-aa13-4c46-be63-f82fc6c1ba0b admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:17.081743 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be9026-aa13-4c46-be63-f82fc6c1ba0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:17.082019 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be9026-aa13-4c46-be63-f82fc6c1ba0b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:17.093368 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be9026-aa13-4c46-be63-f82fc6c1ba0b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:38:17.100366 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-c9be9026-aa13-4c46-be63-f82fc6c1ba0b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 10 12:38:17.101934 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 603/1233] 10.222.0.13 () {56 vars in 1123 bytes} [Mon Jan 10 12:38:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:17.108216 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9a899-0bbc-41cf-94d2-62e374982d92 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:17.117202 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9a899-0bbc-41cf-94d2-62e374982d92 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:17.121930 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed364667-c1d5-4750-b211-aa50b4219282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:17.122590 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed364667-c1d5-4750-b211-aa50b4219282 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:17.122867 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed364667-c1d5-4750-b211-aa50b4219282 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:17.123136 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed364667-c1d5-4750-b211-aa50b4219282 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:17.123939 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed364667-c1d5-4750-b211-aa50b4219282 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:17.124249 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed364667-c1d5-4750-b211-aa50b4219282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:17.125844 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed364667-c1d5-4750-b211-aa50b4219282 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:17.134218 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 631/1234] 10.222.0.13 () {56 vars in 1124 bytes} [Mon Jan 10 12:38:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:17.140153 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be9026-aa13-4c46-be63-f82fc6c1ba0b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:17.150910 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be9026-aa13-4c46-be63-f82fc6c1ba0b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:17.157352 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd10f0-ece8-4dee-a242-422735e83f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:17.158223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd10f0-ece8-4dee-a242-422735e83f72 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:17.158573 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd10f0-ece8-4dee-a242-422735e83f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:17.158896 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd10f0-ece8-4dee-a242-422735e83f72 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:17.170657 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd10f0-ece8-4dee-a242-422735e83f72 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:17.173918 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd10f0-ece8-4dee-a242-422735e83f72 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:17.192547 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-05bd10f0-ece8-4dee-a242-422735e83f72 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:38:17.193774 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 604/1235] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:38:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:38:17.200497 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed364667-c1d5-4750-b211-aa50b4219282 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:17.210113 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed364667-c1d5-4750-b211-aa50b4219282 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:17.214875 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2ef17-0a16-4c89-a10e-4d7239c9c1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:17.215561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2ef17-0a16-4c89-a10e-4d7239c9c1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:17.215840 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2ef17-0a16-4c89-a10e-4d7239c9c1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:17.216108 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2ef17-0a16-4c89-a10e-4d7239c9c1d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:17.216840 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2ef17-0a16-4c89-a10e-4d7239c9c1d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:17.217136 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2ef17-0a16-4c89-a10e-4d7239c9c1d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:17.218729 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2ef17-0a16-4c89-a10e-4d7239c9c1d5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:17.232186 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 632/1236] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:17.238725 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd10f0-ece8-4dee-a242-422735e83f72 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:17.249940 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd10f0-ece8-4dee-a242-422735e83f72 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:17.254918 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dc613-a5a5-4284-a7d2-7b66c7aa6948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:17.255769 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dc613-a5a5-4284-a7d2-7b66c7aa6948 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:17.256052 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dc613-a5a5-4284-a7d2-7b66c7aa6948 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:17.256313 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dc613-a5a5-4284-a7d2-7b66c7aa6948 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:17.270467 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dc613-a5a5-4284-a7d2-7b66c7aa6948 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:17.272912 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dc613-a5a5-4284-a7d2-7b66c7aa6948 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:17.290373 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-4a4dc613-a5a5-4284-a7d2-7b66c7aa6948 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 10 12:38:17.291489 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 605/1237] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:38:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:38:17.297999 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2ef17-0a16-4c89-a10e-4d7239c9c1d5 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:17.308384 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2ef17-0a16-4c89-a10e-4d7239c9c1d5 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:17.314161 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc48ffd-6848-4fe5-866e-3071f9ea00ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:17.314948 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc48ffd-6848-4fe5-866e-3071f9ea00ec admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:17.315261 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc48ffd-6848-4fe5-866e-3071f9ea00ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:17.315600 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc48ffd-6848-4fe5-866e-3071f9ea00ec admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:17.316527 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc48ffd-6848-4fe5-866e-3071f9ea00ec admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:17.316854 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc48ffd-6848-4fe5-866e-3071f9ea00ec admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:17.319039 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc48ffd-6848-4fe5-866e-3071f9ea00ec admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:17.338876 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 633/1238] 10.222.0.13 () {56 vars in 1164 bytes} [Mon Jan 10 12:38:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:17.345278 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dc613-a5a5-4284-a7d2-7b66c7aa6948 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:17.355000 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dc613-a5a5-4284-a7d2-7b66c7aa6948 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:17.359737 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f9dc3-56d5-40c1-90f5-9e1b46912774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:17.360421 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f9dc3-56d5-40c1-90f5-9e1b46912774 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:17.360736 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f9dc3-56d5-40c1-90f5-9e1b46912774 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:17.360992 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f9dc3-56d5-40c1-90f5-9e1b46912774 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:17.369325 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f9dc3-56d5-40c1-90f5-9e1b46912774 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:17.371254 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f9dc3-56d5-40c1-90f5-9e1b46912774 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:17.381049 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 606/1239] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:38:17 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:38:17.387269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc48ffd-6848-4fe5-866e-3071f9ea00ec admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:17.398677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc48ffd-6848-4fe5-866e-3071f9ea00ec admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:17.404963 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1ed04-7167-4f53-9fdc-5e66354a0e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:17.405762 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1ed04-7167-4f53-9fdc-5e66354a0e94 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:17.406032 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1ed04-7167-4f53-9fdc-5e66354a0e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:17.406295 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1ed04-7167-4f53-9fdc-5e66354a0e94 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:17.417269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1ed04-7167-4f53-9fdc-5e66354a0e94 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:17.419137 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1ed04-7167-4f53-9fdc-5e66354a0e94 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:17.436525 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-5ef1ed04-7167-4f53-9fdc-5e66354a0e94 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:38:17.437896 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 634/1240] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:38:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:38:17.444428 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f9dc3-56d5-40c1-90f5-9e1b46912774 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:17.454571 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f9dc3-56d5-40c1-90f5-9e1b46912774 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:17.459949 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d934c6-f2e2-4eda-bbf3-ff5901181376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:17.460600 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d934c6-f2e2-4eda-bbf3-ff5901181376 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:17.461551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d934c6-f2e2-4eda-bbf3-ff5901181376 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:17.461845 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d934c6-f2e2-4eda-bbf3-ff5901181376 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:17.462615 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d934c6-f2e2-4eda-bbf3-ff5901181376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:17.462912 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d934c6-f2e2-4eda-bbf3-ff5901181376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:17.464881 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d934c6-f2e2-4eda-bbf3-ff5901181376 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:17.478206 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 607/1241] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:17.484260 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1ed04-7167-4f53-9fdc-5e66354a0e94 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:17.494213 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1ed04-7167-4f53-9fdc-5e66354a0e94 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:17.498655 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e1f76-0ca8-4eb0-a8db-1e4d29212415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:17.499441 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e1f76-0ca8-4eb0-a8db-1e4d29212415 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:17.499745 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e1f76-0ca8-4eb0-a8db-1e4d29212415 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:17.500008 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e1f76-0ca8-4eb0-a8db-1e4d29212415 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:17.508179 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e1f76-0ca8-4eb0-a8db-1e4d29212415 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:17.510257 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e1f76-0ca8-4eb0-a8db-1e4d29212415 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:17.524755 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-549e1f76-0ca8-4eb0-a8db-1e4d29212415 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:38:17.526248 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 635/1242] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:38:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:38:17.532589 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d934c6-f2e2-4eda-bbf3-ff5901181376 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:17.544670 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d934c6-f2e2-4eda-bbf3-ff5901181376 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:17.550511 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609d3d5-13af-46f8-9764-e385c198abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:17.551185 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609d3d5-13af-46f8-9764-e385c198abc1 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:17.551481 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609d3d5-13af-46f8-9764-e385c198abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:17.551800 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609d3d5-13af-46f8-9764-e385c198abc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:17.552670 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609d3d5-13af-46f8-9764-e385c198abc1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:17.553022 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609d3d5-13af-46f8-9764-e385c198abc1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:17.555038 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609d3d5-13af-46f8-9764-e385c198abc1 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:17.568737 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 608/1243] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:38:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:38:17.574996 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e1f76-0ca8-4eb0-a8db-1e4d29212415 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:17.586078 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e1f76-0ca8-4eb0-a8db-1e4d29212415 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:17.590982 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67069da-57c8-4c44-820d-b9425dda9806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:17.591676 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67069da-57c8-4c44-820d-b9425dda9806 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:17.591959 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67069da-57c8-4c44-820d-b9425dda9806 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:17.592278 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67069da-57c8-4c44-820d-b9425dda9806 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:17.593183 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67069da-57c8-4c44-820d-b9425dda9806 admin admin] RBAC: Adding query filter params (role.id=3c723eddb93e4ab6b44d5fe4ed5877a7, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=c6aa01ebd7314f30a1c729ff2b50c975) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:17.593527 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67069da-57c8-4c44-820d-b9425dda9806 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:17.595539 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67069da-57c8-4c44-820d-b9425dda9806 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:17.603884 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 636/1244] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:38:17 2022] GET /identity/v3/role_assignments?user.id=c6aa01ebd7314f30a1c729ff2b50c975&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=3c723eddb93e4ab6b44d5fe4ed5877a7 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:20.188987 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f50f32-25dc-4348-95b1-2008e005123e None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:20.189715 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f50f32-25dc-4348-95b1-2008e005123e None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:20.189715 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f50f32-25dc-4348-95b1-2008e005123e None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:20.191465 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 609/1245] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:38:20.197028 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf68e38-fcb9-48da-a759-dae63066cd29 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:20.197553 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf68e38-fcb9-48da-a759-dae63066cd29 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:20.197659 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf68e38-fcb9-48da-a759-dae63066cd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:20.217133 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-aaf68e38-fcb9-48da-a759-dae63066cd29 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:38:20.218425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-aaf68e38-fcb9-48da-a759-dae63066cd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:38:20.227060 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 637/1246] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:38:20 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:38:20.253223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f50f32-25dc-4348-95b1-2008e005123e None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:20.267678 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f50f32-25dc-4348-95b1-2008e005123e None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:20.274343 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150351d1-962f-4905-9242-82151790cfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:20.275249 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150351d1-962f-4905-9242-82151790cfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:20.275597 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150351d1-962f-4905-9242-82151790cfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:20.275869 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150351d1-962f-4905-9242-82151790cfb9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:20.288671 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150351d1-962f-4905-9242-82151790cfb9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:38:20.297895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-150351d1-962f-4905-9242-82151790cfb9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:38:20.299469 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 610/1247] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:38:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:20.307366 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf68e38-fcb9-48da-a759-dae63066cd29 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:20.316802 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf68e38-fcb9-48da-a759-dae63066cd29 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:20.322632 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc300b2-35b8-459f-a468-230619d33bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:20.323414 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc300b2-35b8-459f-a468-230619d33bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:20.323743 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc300b2-35b8-459f-a468-230619d33bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:20.324087 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc300b2-35b8-459f-a468-230619d33bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:20.324991 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc300b2-35b8-459f-a468-230619d33bc7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:20.325351 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc300b2-35b8-459f-a468-230619d33bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:20.327197 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc300b2-35b8-459f-a468-230619d33bc7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:20.336954 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 638/1248] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:38:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:20.342861 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150351d1-962f-4905-9242-82151790cfb9 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:20.355840 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150351d1-962f-4905-9242-82151790cfb9 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:20.361137 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c9497-3685-4455-95a0-861fd2754ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:20.362191 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c9497-3685-4455-95a0-861fd2754ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:20.362571 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c9497-3685-4455-95a0-861fd2754ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:20.362878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c9497-3685-4455-95a0-861fd2754ac3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:20.375472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c9497-3685-4455-95a0-861fd2754ac3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:20.377606 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c9497-3685-4455-95a0-861fd2754ac3 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:20.398671 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-0a3c9497-3685-4455-95a0-861fd2754ac3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:38:20.400699 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 611/1249] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:20.406477 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc300b2-35b8-459f-a468-230619d33bc7 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:20.417450 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc300b2-35b8-459f-a468-230619d33bc7 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:20.421862 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe92774-7653-48a4-bd96-5656999bc373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:20.422517 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe92774-7653-48a4-bd96-5656999bc373 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:20.422792 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe92774-7653-48a4-bd96-5656999bc373 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:20.423058 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe92774-7653-48a4-bd96-5656999bc373 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:20.423842 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe92774-7653-48a4-bd96-5656999bc373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:20.424134 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe92774-7653-48a4-bd96-5656999bc373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:20.426046 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe92774-7653-48a4-bd96-5656999bc373 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:20.439840 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 639/1250] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:20.446377 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c9497-3685-4455-95a0-861fd2754ac3 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:20.457036 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c9497-3685-4455-95a0-861fd2754ac3 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:20.463319 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5228b-82ee-4293-a118-e120aafb0038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:20.464354 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5228b-82ee-4293-a118-e120aafb0038 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:20.464630 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5228b-82ee-4293-a118-e120aafb0038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:20.464941 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5228b-82ee-4293-a118-e120aafb0038 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:20.473340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5228b-82ee-4293-a118-e120aafb0038 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:20.475738 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5228b-82ee-4293-a118-e120aafb0038 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:20.492848 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-5cc5228b-82ee-4293-a118-e120aafb0038 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 10 12:38:20.494026 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 612/1251] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:38:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:20.499966 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe92774-7653-48a4-bd96-5656999bc373 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:20.510223 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe92774-7653-48a4-bd96-5656999bc373 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:20.514888 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78b58f-d5ea-4a73-acce-c953d12a8cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:20.515574 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78b58f-d5ea-4a73-acce-c953d12a8cdb admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:20.515913 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78b58f-d5ea-4a73-acce-c953d12a8cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:20.516322 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78b58f-d5ea-4a73-acce-c953d12a8cdb admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:20.517238 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78b58f-d5ea-4a73-acce-c953d12a8cdb admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:20.517683 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78b58f-d5ea-4a73-acce-c953d12a8cdb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:20.519617 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78b58f-d5ea-4a73-acce-c953d12a8cdb admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:20.539906 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 640/1252] 10.222.0.13 () {56 vars in 1164 bytes} [Mon Jan 10 12:38:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:38:20.547031 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5228b-82ee-4293-a118-e120aafb0038 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:20.557896 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5228b-82ee-4293-a118-e120aafb0038 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:20.562871 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f2090-54a4-4eb7-89e4-6ad3f8c1b6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:20.564056 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f2090-54a4-4eb7-89e4-6ad3f8c1b6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:20.564436 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f2090-54a4-4eb7-89e4-6ad3f8c1b6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:20.564796 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f2090-54a4-4eb7-89e4-6ad3f8c1b6a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:20.573867 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f2090-54a4-4eb7-89e4-6ad3f8c1b6a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:20.575820 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f2090-54a4-4eb7-89e4-6ad3f8c1b6a7 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:20.588185 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 613/1253] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:38:20 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:38:20.594452 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78b58f-d5ea-4a73-acce-c953d12a8cdb admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:20.606799 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78b58f-d5ea-4a73-acce-c953d12a8cdb admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:20.612054 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261af3f1-c6b0-4094-95c6-ef9fc67a48eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:20.612967 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261af3f1-c6b0-4094-95c6-ef9fc67a48eb admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:20.613415 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261af3f1-c6b0-4094-95c6-ef9fc67a48eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:20.613906 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261af3f1-c6b0-4094-95c6-ef9fc67a48eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:20.628145 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261af3f1-c6b0-4094-95c6-ef9fc67a48eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:20.630655 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261af3f1-c6b0-4094-95c6-ef9fc67a48eb admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:20.650741 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-261af3f1-c6b0-4094-95c6-ef9fc67a48eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:38:20.652000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 641/1254] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:20.657817 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f2090-54a4-4eb7-89e4-6ad3f8c1b6a7 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:20.667564 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f2090-54a4-4eb7-89e4-6ad3f8c1b6a7 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:20.673396 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b2490-22b2-4eca-b20c-1a70c929acd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:20.674051 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b2490-22b2-4eca-b20c-1a70c929acd7 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:20.674327 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b2490-22b2-4eca-b20c-1a70c929acd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:20.674592 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b2490-22b2-4eca-b20c-1a70c929acd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:20.675322 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b2490-22b2-4eca-b20c-1a70c929acd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:20.675655 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b2490-22b2-4eca-b20c-1a70c929acd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:20.677254 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b2490-22b2-4eca-b20c-1a70c929acd7 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:20.690690 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 614/1255] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:20.697817 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261af3f1-c6b0-4094-95c6-ef9fc67a48eb admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:20.708479 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261af3f1-c6b0-4094-95c6-ef9fc67a48eb admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:20.713418 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a30508-62f9-4d47-8c52-3465dd26b85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:20.714268 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a30508-62f9-4d47-8c52-3465dd26b85a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:20.714596 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a30508-62f9-4d47-8c52-3465dd26b85a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:20.714866 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a30508-62f9-4d47-8c52-3465dd26b85a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:20.723420 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a30508-62f9-4d47-8c52-3465dd26b85a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:20.725714 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a30508-62f9-4d47-8c52-3465dd26b85a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:20.739861 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-31a30508-62f9-4d47-8c52-3465dd26b85a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:38:20.741189 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 642/1256] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:38:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:20.747321 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b2490-22b2-4eca-b20c-1a70c929acd7 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:20.759157 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b2490-22b2-4eca-b20c-1a70c929acd7 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:20.768994 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f691d-a206-4826-a565-b57bc1be7e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:20.769749 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f691d-a206-4826-a565-b57bc1be7e70 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:20.770032 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f691d-a206-4826-a565-b57bc1be7e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:20.770303 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f691d-a206-4826-a565-b57bc1be7e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:20.771112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f691d-a206-4826-a565-b57bc1be7e70 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:20.771450 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f691d-a206-4826-a565-b57bc1be7e70 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:20.773753 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f691d-a206-4826-a565-b57bc1be7e70 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:20.788056 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 615/1257] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:38:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:20.794343 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a30508-62f9-4d47-8c52-3465dd26b85a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:20.928714 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a30508-62f9-4d47-8c52-3465dd26b85a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:20.933341 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a0c9c-12a2-48af-80c0-a38b0774c50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:20.933994 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a0c9c-12a2-48af-80c0-a38b0774c50e admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:20.934315 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a0c9c-12a2-48af-80c0-a38b0774c50e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:20.934574 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a0c9c-12a2-48af-80c0-a38b0774c50e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:20.935387 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a0c9c-12a2-48af-80c0-a38b0774c50e admin admin] RBAC: Adding query filter params (role.id=9d097c033f454263a874fbafe92c9aea, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=c6aa01ebd7314f30a1c729ff2b50c975) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:20.935731 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a0c9c-12a2-48af-80c0-a38b0774c50e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:20.937665 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a0c9c-12a2-48af-80c0-a38b0774c50e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:20.946400 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 643/1258] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:38:20 2022] GET /identity/v3/role_assignments?user.id=c6aa01ebd7314f30a1c729ff2b50c975&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=9d097c033f454263a874fbafe92c9aea => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:23.359598 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2afbf-0460-4eef-8e72-087ecb40d127 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:23.360211 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2afbf-0460-4eef-8e72-087ecb40d127 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:23.360211 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2afbf-0460-4eef-8e72-087ecb40d127 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:23.362238 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 616/1259] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:38:23.368129 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02ab50-b628-42dc-b710-0223bac652e6 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:23.368697 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02ab50-b628-42dc-b710-0223bac652e6 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:23.368697 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02ab50-b628-42dc-b710-0223bac652e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:23.388177 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-6f02ab50-b628-42dc-b710-0223bac652e6 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:38:23.389398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-6f02ab50-b628-42dc-b710-0223bac652e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:38:23.397270 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 644/1260] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:38:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:38:23.426205 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2afbf-0460-4eef-8e72-087ecb40d127 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:23.440553 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2afbf-0460-4eef-8e72-087ecb40d127 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:23.445854 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a572b-fcfc-425f-a61f-00cffb570815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:23.446640 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a572b-fcfc-425f-a61f-00cffb570815 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:23.446911 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a572b-fcfc-425f-a61f-00cffb570815 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:23.447175 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a572b-fcfc-425f-a61f-00cffb570815 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:23.457473 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a572b-fcfc-425f-a61f-00cffb570815 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:38:23.464779 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-327a572b-fcfc-425f-a61f-00cffb570815 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:38:23.465957 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 617/1261] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:38:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:23.472098 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02ab50-b628-42dc-b710-0223bac652e6 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:23.481464 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02ab50-b628-42dc-b710-0223bac652e6 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:23.487572 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaa20c-f72c-486f-bda8-052c86056997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:23.488265 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaa20c-f72c-486f-bda8-052c86056997 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:23.488543 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaa20c-f72c-486f-bda8-052c86056997 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:23.488807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaa20c-f72c-486f-bda8-052c86056997 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:23.489588 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaaa20c-f72c-486f-bda8-052c86056997 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:23.489887 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaaa20c-f72c-486f-bda8-052c86056997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:23.491504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaaa20c-f72c-486f-bda8-052c86056997 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:23.501239 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 645/1262] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:38:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:23.507107 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a572b-fcfc-425f-a61f-00cffb570815 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:23.518018 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a572b-fcfc-425f-a61f-00cffb570815 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:23.522664 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3599e-643d-46bc-8a4d-db81ec72a83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:23.524149 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3599e-643d-46bc-8a4d-db81ec72a83d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:23.524426 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3599e-643d-46bc-8a4d-db81ec72a83d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:23.524687 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3599e-643d-46bc-8a4d-db81ec72a83d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:23.534820 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3599e-643d-46bc-8a4d-db81ec72a83d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:23.536695 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3599e-643d-46bc-8a4d-db81ec72a83d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:23.553836 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-2ae3599e-643d-46bc-8a4d-db81ec72a83d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:38:23.555147 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 618/1263] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:23.561022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaa20c-f72c-486f-bda8-052c86056997 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:23.571471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaa20c-f72c-486f-bda8-052c86056997 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:23.576418 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560e63c-995a-4d45-a341-f6caa5693670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:23.577035 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560e63c-995a-4d45-a341-f6caa5693670 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:23.577310 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560e63c-995a-4d45-a341-f6caa5693670 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:23.577578 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560e63c-995a-4d45-a341-f6caa5693670 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:23.578366 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560e63c-995a-4d45-a341-f6caa5693670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:23.578619 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560e63c-995a-4d45-a341-f6caa5693670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:23.580246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560e63c-995a-4d45-a341-f6caa5693670 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:23.593386 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 646/1264] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:23.599318 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3599e-643d-46bc-8a4d-db81ec72a83d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:23.609256 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3599e-643d-46bc-8a4d-db81ec72a83d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:23.614081 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ade536-6417-4e1a-9dde-4011f416e0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:23.614855 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ade536-6417-4e1a-9dde-4011f416e0ef admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:23.615221 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ade536-6417-4e1a-9dde-4011f416e0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:23.615493 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ade536-6417-4e1a-9dde-4011f416e0ef admin admin] PATH_INFO: `/v3/users/placement` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:23.623977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ade536-6417-4e1a-9dde-4011f416e0ef admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:23.625999 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ade536-6417-4e1a-9dde-4011f416e0ef admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:23.640105 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-25ade536-6417-4e1a-9dde-4011f416e0ef admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 10 12:38:23.641459 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 619/1265] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:38:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:38:23.647350 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560e63c-995a-4d45-a341-f6caa5693670 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:23.657439 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560e63c-995a-4d45-a341-f6caa5693670 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:23.661874 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5209f8f-b0f5-4091-ae55-b7357536b0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:23.662541 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5209f8f-b0f5-4091-ae55-b7357536b0eb admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:23.662817 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5209f8f-b0f5-4091-ae55-b7357536b0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:23.663089 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5209f8f-b0f5-4091-ae55-b7357536b0eb admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:23.664002 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5209f8f-b0f5-4091-ae55-b7357536b0eb admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:23.664563 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5209f8f-b0f5-4091-ae55-b7357536b0eb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:23.666220 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5209f8f-b0f5-4091-ae55-b7357536b0eb admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:23.684589 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 647/1266] 10.222.0.13 () {56 vars in 1164 bytes} [Mon Jan 10 12:38:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:23.690946 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ade536-6417-4e1a-9dde-4011f416e0ef admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:23.702024 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ade536-6417-4e1a-9dde-4011f416e0ef admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:23.706908 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9232d8d-8084-4948-b8c9-58f58381a299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:23.707918 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9232d8d-8084-4948-b8c9-58f58381a299 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:23.708284 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9232d8d-8084-4948-b8c9-58f58381a299 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:23.708598 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9232d8d-8084-4948-b8c9-58f58381a299 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:23.721787 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9232d8d-8084-4948-b8c9-58f58381a299 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:23.723729 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9232d8d-8084-4948-b8c9-58f58381a299 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:23.741948 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-d9232d8d-8084-4948-b8c9-58f58381a299 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:38:23.743266 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 620/1267] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:23.749038 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5209f8f-b0f5-4091-ae55-b7357536b0eb admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:23.759960 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5209f8f-b0f5-4091-ae55-b7357536b0eb admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:23.764736 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05cdb8-cdea-4769-9d54-71488675143f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:23.765367 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05cdb8-cdea-4769-9d54-71488675143f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:23.765663 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05cdb8-cdea-4769-9d54-71488675143f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:23.765917 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05cdb8-cdea-4769-9d54-71488675143f admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:23.766689 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05cdb8-cdea-4769-9d54-71488675143f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:23.767001 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05cdb8-cdea-4769-9d54-71488675143f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:23.768640 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05cdb8-cdea-4769-9d54-71488675143f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:23.780655 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 648/1268] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:23.786477 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9232d8d-8084-4948-b8c9-58f58381a299 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:23.796259 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9232d8d-8084-4948-b8c9-58f58381a299 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:23.801030 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1459b-b5bc-4677-970c-4686a31a84b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:23.801810 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1459b-b5bc-4677-970c-4686a31a84b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:23.802094 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1459b-b5bc-4677-970c-4686a31a84b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:23.802362 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1459b-b5bc-4677-970c-4686a31a84b2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:23.809769 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1459b-b5bc-4677-970c-4686a31a84b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:23.811765 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1459b-b5bc-4677-970c-4686a31a84b2 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:23.827213 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-eee1459b-b5bc-4677-970c-4686a31a84b2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:38:23.828744 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 621/1269] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:38:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:38:23.834893 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05cdb8-cdea-4769-9d54-71488675143f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:23.846175 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05cdb8-cdea-4769-9d54-71488675143f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:23.851586 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97984f87-59ab-4641-bb39-1c0690cc83e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:23.852417 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97984f87-59ab-4641-bb39-1c0690cc83e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:23.852753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97984f87-59ab-4641-bb39-1c0690cc83e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:23.853012 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97984f87-59ab-4641-bb39-1c0690cc83e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:23.853827 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97984f87-59ab-4641-bb39-1c0690cc83e6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:23.854134 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97984f87-59ab-4641-bb39-1c0690cc83e6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:23.856104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97984f87-59ab-4641-bb39-1c0690cc83e6 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:23.874986 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 649/1270] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:38:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:23.876454 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1459b-b5bc-4677-970c-4686a31a84b2 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:23.889169 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1459b-b5bc-4677-970c-4686a31a84b2 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:23.893855 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14109660-f07d-48eb-9d78-43123effb014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:23.894733 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14109660-f07d-48eb-9d78-43123effb014 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:23.895009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14109660-f07d-48eb-9d78-43123effb014 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:23.895342 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14109660-f07d-48eb-9d78-43123effb014 admin admin] PATH_INFO: `/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/c6aa01ebd7314f30a1c729ff2b50c975/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:23.897601 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14109660-f07d-48eb-9d78-43123effb014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0105f8c08c84f538cd7ba86fcd26b62, user_id=c6aa01ebd7314f30a1c729ff2b50c975, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:23.900645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14109660-f07d-48eb-9d78-43123effb014 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:23.914557 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 622/1271] 10.222.0.13 () {58 vars in 1460 bytes} [Mon Jan 10 12:38:23 2022] PUT /identity/v3/projects/f0105f8c08c84f538cd7ba86fcd26b62/users/c6aa01ebd7314f30a1c729ff2b50c975/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:38:26.354909 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60daf42-ab91-45d8-ae16-7adee7116611 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:26.355824 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60daf42-ab91-45d8-ae16-7adee7116611 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:26.355824 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60daf42-ab91-45d8-ae16-7adee7116611 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:26.358665 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 650/1272] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:38:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:38:26.364117 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0914891-7377-46e8-a9c1-cf23ccd01962 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:26.364535 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0914891-7377-46e8-a9c1-cf23ccd01962 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:26.364624 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0914891-7377-46e8-a9c1-cf23ccd01962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:26.382738 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-a0914891-7377-46e8-a9c1-cf23ccd01962 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:38:26.383940 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-a0914891-7377-46e8-a9c1-cf23ccd01962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:38:26.442460 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 623/1273] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:38:26 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:38:26.468124 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60daf42-ab91-45d8-ae16-7adee7116611 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:26.484831 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60daf42-ab91-45d8-ae16-7adee7116611 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:26.490493 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1b2d0-5478-425c-850b-30040ed288d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:26.491278 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1b2d0-5478-425c-850b-30040ed288d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:26.491544 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1b2d0-5478-425c-850b-30040ed288d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:26.491959 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1b2d0-5478-425c-850b-30040ed288d8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:26.502052 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1b2d0-5478-425c-850b-30040ed288d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 10 12:38:26.509366 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-1eb1b2d0-5478-425c-850b-30040ed288d8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 10 12:38:26.510490 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 651/1274] 10.222.0.13 () {56 vars in 1117 bytes} [Mon Jan 10 12:38:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:26.516802 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0914891-7377-46e8-a9c1-cf23ccd01962 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:26.527209 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0914891-7377-46e8-a9c1-cf23ccd01962 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:26.534039 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe41a35-fba8-4657-b70c-f2cc9faba271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:26.535173 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe41a35-fba8-4657-b70c-f2cc9faba271 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:26.535719 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe41a35-fba8-4657-b70c-f2cc9faba271 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:26.536159 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe41a35-fba8-4657-b70c-f2cc9faba271 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:26.536928 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe41a35-fba8-4657-b70c-f2cc9faba271 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:26.537228 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe41a35-fba8-4657-b70c-f2cc9faba271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:26.539428 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe41a35-fba8-4657-b70c-f2cc9faba271 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:26.550368 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 624/1275] 10.222.0.13 () {56 vars in 1120 bytes} [Mon Jan 10 12:38:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:26.556863 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1b2d0-5478-425c-850b-30040ed288d8 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:26.568174 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1b2d0-5478-425c-850b-30040ed288d8 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:26.574363 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d2ddf-bc75-48b7-a703-eb41826d0420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:26.575135 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d2ddf-bc75-48b7-a703-eb41826d0420 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:26.575407 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d2ddf-bc75-48b7-a703-eb41826d0420 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:26.575710 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d2ddf-bc75-48b7-a703-eb41826d0420 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:26.587717 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d2ddf-bc75-48b7-a703-eb41826d0420 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:26.589561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d2ddf-bc75-48b7-a703-eb41826d0420 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:26.607372 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-146d2ddf-bc75-48b7-a703-eb41826d0420 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:38:26.608498 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 652/1276] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:26.614766 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe41a35-fba8-4657-b70c-f2cc9faba271 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:26.632359 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe41a35-fba8-4657-b70c-f2cc9faba271 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:26.638224 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651e507-9fcd-4bb0-880d-44f33489d007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:26.638873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e507-9fcd-4bb0-880d-44f33489d007 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:26.639146 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e507-9fcd-4bb0-880d-44f33489d007 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:26.639409 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e507-9fcd-4bb0-880d-44f33489d007 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:26.640181 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651e507-9fcd-4bb0-880d-44f33489d007 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:26.640484 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651e507-9fcd-4bb0-880d-44f33489d007 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:26.642087 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651e507-9fcd-4bb0-880d-44f33489d007 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:26.654368 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 625/1277] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:26.660034 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d2ddf-bc75-48b7-a703-eb41826d0420 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:26.670015 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d2ddf-bc75-48b7-a703-eb41826d0420 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:26.675032 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376303bd-d9ad-4821-9ba7-cd804f0b83d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:26.675840 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376303bd-d9ad-4821-9ba7-cd804f0b83d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:26.676121 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376303bd-d9ad-4821-9ba7-cd804f0b83d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:26.676385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376303bd-d9ad-4821-9ba7-cd804f0b83d4 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:26.683843 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376303bd-d9ad-4821-9ba7-cd804f0b83d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:26.685855 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376303bd-d9ad-4821-9ba7-cd804f0b83d4 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:26.699884 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-376303bd-d9ad-4821-9ba7-cd804f0b83d4 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 10 12:38:26.700992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 653/1278] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:38:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 10 12:38:26.706960 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651e507-9fcd-4bb0-880d-44f33489d007 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:26.722254 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651e507-9fcd-4bb0-880d-44f33489d007 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:26.729224 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460eef4-2422-4196-b9c5-044bdf4b0bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:26.729883 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460eef4-2422-4196-b9c5-044bdf4b0bfe admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:26.730156 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460eef4-2422-4196-b9c5-044bdf4b0bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:26.730422 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460eef4-2422-4196-b9c5-044bdf4b0bfe admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:26.731271 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460eef4-2422-4196-b9c5-044bdf4b0bfe admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:26.731574 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460eef4-2422-4196-b9c5-044bdf4b0bfe admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:26.733439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460eef4-2422-4196-b9c5-044bdf4b0bfe admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:26.753591 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 626/1279] 10.222.0.13 () {56 vars in 1164 bytes} [Mon Jan 10 12:38:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:38:26.759615 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376303bd-d9ad-4821-9ba7-cd804f0b83d4 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:26.769477 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376303bd-d9ad-4821-9ba7-cd804f0b83d4 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:26.774749 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528b6ec-5cd1-40d4-8070-e2ba5017741c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:26.775385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528b6ec-5cd1-40d4-8070-e2ba5017741c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:26.775697 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528b6ec-5cd1-40d4-8070-e2ba5017741c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:26.775964 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528b6ec-5cd1-40d4-8070-e2ba5017741c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:26.783875 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528b6ec-5cd1-40d4-8070-e2ba5017741c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:26.785626 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528b6ec-5cd1-40d4-8070-e2ba5017741c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:26.794591 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 654/1280] 10.222.0.13 () {58 vars in 1324 bytes} [Mon Jan 10 12:38:26 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:38:26.800645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460eef4-2422-4196-b9c5-044bdf4b0bfe admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:26.812167 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460eef4-2422-4196-b9c5-044bdf4b0bfe admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:26.818155 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d8c83-268f-4aaa-bf90-dc2eae936d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:26.818929 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d8c83-268f-4aaa-bf90-dc2eae936d9d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:26.819201 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d8c83-268f-4aaa-bf90-dc2eae936d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:26.819462 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d8c83-268f-4aaa-bf90-dc2eae936d9d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:26.830542 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d8c83-268f-4aaa-bf90-dc2eae936d9d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:26.832460 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d8c83-268f-4aaa-bf90-dc2eae936d9d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:26.857546 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-8c3d8c83-268f-4aaa-bf90-dc2eae936d9d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 10 12:38:26.859252 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 627/1281] 10.222.0.13 () {56 vars in 1129 bytes} [Mon Jan 10 12:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:26.868547 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528b6ec-5cd1-40d4-8070-e2ba5017741c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:26.882980 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528b6ec-5cd1-40d4-8070-e2ba5017741c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:26.890873 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f570e-15ff-4704-bfcd-ac5c130ec8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:26.891852 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f570e-15ff-4704-bfcd-ac5c130ec8ba admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:26.892128 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f570e-15ff-4704-bfcd-ac5c130ec8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:26.892390 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f570e-15ff-4704-bfcd-ac5c130ec8ba admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:26.893240 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f570e-15ff-4704-bfcd-ac5c130ec8ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:26.893539 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f570e-15ff-4704-bfcd-ac5c130ec8ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:26.895240 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f570e-15ff-4704-bfcd-ac5c130ec8ba admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:26.907240 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 655/1282] 10.222.0.13 () {56 vars in 1130 bytes} [Mon Jan 10 12:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:26.914348 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d8c83-268f-4aaa-bf90-dc2eae936d9d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:26.929904 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d8c83-268f-4aaa-bf90-dc2eae936d9d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:26.935490 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424f5e9-8ae3-4dd6-af91-1805a1e018de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:26.936447 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424f5e9-8ae3-4dd6-af91-1805a1e018de admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:26.936648 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424f5e9-8ae3-4dd6-af91-1805a1e018de admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:26.936926 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424f5e9-8ae3-4dd6-af91-1805a1e018de admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:26.946079 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424f5e9-8ae3-4dd6-af91-1805a1e018de admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:26.948350 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424f5e9-8ae3-4dd6-af91-1805a1e018de admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:26.964784 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING keystone.server.flask.application [None req-9424f5e9-8ae3-4dd6-af91-1805a1e018de admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 10 12:38:26.966498 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 628/1283] 10.222.0.13 () {56 vars in 1132 bytes} [Mon Jan 10 12:38:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:26.972422 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f570e-15ff-4704-bfcd-ac5c130ec8ba admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:26.985361 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f570e-15ff-4704-bfcd-ac5c130ec8ba admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:26.991673 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afaa6b9-568a-4490-8e19-57ecae687254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:26.992426 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afaa6b9-568a-4490-8e19-57ecae687254 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:26.992983 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afaa6b9-568a-4490-8e19-57ecae687254 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:26.992983 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afaa6b9-568a-4490-8e19-57ecae687254 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:26.993766 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afaa6b9-568a-4490-8e19-57ecae687254 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:26.994149 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afaa6b9-568a-4490-8e19-57ecae687254 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:26.996048 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afaa6b9-568a-4490-8e19-57ecae687254 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:27.009429 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 656/1284] 10.222.0.13 () {56 vars in 1169 bytes} [Mon Jan 10 12:38:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:27.016080 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424f5e9-8ae3-4dd6-af91-1805a1e018de admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:27.026635 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424f5e9-8ae3-4dd6-af91-1805a1e018de admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:27.031247 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27bc93-ce1a-474e-a5d2-4c92ac1de30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:27.031919 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27bc93-ce1a-474e-a5d2-4c92ac1de30e admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:27.032195 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27bc93-ce1a-474e-a5d2-4c92ac1de30e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:27.032458 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27bc93-ce1a-474e-a5d2-4c92ac1de30e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:27.033294 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27bc93-ce1a-474e-a5d2-4c92ac1de30e admin admin] RBAC: Adding query filter params (role.id=9d097c033f454263a874fbafe92c9aea, scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62, user.id=c6aa01ebd7314f30a1c729ff2b50c975) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:27.033605 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27bc93-ce1a-474e-a5d2-4c92ac1de30e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:27.035451 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27bc93-ce1a-474e-a5d2-4c92ac1de30e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:27.041698 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 629/1285] 10.222.0.13 () {56 vars in 1395 bytes} [Mon Jan 10 12:38:27 2022] GET /identity/v3/role_assignments?user.id=c6aa01ebd7314f30a1c729ff2b50c975&scope.project.id=f0105f8c08c84f538cd7ba86fcd26b62&role.id=9d097c033f454263a874fbafe92c9aea => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:29.479159 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d734707-f209-4c8f-923a-a76c4b2a0235 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:29.480152 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d734707-f209-4c8f-923a-a76c4b2a0235 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:29.480152 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d734707-f209-4c8f-923a-a76c4b2a0235 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:29.482933 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 657/1286] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:38:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:38:29.490324 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da99c0-bbc3-47bd-8646-a3840e38ddb3 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:29.491112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da99c0-bbc3-47bd-8646-a3840e38ddb3 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:29.491279 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da99c0-bbc3-47bd-8646-a3840e38ddb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:29.516967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-d8da99c0-bbc3-47bd-8646-a3840e38ddb3 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:38:29.518151 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-d8da99c0-bbc3-47bd-8646-a3840e38ddb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:38:29.526686 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 630/1287] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:38:29 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:38:29.549269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d734707-f209-4c8f-923a-a76c4b2a0235 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:29.563931 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d734707-f209-4c8f-923a-a76c4b2a0235 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:29.569410 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4104c-7872-438d-aa75-73974f911dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:29.570363 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4104c-7872-438d-aa75-73974f911dfa admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:29.570694 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4104c-7872-438d-aa75-73974f911dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:29.570964 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4104c-7872-438d-aa75-73974f911dfa admin admin] PATH_INFO: `/v3/services/placement` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:29.571719 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4104c-7872-438d-aa75-73974f911dfa admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:29.573316 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4104c-7872-438d-aa75-73974f911dfa admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:29.584198 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-5fc4104c-7872-438d-aa75-73974f911dfa admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 10 12:38:29.585425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 658/1288] 10.222.0.13 () {56 vars in 1138 bytes} [Mon Jan 10 12:38:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:29.593054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da99c0-bbc3-47bd-8646-a3840e38ddb3 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:29.603330 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da99c0-bbc3-47bd-8646-a3840e38ddb3 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:29.609184 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab7bbf-9bb3-4464-9a2b-f490cfa45bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:29.609850 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab7bbf-9bb3-4464-9a2b-f490cfa45bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:29.610124 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab7bbf-9bb3-4464-9a2b-f490cfa45bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:29.610397 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab7bbf-9bb3-4464-9a2b-f490cfa45bb7 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:29.611116 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab7bbf-9bb3-4464-9a2b-f490cfa45bb7 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:29.611420 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab7bbf-9bb3-4464-9a2b-f490cfa45bb7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:29.613091 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab7bbf-9bb3-4464-9a2b-f490cfa45bb7 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:29.618848 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 631/1289] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Jan 10 12:38:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:29.625521 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4104c-7872-438d-aa75-73974f911dfa admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:29.639030 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4104c-7872-438d-aa75-73974f911dfa admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:29.644190 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a8519-405f-4508-9a4e-a0e30fd53497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:29.644840 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a8519-405f-4508-9a4e-a0e30fd53497 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:29.645145 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a8519-405f-4508-9a4e-a0e30fd53497 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:29.645390 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a8519-405f-4508-9a4e-a0e30fd53497 admin admin] PATH_INFO: `/v3/services` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:29.646103 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a8519-405f-4508-9a4e-a0e30fd53497 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:29.646408 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a8519-405f-4508-9a4e-a0e30fd53497 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:29.648093 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a8519-405f-4508-9a4e-a0e30fd53497 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:29.653220 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 659/1290] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Jan 10 12:38:29 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:32.145726 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe88777-1434-4caa-acd8-a5ba37c69540 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:32.146295 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe88777-1434-4caa-acd8-a5ba37c69540 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:32.146295 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe88777-1434-4caa-acd8-a5ba37c69540 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:32.148713 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 632/1291] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:38:32.157480 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3836b50-df2c-46af-9019-d2e4272a5d6d None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:32.158188 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3836b50-df2c-46af-9019-d2e4272a5d6d None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:32.158355 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3836b50-df2c-46af-9019-d2e4272a5d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:32.184584 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-d3836b50-df2c-46af-9019-d2e4272a5d6d None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:38:32.185921 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d3836b50-df2c-46af-9019-d2e4272a5d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:38:32.196142 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 660/1292] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:38:32 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:38:32.221607 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe88777-1434-4caa-acd8-a5ba37c69540 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:32.235787 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe88777-1434-4caa-acd8-a5ba37c69540 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:32.240993 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866a142-1b7e-4862-abf6-c9c1c3915174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:32.241640 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866a142-1b7e-4862-abf6-c9c1c3915174 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:32.242008 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866a142-1b7e-4862-abf6-c9c1c3915174 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:32.242566 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866a142-1b7e-4862-abf6-c9c1c3915174 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:32.243176 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866a142-1b7e-4862-abf6-c9c1c3915174 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:32.244792 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866a142-1b7e-4862-abf6-c9c1c3915174 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:32.259324 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 633/1293] 10.222.0.13 () {60 vars in 1162 bytes} [Mon Jan 10 12:38:32 2022] POST /identity/v3/services => generated 246 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:38:34.697815 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30b5eb-0054-4a9d-9073-5e3181c07622 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:34.698411 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30b5eb-0054-4a9d-9073-5e3181c07622 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:34.698411 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30b5eb-0054-4a9d-9073-5e3181c07622 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:34.700678 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 661/1294] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:38:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:38:34.708037 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf51196-1887-409b-9f5f-71aeefeafad9 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:34.708462 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf51196-1887-409b-9f5f-71aeefeafad9 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:34.708569 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf51196-1887-409b-9f5f-71aeefeafad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:34.730017 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-8bf51196-1887-409b-9f5f-71aeefeafad9 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:38:34.731249 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-8bf51196-1887-409b-9f5f-71aeefeafad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:38:34.754403 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 634/1295] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:38:34 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:38:34.780789 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30b5eb-0054-4a9d-9073-5e3181c07622 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:34.798478 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30b5eb-0054-4a9d-9073-5e3181c07622 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:34.803643 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a448be1-3bbb-41aa-9c6e-e43effe95844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:34.804439 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a448be1-3bbb-41aa-9c6e-e43effe95844 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:34.804723 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a448be1-3bbb-41aa-9c6e-e43effe95844 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:34.804997 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a448be1-3bbb-41aa-9c6e-e43effe95844 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:34.805668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a448be1-3bbb-41aa-9c6e-e43effe95844 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:34.807276 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a448be1-3bbb-41aa-9c6e-e43effe95844 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:34.819220 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-8a448be1-3bbb-41aa-9c6e-e43effe95844 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 10 12:38:34.820450 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 662/1296] 10.222.0.13 () {56 vars in 1138 bytes} [Mon Jan 10 12:38:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:34.826555 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf51196-1887-409b-9f5f-71aeefeafad9 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:34.836745 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf51196-1887-409b-9f5f-71aeefeafad9 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:34.842610 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b7487-3853-4d0f-b313-7de896a4a469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:34.843303 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b7487-3853-4d0f-b313-7de896a4a469 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:34.843748 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b7487-3853-4d0f-b313-7de896a4a469 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:34.844050 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b7487-3853-4d0f-b313-7de896a4a469 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:34.844779 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b7487-3853-4d0f-b313-7de896a4a469 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:34.845081 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b7487-3853-4d0f-b313-7de896a4a469 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:34.846683 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b7487-3853-4d0f-b313-7de896a4a469 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:34.852641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 635/1297] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Jan 10 12:38:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:34.862199 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a448be1-3bbb-41aa-9c6e-e43effe95844 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:34.878597 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a448be1-3bbb-41aa-9c6e-e43effe95844 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:34.886150 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4e538-e488-472e-ae7f-dd03413838a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:34.886786 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4e538-e488-472e-ae7f-dd03413838a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:34.887060 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4e538-e488-472e-ae7f-dd03413838a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:34.887324 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4e538-e488-472e-ae7f-dd03413838a8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:34.888153 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4e538-e488-472e-ae7f-dd03413838a8 admin admin] RBAC: Adding query filter params (interface=public, service_id=ef734eaa21014f29977d537f7e525246, region_id=RegionOne) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:34.888456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4e538-e488-472e-ae7f-dd03413838a8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:34.890041 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4e538-e488-472e-ae7f-dd03413838a8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:34.895363 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 663/1298] 10.222.0.13 () {56 vars in 1272 bytes} [Mon Jan 10 12:38:34 2022] GET /identity/v3/endpoints?service_id=ef734eaa21014f29977d537f7e525246&interface=public®ion_id=RegionOne => generated 194 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:34.901325 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b7487-3853-4d0f-b313-7de896a4a469 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:34.912192 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b7487-3853-4d0f-b313-7de896a4a469 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:34.918570 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a19b4-7fa6-4685-9361-ea7e8deb7198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:34.919218 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a19b4-7fa6-4685-9361-ea7e8deb7198 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:34.919494 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a19b4-7fa6-4685-9361-ea7e8deb7198 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:34.919797 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a19b4-7fa6-4685-9361-ea7e8deb7198 admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:34.920487 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a19b4-7fa6-4685-9361-ea7e8deb7198 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:34.922063 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a19b4-7fa6-4685-9361-ea7e8deb7198 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:34.929317 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 636/1299] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jan 10 12:38:34 2022] GET /identity/v3/services => generated 2191 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:38:37.312745 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc29e15-df71-4a88-98c1-2c142a95bc7b None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:37.313715 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc29e15-df71-4a88-98c1-2c142a95bc7b None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:37.313715 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc29e15-df71-4a88-98c1-2c142a95bc7b None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:37.315429 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 664/1300] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:38:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:38:37.322532 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb43b3-3fe1-45f9-9172-c5f5a1b15b50 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:37.323199 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb43b3-3fe1-45f9-9172-c5f5a1b15b50 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:37.323395 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb43b3-3fe1-45f9-9172-c5f5a1b15b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:37.353109 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-d8eb43b3-3fe1-45f9-9172-c5f5a1b15b50 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:38:37.354895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-d8eb43b3-3fe1-45f9-9172-c5f5a1b15b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:38:37.369347 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 637/1301] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:38:37 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:38:37.408114 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc29e15-df71-4a88-98c1-2c142a95bc7b None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:37.424310 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc29e15-df71-4a88-98c1-2c142a95bc7b None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:37.429819 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a7b64-cefb-414a-a2af-075c7f95c9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:37.431127 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a7b64-cefb-414a-a2af-075c7f95c9fb admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:37.431402 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a7b64-cefb-414a-a2af-075c7f95c9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:37.431707 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a7b64-cefb-414a-a2af-075c7f95c9fb admin admin] PATH_INFO: `/v3/services/placement` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:37.432361 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a7b64-cefb-414a-a2af-075c7f95c9fb admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:37.433946 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a7b64-cefb-414a-a2af-075c7f95c9fb admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:37.445852 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING keystone.server.flask.application [None req-758a7b64-cefb-414a-a2af-075c7f95c9fb admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 10 12:38:37.447143 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 665/1302] 10.222.0.13 () {56 vars in 1138 bytes} [Mon Jan 10 12:38:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 10 12:38:37.453755 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb43b3-3fe1-45f9-9172-c5f5a1b15b50 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:37.466379 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb43b3-3fe1-45f9-9172-c5f5a1b15b50 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:37.473026 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a73e31-c58d-4cd7-a06f-135e2197e49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:37.473682 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a73e31-c58d-4cd7-a06f-135e2197e49e admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:37.473959 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a73e31-c58d-4cd7-a06f-135e2197e49e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:37.474221 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a73e31-c58d-4cd7-a06f-135e2197e49e admin admin] PATH_INFO: `/v3/services` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:37.474947 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a73e31-c58d-4cd7-a06f-135e2197e49e admin admin] RBAC: Adding query filter params (name=placement) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:38:37.475253 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a73e31-c58d-4cd7-a06f-135e2197e49e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:37.476966 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a73e31-c58d-4cd7-a06f-135e2197e49e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:37.483394 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 638/1303] 10.222.0.13 () {56 vars in 1137 bytes} [Mon Jan 10 12:38:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:38:37.492091 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a7b64-cefb-414a-a2af-075c7f95c9fb admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:38:37.503042 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a7b64-cefb-414a-a2af-075c7f95c9fb admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:38:37.508510 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf299991-dd47-4d6b-8742-c8a8fdf190de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:38:37.509158 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf299991-dd47-4d6b-8742-c8a8fdf190de admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:38:37.509436 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf299991-dd47-4d6b-8742-c8a8fdf190de admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:38:37.509708 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf299991-dd47-4d6b-8742-c8a8fdf190de admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:38:37.510444 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf299991-dd47-4d6b-8742-c8a8fdf190de admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:38:37.512060 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf299991-dd47-4d6b-8742-c8a8fdf190de admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:38:37.533768 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 666/1304] 10.222.0.13 () {60 vars in 1165 bytes} [Mon Jan 10 12:38:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:39:41.634228 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3236f-a46e-479a-badb-a2ada04d3466 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:41.635385 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3236f-a46e-479a-badb-a2ada04d3466 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:41.636164 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3236f-a46e-479a-badb-a2ada04d3466 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:41.638222 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 639/1305] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:39:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:39:41.645351 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec8c12-763c-49a5-9d30-891066bdd086 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:41.645898 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec8c12-763c-49a5-9d30-891066bdd086 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:41.645898 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec8c12-763c-49a5-9d30-891066bdd086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:41.805399 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-ccec8c12-763c-49a5-9d30-891066bdd086 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:39:41.806629 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ccec8c12-763c-49a5-9d30-891066bdd086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:39:42.044870 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 667/1306] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:39:42.068622 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3236f-a46e-479a-badb-a2ada04d3466 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:39:42.070671 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-38b3236f-a46e-479a-badb-a2ada04d3466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:39:42.220852 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3236f-a46e-479a-badb-a2ada04d3466 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:39:42.319182 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4dc17-15e8-4f0e-9137-1d0f1b95836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:39:42.320172 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4dc17-15e8-4f0e-9137-1d0f1b95836a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:42.320589 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4dc17-15e8-4f0e-9137-1d0f1b95836a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:42.320998 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4dc17-15e8-4f0e-9137-1d0f1b95836a admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:42.322031 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4dc17-15e8-4f0e-9137-1d0f1b95836a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:39:42.324765 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4dc17-15e8-4f0e-9137-1d0f1b95836a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:39:42.347135 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 640/1307] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jan 10 12:39:42 2022] GET /identity/v3/projects => generated 2553 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:39:44.847814 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40016-954f-4e1b-9fcf-52015a007e6b None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:44.848635 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40016-954f-4e1b-9fcf-52015a007e6b None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:44.848912 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40016-954f-4e1b-9fcf-52015a007e6b None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:44.850737 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 668/1308] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:39:44.857804 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490ffbe-f018-469d-b03b-c37456b16fa0 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:44.858280 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490ffbe-f018-469d-b03b-c37456b16fa0 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:44.858361 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490ffbe-f018-469d-b03b-c37456b16fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:45.060385 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-4490ffbe-f018-469d-b03b-c37456b16fa0 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:39:45.061616 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-4490ffbe-f018-469d-b03b-c37456b16fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:39:45.159308 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 641/1309] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:39:45.182787 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40016-954f-4e1b-9fcf-52015a007e6b None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:39:45.184377 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-72c40016-954f-4e1b-9fcf-52015a007e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:39:45.310496 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40016-954f-4e1b-9fcf-52015a007e6b None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:39:45.404764 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608add7-e9df-41b5-96e1-d1c4fe6fbe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:39:45.405428 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608add7-e9df-41b5-96e1-d1c4fe6fbe0b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:45.405701 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608add7-e9df-41b5-96e1-d1c4fe6fbe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:45.405966 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608add7-e9df-41b5-96e1-d1c4fe6fbe0b admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:45.406694 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608add7-e9df-41b5-96e1-d1c4fe6fbe0b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:39:45.408585 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608add7-e9df-41b5-96e1-d1c4fe6fbe0b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:39:45.427845 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 669/1310] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jan 10 12:39:45 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:39:47.863176 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58da86-b907-4944-96fa-84f5ac7e1b93 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:47.863797 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58da86-b907-4944-96fa-84f5ac7e1b93 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:47.863797 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58da86-b907-4944-96fa-84f5ac7e1b93 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:47.865564 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 642/1311] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:39:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:39:47.870992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc646d-fd33-47fc-be02-3973e0369cad None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:47.871438 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc646d-fd33-47fc-be02-3973e0369cad None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:47.871564 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc646d-fd33-47fc-be02-3973e0369cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:47.936476 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-2ffc646d-fd33-47fc-be02-3973e0369cad None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:39:47.938050 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-2ffc646d-fd33-47fc-be02-3973e0369cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:39:48.049001 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 670/1312] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:39:48.121951 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95886ce5-98ec-4577-89a3-d136e04a4dc2 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:48.122288 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95886ce5-98ec-4577-89a3-d136e04a4dc2 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:48.122680 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95886ce5-98ec-4577-89a3-d136e04a4dc2 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:48.125657 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 643/1313] 10.222.0.13 () {54 vars in 964 bytes} [Mon Jan 10 12:39:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:39:48.135087 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6af8dc-f9a9-4ec4-9f0f-bbd5c186935a None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:48.135491 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6af8dc-f9a9-4ec4-9f0f-bbd5c186935a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:48.135832 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6af8dc-f9a9-4ec4-9f0f-bbd5c186935a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:48.219978 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-5b6af8dc-f9a9-4ec4-9f0f-bbd5c186935a None None] MFA Rules not processed for user `fa3a96ff9ab74aeb88465b14de3038eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:39:48.221173 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-5b6af8dc-f9a9-4ec4-9f0f-bbd5c186935a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:39:48.298348 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 671/1314] 10.222.0.13 () {58 vars in 1061 bytes} [Mon Jan 10 12:39:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:39:48.307693 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95886ce5-98ec-4577-89a3-d136e04a4dc2 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:39:48.309298 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-95886ce5-98ec-4577-89a3-d136e04a4dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:39:48.418304 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95886ce5-98ec-4577-89a3-d136e04a4dc2 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:39:48.498192 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce7abf-ba49-4363-83f1-963cc21657cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:39:48.498843 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce7abf-ba49-4363-83f1-963cc21657cb service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:48.499116 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce7abf-ba49-4363-83f1-963cc21657cb service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:48.499378 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce7abf-ba49-4363-83f1-963cc21657cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:48.501023 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-22ce7abf-ba49-4363-83f1-963cc21657cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:39:48.616440 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce7abf-ba49-4363-83f1-963cc21657cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:39:48.617788 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce7abf-ba49-4363-83f1-963cc21657cb service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:39:48.636287 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 644/1315] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:39:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:39:51.315703 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9e9eb-136f-4db8-94a4-27681fa6e0da None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:51.316184 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9e9eb-136f-4db8-94a4-27681fa6e0da None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:51.316273 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9e9eb-136f-4db8-94a4-27681fa6e0da None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:51.318074 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 672/1316] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:39:51.323875 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603dc7a-7851-453d-b49d-7850df66d914 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:51.324316 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603dc7a-7851-453d-b49d-7850df66d914 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:51.324409 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603dc7a-7851-453d-b49d-7850df66d914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:51.395226 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-9603dc7a-7851-453d-b49d-7850df66d914 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:39:51.396447 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9603dc7a-7851-453d-b49d-7850df66d914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:39:51.493268 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 645/1317] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:39:51.529005 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9e9eb-136f-4db8-94a4-27681fa6e0da None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:39:51.530540 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b6b9e9eb-136f-4db8-94a4-27681fa6e0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:39:51.662174 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9e9eb-136f-4db8-94a4-27681fa6e0da None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:39:51.764069 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57850a57-5ab2-43ed-8677-ca9d65a4c2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:39:51.764930 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57850a57-5ab2-43ed-8677-ca9d65a4c2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:51.765219 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57850a57-5ab2-43ed-8677-ca9d65a4c2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:51.765487 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57850a57-5ab2-43ed-8677-ca9d65a4c2d1 admin admin] PATH_INFO: `/v3/projects/230e0a61baae4ee798a1e664588228fe` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:51.766536 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57850a57-5ab2-43ed-8677-ca9d65a4c2d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=230e0a61baae4ee798a1e664588228fe)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:39:51.768432 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57850a57-5ab2-43ed-8677-ca9d65a4c2d1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:39:51.770123 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 673/1318] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:39:51 2022] GET /identity/v3/projects/230e0a61baae4ee798a1e664588228fe => generated 344 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:39:51.799506 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb629f54-c19b-4f3f-92a8-48a5612a3f70 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:51.799923 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb629f54-c19b-4f3f-92a8-48a5612a3f70 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:51.800316 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb629f54-c19b-4f3f-92a8-48a5612a3f70 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:51.803197 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 646/1319] 10.222.0.13 () {54 vars in 964 bytes} [Mon Jan 10 12:39:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:39:51.809595 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22cf03-9c95-447b-b8f3-490fbc066936 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:51.809875 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22cf03-9c95-447b-b8f3-490fbc066936 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:51.810145 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22cf03-9c95-447b-b8f3-490fbc066936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:51.898423 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-4a22cf03-9c95-447b-b8f3-490fbc066936 None None] MFA Rules not processed for user `fa3a96ff9ab74aeb88465b14de3038eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:39:51.900184 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-4a22cf03-9c95-447b-b8f3-490fbc066936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:39:51.985281 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 674/1320] 10.222.0.13 () {58 vars in 1061 bytes} [Mon Jan 10 12:39:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:39:51.998127 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb629f54-c19b-4f3f-92a8-48a5612a3f70 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:39:52.000998 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-fb629f54-c19b-4f3f-92a8-48a5612a3f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:39:52.124102 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb629f54-c19b-4f3f-92a8-48a5612a3f70 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:39:52.196627 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932bec0-91d0-4f1d-8b7e-1c472f824db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:39:52.197274 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932bec0-91d0-4f1d-8b7e-1c472f824db7 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:52.197554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932bec0-91d0-4f1d-8b7e-1c472f824db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:52.197859 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932bec0-91d0-4f1d-8b7e-1c472f824db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:52.199480 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9932bec0-91d0-4f1d-8b7e-1c472f824db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:39:52.309704 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932bec0-91d0-4f1d-8b7e-1c472f824db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:39:52.311056 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932bec0-91d0-4f1d-8b7e-1c472f824db7 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:39:52.330353 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 647/1321] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:39:55.303390 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fb9c5-b674-4af9-88de-a057892e9b24 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:55.303919 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fb9c5-b674-4af9-88de-a057892e9b24 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:55.304012 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fb9c5-b674-4af9-88de-a057892e9b24 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:55.306084 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 675/1322] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:39:55.313675 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9d013-807b-494b-abe4-34d35105c5b8 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:55.314086 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9d013-807b-494b-abe4-34d35105c5b8 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:55.314419 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9d013-807b-494b-abe4-34d35105c5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:55.391394 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-84a9d013-807b-494b-abe4-34d35105c5b8 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:39:55.392642 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-84a9d013-807b-494b-abe4-34d35105c5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:39:55.488243 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 648/1323] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:39:55.524694 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fb9c5-b674-4af9-88de-a057892e9b24 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:39:55.527155 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-946fb9c5-b674-4af9-88de-a057892e9b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:39:55.665310 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fb9c5-b674-4af9-88de-a057892e9b24 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:39:55.766980 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd90546-7fcb-4ed4-87d7-6c9b85c43080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:39:55.767890 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd90546-7fcb-4ed4-87d7-6c9b85c43080 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:55.768166 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd90546-7fcb-4ed4-87d7-6c9b85c43080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:55.768433 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd90546-7fcb-4ed4-87d7-6c9b85c43080 admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:55.778531 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd90546-7fcb-4ed4-87d7-6c9b85c43080 admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:39:55.780657 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd90546-7fcb-4ed4-87d7-6c9b85c43080 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:39:55.782354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 676/1324] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:39:55 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:39:55.798076 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9d013-807b-494b-abe4-34d35105c5b8 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:39:55.799939 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-84a9d013-807b-494b-abe4-34d35105c5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:39:55.893390 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9d013-807b-494b-abe4-34d35105c5b8 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:39:55.978388 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8df69-3cc0-4337-808f-e35ec4ad1e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:39:55.979177 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8df69-3cc0-4337-808f-e35ec4ad1e5f service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:55.979452 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8df69-3cc0-4337-808f-e35ec4ad1e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:55.979778 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8df69-3cc0-4337-808f-e35ec4ad1e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:55.981402 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-6bc8df69-3cc0-4337-808f-e35ec4ad1e5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:39:56.094753 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8df69-3cc0-4337-808f-e35ec4ad1e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:39:56.096360 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8df69-3cc0-4337-808f-e35ec4ad1e5f service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:39:56.114190 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 649/1325] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:39:59.365332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fede8-145b-4f5f-8fe1-dc0768cfa982 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:59.366146 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fede8-145b-4f5f-8fe1-dc0768cfa982 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:59.366296 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fede8-145b-4f5f-8fe1-dc0768cfa982 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:59.369225 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 677/1326] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:39:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:39:59.375567 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86b86f-a2fc-4bf6-8886-152d51796252 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:59.376000 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86b86f-a2fc-4bf6-8886-152d51796252 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:59.376119 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86b86f-a2fc-4bf6-8886-152d51796252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:59.464218 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-9b86b86f-a2fc-4bf6-8886-152d51796252 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:39:59.465411 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9b86b86f-a2fc-4bf6-8886-152d51796252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:39:59.565605 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 650/1327] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:39:59.611797 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fede8-145b-4f5f-8fe1-dc0768cfa982 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:39:59.613372 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-142fede8-145b-4f5f-8fe1-dc0768cfa982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:39:59.762225 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fede8-145b-4f5f-8fe1-dc0768cfa982 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:39:59.866697 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61763502-0e6a-4e60-a24e-323946f3d3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:39:59.867470 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61763502-0e6a-4e60-a24e-323946f3d3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:39:59.867800 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61763502-0e6a-4e60-a24e-323946f3d3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:39:59.868063 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61763502-0e6a-4e60-a24e-323946f3d3f1 admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:39:59.878094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61763502-0e6a-4e60-a24e-323946f3d3f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:39:59.880199 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61763502-0e6a-4e60-a24e-323946f3d3f1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:39:59.881876 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 678/1328] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:39:59 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:39:59.896711 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86b86f-a2fc-4bf6-8886-152d51796252 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:39:59.897929 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9b86b86f-a2fc-4bf6-8886-152d51796252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:00.006595 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86b86f-a2fc-4bf6-8886-152d51796252 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:40:00.095148 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95afb2d-1b40-4f34-bf69-594af91a6e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:40:00.095901 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95afb2d-1b40-4f34-bf69-594af91a6e68 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:00.096157 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95afb2d-1b40-4f34-bf69-594af91a6e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:00.096429 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95afb2d-1b40-4f34-bf69-594af91a6e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:00.098079 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-a95afb2d-1b40-4f34-bf69-594af91a6e68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:00.211030 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95afb2d-1b40-4f34-bf69-594af91a6e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:40:00.212507 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95afb2d-1b40-4f34-bf69-594af91a6e68 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:40:00.230423 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 651/1329] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:40:03.391758 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aa31b-02d2-4207-8bec-badef5eba0a8 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:03.392353 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aa31b-02d2-4207-8bec-badef5eba0a8 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:03.392353 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aa31b-02d2-4207-8bec-badef5eba0a8 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:03.394104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 679/1330] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:40:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:40:03.399418 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbaf528-6069-475c-a18b-9fc641cd6d46 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:03.399864 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbaf528-6069-475c-a18b-9fc641cd6d46 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:03.400011 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbaf528-6069-475c-a18b-9fc641cd6d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:03.467527 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-ecbaf528-6069-475c-a18b-9fc641cd6d46 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:03.468752 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-ecbaf528-6069-475c-a18b-9fc641cd6d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:03.567636 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 652/1331] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:40:03.605188 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268aa31b-02d2-4207-8bec-badef5eba0a8 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:40:03.606729 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-268aa31b-02d2-4207-8bec-badef5eba0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:03.716039 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268aa31b-02d2-4207-8bec-badef5eba0a8 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:40:03.793149 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee3551-0754-4818-a5c7-8a58cd1ba6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:40:03.793807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee3551-0754-4818-a5c7-8a58cd1ba6ca service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:03.794088 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee3551-0754-4818-a5c7-8a58cd1ba6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:03.794357 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee3551-0754-4818-a5c7-8a58cd1ba6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:03.796179 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-23ee3551-0754-4818-a5c7-8a58cd1ba6ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:03.912906 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee3551-0754-4818-a5c7-8a58cd1ba6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:40:03.914393 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee3551-0754-4818-a5c7-8a58cd1ba6ca service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:40:03.936153 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 680/1332] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:40:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:40:06.412645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c26e0b-3f44-4f17-b98b-0cb697cb6fef None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:06.413326 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c26e0b-3f44-4f17-b98b-0cb697cb6fef None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:06.413440 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c26e0b-3f44-4f17-b98b-0cb697cb6fef None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:06.416439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 653/1333] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:40:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:40:06.422133 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8267c-d03b-43ab-aa82-6888948dbeca None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:06.422560 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8267c-d03b-43ab-aa82-6888948dbeca None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:06.422748 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8267c-d03b-43ab-aa82-6888948dbeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:06.489818 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-b8f8267c-d03b-43ab-aa82-6888948dbeca None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:06.491024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b8f8267c-d03b-43ab-aa82-6888948dbeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:06.591778 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 681/1334] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:40:06.629936 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c26e0b-3f44-4f17-b98b-0cb697cb6fef None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:40:06.631428 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-20c26e0b-3f44-4f17-b98b-0cb697cb6fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:06.741049 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c26e0b-3f44-4f17-b98b-0cb697cb6fef None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:40:06.814777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c6b64-fe3a-4807-9fb0-fc32e18b195f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:40:06.815434 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c6b64-fe3a-4807-9fb0-fc32e18b195f service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:06.815744 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c6b64-fe3a-4807-9fb0-fc32e18b195f service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:06.816021 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c6b64-fe3a-4807-9fb0-fc32e18b195f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:06.817637 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e85c6b64-fe3a-4807-9fb0-fc32e18b195f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:06.939694 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c6b64-fe3a-4807-9fb0-fc32e18b195f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:40:06.941240 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c6b64-fe3a-4807-9fb0-fc32e18b195f service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:40:06.961187 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 654/1335] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:40:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:40:09.420308 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202aa62c-aafc-43d5-85e8-e35324f25445 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:09.420869 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202aa62c-aafc-43d5-85e8-e35324f25445 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:09.420869 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202aa62c-aafc-43d5-85e8-e35324f25445 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:09.422714 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 682/1336] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:40:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:40:09.428207 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698b158-81b7-4e5e-8352-49f40e40a689 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:09.428603 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698b158-81b7-4e5e-8352-49f40e40a689 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:09.428791 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698b158-81b7-4e5e-8352-49f40e40a689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:09.496933 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-1698b158-81b7-4e5e-8352-49f40e40a689 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:09.498173 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-1698b158-81b7-4e5e-8352-49f40e40a689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:09.596849 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 655/1337] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:40:09.629999 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202aa62c-aafc-43d5-85e8-e35324f25445 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:40:09.631582 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-202aa62c-aafc-43d5-85e8-e35324f25445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:09.770665 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202aa62c-aafc-43d5-85e8-e35324f25445 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:40:09.875206 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dba32c-e9df-4daf-8a8a-c15099d3b723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:40:09.876040 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dba32c-e9df-4daf-8a8a-c15099d3b723 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:09.876320 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dba32c-e9df-4daf-8a8a-c15099d3b723 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:09.876591 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dba32c-e9df-4daf-8a8a-c15099d3b723 admin admin] PATH_INFO: `/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:09.888319 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dba32c-e9df-4daf-8a8a-c15099d3b723 admin admin] RBAC: Authorizing `identity:get_project(project_id=28a2db78a87c4bd69fde46b3f80e8b5e)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:40:09.890413 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dba32c-e9df-4daf-8a8a-c15099d3b723 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:40:09.892339 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 683/1338] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:40:09 2022] GET /identity/v3/projects/28a2db78a87c4bd69fde46b3f80e8b5e => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:40:09.904705 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698b158-81b7-4e5e-8352-49f40e40a689 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:40:09.905937 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-1698b158-81b7-4e5e-8352-49f40e40a689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:10.000622 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698b158-81b7-4e5e-8352-49f40e40a689 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:40:10.075824 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8471547-0549-4bc9-beb9-346ab460b080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:40:10.076474 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8471547-0549-4bc9-beb9-346ab460b080 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:10.076749 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8471547-0549-4bc9-beb9-346ab460b080 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:10.076980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8471547-0549-4bc9-beb9-346ab460b080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:10.078617 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-f8471547-0549-4bc9-beb9-346ab460b080 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:10.185965 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8471547-0549-4bc9-beb9-346ab460b080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:40:10.187712 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8471547-0549-4bc9-beb9-346ab460b080 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:40:10.205651 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 656/1339] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:40:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:40:12.871448 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3218bd8-c953-4254-b625-901ccf8933d3 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:12.872073 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3218bd8-c953-4254-b625-901ccf8933d3 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:12.872073 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3218bd8-c953-4254-b625-901ccf8933d3 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:12.873797 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 684/1340] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:40:12.879381 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271f55b-7d23-4622-ab9d-a0b8da738c17 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:12.879858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271f55b-7d23-4622-ab9d-a0b8da738c17 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:12.879965 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271f55b-7d23-4622-ab9d-a0b8da738c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:12.954495 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-9271f55b-7d23-4622-ab9d-a0b8da738c17 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:12.955923 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9271f55b-7d23-4622-ab9d-a0b8da738c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:13.065984 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 657/1341] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:40:13.103775 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3218bd8-c953-4254-b625-901ccf8933d3 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:40:13.106163 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-a3218bd8-c953-4254-b625-901ccf8933d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:13.207826 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3218bd8-c953-4254-b625-901ccf8933d3 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:40:13.211693 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbb074-dd0a-4143-ab57-a3a4b81d8ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:40:13.212352 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbb074-dd0a-4143-ab57-a3a4b81d8ebf service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:13.212646 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbb074-dd0a-4143-ab57-a3a4b81d8ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:13.212964 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbb074-dd0a-4143-ab57-a3a4b81d8ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:13.223413 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbb074-dd0a-4143-ab57-a3a4b81d8ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:40:13.224932 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbb074-dd0a-4143-ab57-a3a4b81d8ebf service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:40:13.235146 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 685/1342] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:40:15.677371 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85219872-d7d1-42c0-b0a8-387a3a3b35c5 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:15.677932 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85219872-d7d1-42c0-b0a8-387a3a3b35c5 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:15.677932 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85219872-d7d1-42c0-b0a8-387a3a3b35c5 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:15.679697 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 658/1343] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:40:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:40:15.685276 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de126a32-f164-4b84-a43a-ffab332357a7 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:15.685695 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de126a32-f164-4b84-a43a-ffab332357a7 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:15.685803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de126a32-f164-4b84-a43a-ffab332357a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:15.706660 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-de126a32-f164-4b84-a43a-ffab332357a7 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:15.707873 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-de126a32-f164-4b84-a43a-ffab332357a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:15.717406 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 686/1344] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:40:15.753497 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85219872-d7d1-42c0-b0a8-387a3a3b35c5 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:40:15.766089 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85219872-d7d1-42c0-b0a8-387a3a3b35c5 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:40:15.770379 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803263b2-d29a-47fb-a497-0793e39707e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:40:15.771422 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803263b2-d29a-47fb-a497-0793e39707e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:15.771728 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803263b2-d29a-47fb-a497-0793e39707e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:15.772025 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803263b2-d29a-47fb-a497-0793e39707e9 admin admin] PATH_INFO: `/v3/projects/230e0a61baae4ee798a1e664588228fe` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:15.773326 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803263b2-d29a-47fb-a497-0793e39707e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=230e0a61baae4ee798a1e664588228fe)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:40:15.775374 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803263b2-d29a-47fb-a497-0793e39707e9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:40:15.777337 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 659/1345] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:40:15 2022] GET /identity/v3/projects/230e0a61baae4ee798a1e664588228fe => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:40:15.789429 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de126a32-f164-4b84-a43a-ffab332357a7 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:40:15.800979 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de126a32-f164-4b84-a43a-ffab332357a7 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:40:15.805572 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4a0f7-120f-43b4-8edf-b6d1ca8c42d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:40:15.806218 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4a0f7-120f-43b4-8edf-b6d1ca8c42d1 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:15.806495 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4a0f7-120f-43b4-8edf-b6d1ca8c42d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:15.806764 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4a0f7-120f-43b4-8edf-b6d1ca8c42d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:15.816730 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4a0f7-120f-43b4-8edf-b6d1ca8c42d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:40:15.818173 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4a0f7-120f-43b4-8edf-b6d1ca8c42d1 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:40:15.828076 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 687/1346] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:40:18.519683 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c351ccc-53b4-4a81-8fed-6b6ddd80dafc None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:18.520304 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c351ccc-53b4-4a81-8fed-6b6ddd80dafc None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:18.520304 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c351ccc-53b4-4a81-8fed-6b6ddd80dafc None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:18.522003 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 660/1347] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:40:18.528401 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105cf82-6f89-492b-ac30-42b5532fb577 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:18.528839 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105cf82-6f89-492b-ac30-42b5532fb577 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:18.528948 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105cf82-6f89-492b-ac30-42b5532fb577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:18.552469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-9105cf82-6f89-492b-ac30-42b5532fb577 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:18.553666 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-9105cf82-6f89-492b-ac30-42b5532fb577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:18.563406 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 688/1348] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:40:18.604695 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c351ccc-53b4-4a81-8fed-6b6ddd80dafc None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:40:18.617144 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c351ccc-53b4-4a81-8fed-6b6ddd80dafc None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:40:18.621652 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f528226-4643-405e-a1c5-3764d6cd7185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:40:18.622284 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f528226-4643-405e-a1c5-3764d6cd7185 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:18.622562 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f528226-4643-405e-a1c5-3764d6cd7185 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:18.622830 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f528226-4643-405e-a1c5-3764d6cd7185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:18.632753 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f528226-4643-405e-a1c5-3764d6cd7185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:40:18.634179 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f528226-4643-405e-a1c5-3764d6cd7185 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:40:18.643807 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 661/1349] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:40:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:40:23.090615 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f241080-a7ee-42ec-86e7-4f0489ab9cf9 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:23.091147 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f241080-a7ee-42ec-86e7-4f0489ab9cf9 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:23.091456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f241080-a7ee-42ec-86e7-4f0489ab9cf9 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:23.094833 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 689/1350] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:40:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:40:23.101581 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c86c81-8700-413b-831f-673bb7f22b3d None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:23.102050 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c86c81-8700-413b-831f-673bb7f22b3d None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:23.102143 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c86c81-8700-413b-831f-673bb7f22b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:23.121069 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-58c86c81-8700-413b-831f-673bb7f22b3d None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:23.122259 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-58c86c81-8700-413b-831f-673bb7f22b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:23.130903 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 662/1351] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:40:23.154245 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f241080-a7ee-42ec-86e7-4f0489ab9cf9 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:40:23.168129 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f241080-a7ee-42ec-86e7-4f0489ab9cf9 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:40:23.173025 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0743c47-366a-4052-8948-c11dce0cfdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:40:23.173688 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0743c47-366a-4052-8948-c11dce0cfdd3 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:23.173965 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0743c47-366a-4052-8948-c11dce0cfdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:23.174233 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0743c47-366a-4052-8948-c11dce0cfdd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:23.174967 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0743c47-366a-4052-8948-c11dce0cfdd3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:40:23.176895 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0743c47-366a-4052-8948-c11dce0cfdd3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:40:23.191367 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 690/1352] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jan 10 12:40:23 2022] GET /identity/v3/projects => generated 2553 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:40:25.618977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd04c0-28f5-408b-aa78-e8ef9764eb9c None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:25.619544 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd04c0-28f5-408b-aa78-e8ef9764eb9c None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:25.619544 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd04c0-28f5-408b-aa78-e8ef9764eb9c None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:25.621394 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 663/1353] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:40:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:40:25.626653 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20031c5-b09d-4990-9ee0-8d1af042ee70 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:25.627078 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20031c5-b09d-4990-9ee0-8d1af042ee70 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:25.627165 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20031c5-b09d-4990-9ee0-8d1af042ee70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:25.645648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-c20031c5-b09d-4990-9ee0-8d1af042ee70 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:25.646837 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c20031c5-b09d-4990-9ee0-8d1af042ee70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:25.655307 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 691/1354] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:40:25.691036 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd04c0-28f5-408b-aa78-e8ef9764eb9c None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:40:25.706507 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd04c0-28f5-408b-aa78-e8ef9764eb9c None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:40:25.711481 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6244b-8f23-478f-b429-b92fa110b88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:40:25.712437 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6244b-8f23-478f-b429-b92fa110b88f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:25.712714 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6244b-8f23-478f-b429-b92fa110b88f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:25.712981 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6244b-8f23-478f-b429-b92fa110b88f admin admin] PATH_INFO: `/v3/projects/230e0a61baae4ee798a1e664588228fe` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:25.714332 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6244b-8f23-478f-b429-b92fa110b88f admin admin] RBAC: Authorizing `identity:get_project(project_id=230e0a61baae4ee798a1e664588228fe)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:40:25.716202 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6244b-8f23-478f-b429-b92fa110b88f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:40:25.717919 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 664/1355] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:40:25 2022] GET /identity/v3/projects/230e0a61baae4ee798a1e664588228fe => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:40:25.732843 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20031c5-b09d-4990-9ee0-8d1af042ee70 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:40:25.734476 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c20031c5-b09d-4990-9ee0-8d1af042ee70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:25.746624 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20031c5-b09d-4990-9ee0-8d1af042ee70 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:40:25.750235 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda5540-4b82-448a-adde-f959f31fc198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:40:25.750885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda5540-4b82-448a-adde-f959f31fc198 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:25.751169 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda5540-4b82-448a-adde-f959f31fc198 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:25.751429 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda5540-4b82-448a-adde-f959f31fc198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:25.760735 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda5540-4b82-448a-adde-f959f31fc198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:40:25.762180 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda5540-4b82-448a-adde-f959f31fc198 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:40:25.771295 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 692/1356] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:40:28.796934 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354ed17-8499-4d11-bc12-6b0b6c0efa37 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:28.797486 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354ed17-8499-4d11-bc12-6b0b6c0efa37 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:28.797486 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354ed17-8499-4d11-bc12-6b0b6c0efa37 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:28.799476 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 665/1357] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:40:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:40:28.804591 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081dd68-6043-4b78-b465-f072b7180299 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:28.805035 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081dd68-6043-4b78-b465-f072b7180299 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:28.805129 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081dd68-6043-4b78-b465-f072b7180299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:28.823824 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-f081dd68-6043-4b78-b465-f072b7180299 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:28.825022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f081dd68-6043-4b78-b465-f072b7180299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:28.833666 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 693/1358] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:40:28.871887 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354ed17-8499-4d11-bc12-6b0b6c0efa37 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:40:28.886455 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354ed17-8499-4d11-bc12-6b0b6c0efa37 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:40:28.892449 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02507e03-4a28-4476-848b-873a355681b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:40:28.893440 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02507e03-4a28-4476-848b-873a355681b7 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:28.893940 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02507e03-4a28-4476-848b-873a355681b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:28.894364 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02507e03-4a28-4476-848b-873a355681b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:28.905890 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02507e03-4a28-4476-848b-873a355681b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:40:28.907321 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02507e03-4a28-4476-848b-873a355681b7 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:40:28.916620 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 666/1359] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:40:33.525445 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935864de-bd0d-4d38-aba5-b1a05ec4a6a2 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:33.526051 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935864de-bd0d-4d38-aba5-b1a05ec4a6a2 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:33.526051 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935864de-bd0d-4d38-aba5-b1a05ec4a6a2 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:33.527746 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 694/1360] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:40:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:40:33.533375 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055321e-52ee-4cd9-9dd6-f8ff5e64b878 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:33.533830 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055321e-52ee-4cd9-9dd6-f8ff5e64b878 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:33.534032 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055321e-52ee-4cd9-9dd6-f8ff5e64b878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:33.553027 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-a055321e-52ee-4cd9-9dd6-f8ff5e64b878 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:33.554231 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-a055321e-52ee-4cd9-9dd6-f8ff5e64b878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:33.564643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 667/1361] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:40:33.613897 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935864de-bd0d-4d38-aba5-b1a05ec4a6a2 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:40:33.626059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935864de-bd0d-4d38-aba5-b1a05ec4a6a2 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:40:33.631807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454703bd-f0a2-4b7d-99fb-b45bf08f89c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:40:33.632766 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454703bd-f0a2-4b7d-99fb-b45bf08f89c7 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:33.633134 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454703bd-f0a2-4b7d-99fb-b45bf08f89c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:33.633543 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454703bd-f0a2-4b7d-99fb-b45bf08f89c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:33.643417 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454703bd-f0a2-4b7d-99fb-b45bf08f89c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:40:33.644890 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454703bd-f0a2-4b7d-99fb-b45bf08f89c7 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:40:33.655234 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 695/1362] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:40:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:40:38.573941 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98516e-f93e-4ea5-8e35-2564274ef32c None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:38.574750 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98516e-f93e-4ea5-8e35-2564274ef32c None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:38.575157 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98516e-f93e-4ea5-8e35-2564274ef32c None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:38.577495 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 668/1363] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jan 10 12:40:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:40:38.583308 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea034d-4a0b-4ffa-8ea3-6eb2c5421f22 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:38.584201 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea034d-4a0b-4ffa-8ea3-6eb2c5421f22 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:38.584638 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea034d-4a0b-4ffa-8ea3-6eb2c5421f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:38.661074 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-6bea034d-4a0b-4ffa-8ea3-6eb2c5421f22 None None] MFA Rules not processed for user `c6aa01ebd7314f30a1c729ff2b50c975`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:38.663033 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-6bea034d-4a0b-4ffa-8ea3-6eb2c5421f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:38.752929 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 696/1364] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jan 10 12:40:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:40:42.926051 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3c845-2b91-4a1d-8d7d-622efb66d78f None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:42.926625 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3c845-2b91-4a1d-8d7d-622efb66d78f None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:42.926625 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3c845-2b91-4a1d-8d7d-622efb66d78f None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:42.928462 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 669/1365] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jan 10 12:40:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:40:42.934124 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dffbe-9322-47b3-a148-8a1441fbffef None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:42.934974 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dffbe-9322-47b3-a148-8a1441fbffef None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:42.935377 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dffbe-9322-47b3-a148-8a1441fbffef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:42.956221 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-5f7dffbe-9322-47b3-a148-8a1441fbffef None None] MFA Rules not processed for user `c6aa01ebd7314f30a1c729ff2b50c975`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:42.957740 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-5f7dffbe-9322-47b3-a148-8a1441fbffef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:42.968233 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 697/1366] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jan 10 12:40:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:40:44.462369 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923a3b5-f027-430f-9890-12c4c6007794 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:44.462968 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923a3b5-f027-430f-9890-12c4c6007794 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:44.462968 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923a3b5-f027-430f-9890-12c4c6007794 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:44.464721 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 670/1367] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jan 10 12:40:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:40:44.469757 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3bea9-42a7-4b23-acfb-9ea3f988130b None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:44.470196 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3bea9-42a7-4b23-acfb-9ea3f988130b None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:44.470288 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3bea9-42a7-4b23-acfb-9ea3f988130b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:44.489197 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-c4f3bea9-42a7-4b23-acfb-9ea3f988130b None None] MFA Rules not processed for user `c6aa01ebd7314f30a1c729ff2b50c975`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:44.490381 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c4f3bea9-42a7-4b23-acfb-9ea3f988130b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:44.500885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 698/1368] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jan 10 12:40:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:40:48.467431 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00c613-de1b-465b-9716-4a0969f053fc None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:48.468023 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00c613-de1b-465b-9716-4a0969f053fc None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:48.468023 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00c613-de1b-465b-9716-4a0969f053fc None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:48.469972 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 671/1369] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:40:48.476242 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb6acf-999b-4e66-89a7-f9b5801f24aa None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:48.476661 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb6acf-999b-4e66-89a7-f9b5801f24aa None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:48.476761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb6acf-999b-4e66-89a7-f9b5801f24aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:48.495384 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-f0eb6acf-999b-4e66-89a7-f9b5801f24aa None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:48.496722 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f0eb6acf-999b-4e66-89a7-f9b5801f24aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:48.504979 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 699/1370] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:40:48.553894 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ffe75-4ada-4d8f-8507-19845f1b3593 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:48.554368 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ffe75-4ada-4d8f-8507-19845f1b3593 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:48.554733 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ffe75-4ada-4d8f-8507-19845f1b3593 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:48.556861 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 672/1371] 10.222.0.13 () {54 vars in 961 bytes} [Mon Jan 10 12:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:40:48.562519 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ec760-99fc-4def-af98-3d25e9f14cc4 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:48.562986 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ec760-99fc-4def-af98-3d25e9f14cc4 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:48.563260 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ec760-99fc-4def-af98-3d25e9f14cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:48.620190 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-4b6ec760-99fc-4def-af98-3d25e9f14cc4 None None] MFA Rules not processed for user `d68fa8e4f3a341a5b74ee32c85e59869`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:48.621388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-4b6ec760-99fc-4def-af98-3d25e9f14cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:48.723261 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 700/1372] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Jan 10 12:40:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:40:48.733164 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ffe75-4ada-4d8f-8507-19845f1b3593 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:40:48.751888 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ffe75-4ada-4d8f-8507-19845f1b3593 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:40:48.757662 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e41fa4-7a8b-42a2-90fa-d5c66fb125cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:40:48.758460 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e41fa4-7a8b-42a2-90fa-d5c66fb125cd service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:48.758775 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e41fa4-7a8b-42a2-90fa-d5c66fb125cd service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:48.759370 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e41fa4-7a8b-42a2-90fa-d5c66fb125cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:48.768406 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e41fa4-7a8b-42a2-90fa-d5c66fb125cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:40:48.770250 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e41fa4-7a8b-42a2-90fa-d5c66fb125cd service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:40:48.780092 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 673/1373] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:40:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:40:51.406905 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b27338-5080-489a-b3b5-0729408e62d1 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:51.407356 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b27338-5080-489a-b3b5-0729408e62d1 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:51.407356 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b27338-5080-489a-b3b5-0729408e62d1 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:51.409617 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 701/1374] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:40:51.414499 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ace54a-75fe-4699-8a63-e94fa489e1c8 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:51.415554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ace54a-75fe-4699-8a63-e94fa489e1c8 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:51.415554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ace54a-75fe-4699-8a63-e94fa489e1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:51.434886 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-59ace54a-75fe-4699-8a63-e94fa489e1c8 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:51.436266 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-59ace54a-75fe-4699-8a63-e94fa489e1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:51.446684 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 674/1375] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:40:51.493885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b27338-5080-489a-b3b5-0729408e62d1 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:40:51.510066 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b27338-5080-489a-b3b5-0729408e62d1 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:40:51.517024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8a6b8-c712-454e-be78-70ca616b09ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:40:51.517792 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8a6b8-c712-454e-be78-70ca616b09ac service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:51.518169 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8a6b8-c712-454e-be78-70ca616b09ac service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:51.518534 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8a6b8-c712-454e-be78-70ca616b09ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:51.528266 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8a6b8-c712-454e-be78-70ca616b09ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:40:51.529988 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8a6b8-c712-454e-be78-70ca616b09ac service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:40:51.539581 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 702/1376] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:40:54.342708 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565d65a-3e7b-4a3c-9acf-c0f34f57ce29 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:54.343263 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565d65a-3e7b-4a3c-9acf-c0f34f57ce29 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:54.343263 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565d65a-3e7b-4a3c-9acf-c0f34f57ce29 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:54.345050 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 675/1377] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:40:54.350483 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c034e63-de82-4f63-93b3-c6bbe05e8abe None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:54.350897 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c034e63-de82-4f63-93b3-c6bbe05e8abe None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:54.351005 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c034e63-de82-4f63-93b3-c6bbe05e8abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:54.369777 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-6c034e63-de82-4f63-93b3-c6bbe05e8abe None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:54.371333 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-6c034e63-de82-4f63-93b3-c6bbe05e8abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:54.380433 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 703/1378] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:40:54.427975 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913b99e-27be-4ce0-bd1e-f0828b78c254 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:54.428518 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913b99e-27be-4ce0-bd1e-f0828b78c254 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:54.428817 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913b99e-27be-4ce0-bd1e-f0828b78c254 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:54.430961 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 676/1379] 10.222.0.13 () {54 vars in 961 bytes} [Mon Jan 10 12:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:40:54.437096 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31460a-acf8-4181-8221-94c0589af989 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:54.437383 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31460a-acf8-4181-8221-94c0589af989 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:54.437717 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31460a-acf8-4181-8221-94c0589af989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:54.458923 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-9a31460a-acf8-4181-8221-94c0589af989 None None] MFA Rules not processed for user `d68fa8e4f3a341a5b74ee32c85e59869`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:54.460169 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-9a31460a-acf8-4181-8221-94c0589af989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:54.469567 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 704/1380] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Jan 10 12:40:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:40:54.477173 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913b99e-27be-4ce0-bd1e-f0828b78c254 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:40:54.491118 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913b99e-27be-4ce0-bd1e-f0828b78c254 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:40:54.496676 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bae322-9045-4cca-a259-5a08b5bd0484 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:40:54.497323 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bae322-9045-4cca-a259-5a08b5bd0484 service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:54.497600 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bae322-9045-4cca-a259-5a08b5bd0484 service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:54.497869 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bae322-9045-4cca-a259-5a08b5bd0484 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:54.506133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bae322-9045-4cca-a259-5a08b5bd0484 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:40:54.507738 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bae322-9045-4cca-a259-5a08b5bd0484 service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:40:54.517800 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 677/1381] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:40:56.532905 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a96562-3d22-480d-97c8-eb6b1a96a42a None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:56.533989 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a96562-3d22-480d-97c8-eb6b1a96a42a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:56.534478 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a96562-3d22-480d-97c8-eb6b1a96a42a None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:56.536683 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 705/1382] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:40:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:40:56.545100 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfe47a-d520-49de-880c-023931432de0 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:56.546104 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfe47a-d520-49de-880c-023931432de0 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:56.546608 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfe47a-d520-49de-880c-023931432de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:56.567782 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-f7cfe47a-d520-49de-880c-023931432de0 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:56.569386 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-f7cfe47a-d520-49de-880c-023931432de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:56.579047 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 678/1383] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:40:56.633697 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d21ecd-3388-4867-b25d-b99b2d31a3b5 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:56.634159 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d21ecd-3388-4867-b25d-b99b2d31a3b5 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:56.634548 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d21ecd-3388-4867-b25d-b99b2d31a3b5 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:56.636522 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 706/1384] 10.222.0.13 () {54 vars in 963 bytes} [Mon Jan 10 12:40:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:40:56.641575 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534eef8-6d3a-4d15-9426-f5086fccfa27 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:56.641848 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534eef8-6d3a-4d15-9426-f5086fccfa27 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:56.642115 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534eef8-6d3a-4d15-9426-f5086fccfa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:56.694935 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-3534eef8-6d3a-4d15-9426-f5086fccfa27 None None] MFA Rules not processed for user `dbaa0eb9e5b44a93a357473f8ec1a5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:56.696275 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-3534eef8-6d3a-4d15-9426-f5086fccfa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:56.763347 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 679/1385] 10.222.0.13 () {58 vars in 1060 bytes} [Mon Jan 10 12:40:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:40:56.773313 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d21ecd-3388-4867-b25d-b99b2d31a3b5 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:40:56.788126 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d21ecd-3388-4867-b25d-b99b2d31a3b5 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:40:56.791802 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041de600-a05f-48aa-bb53-657f28901a9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:40:56.792441 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041de600-a05f-48aa-bb53-657f28901a9e service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:56.792717 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041de600-a05f-48aa-bb53-657f28901a9e service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:56.792981 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041de600-a05f-48aa-bb53-657f28901a9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:56.802456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041de600-a05f-48aa-bb53-657f28901a9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:40:56.803979 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041de600-a05f-48aa-bb53-657f28901a9e service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:40:56.814585 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 707/1386] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:40:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:40:56.996792 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34f084-8cad-4e7d-bdf8-2b7ddd61adce None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:56.997417 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34f084-8cad-4e7d-bdf8-2b7ddd61adce None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:56.997909 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34f084-8cad-4e7d-bdf8-2b7ddd61adce None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:56.999726 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 680/1387] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:40:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:40:57.005197 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09d069-d0b0-426d-9477-73736feeb8ad None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:57.005492 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09d069-d0b0-426d-9477-73736feeb8ad None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:57.005769 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09d069-d0b0-426d-9477-73736feeb8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:57.024629 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-6a09d069-d0b0-426d-9477-73736feeb8ad None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:57.025897 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-6a09d069-d0b0-426d-9477-73736feeb8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:57.034013 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 708/1388] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:40:57.079223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34f084-8cad-4e7d-bdf8-2b7ddd61adce None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:40:57.094509 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34f084-8cad-4e7d-bdf8-2b7ddd61adce None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:40:57.099989 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd903f-b895-4a27-98e7-0b3c20d6903a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:40:57.100826 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd903f-b895-4a27-98e7-0b3c20d6903a service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:57.101100 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd903f-b895-4a27-98e7-0b3c20d6903a service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:57.101375 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd903f-b895-4a27-98e7-0b3c20d6903a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:57.109758 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd903f-b895-4a27-98e7-0b3c20d6903a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:40:57.111337 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd903f-b895-4a27-98e7-0b3c20d6903a service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:40:57.120912 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 681/1389] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:40:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:40:59.689585 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f477a7-6320-4d74-ab48-6d8652a284a7 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:59.690153 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f477a7-6320-4d74-ab48-6d8652a284a7 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:59.690153 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f477a7-6320-4d74-ab48-6d8652a284a7 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:59.691907 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 709/1390] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:40:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:40:59.697403 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75c960-6941-4908-9f2b-2a2b3cef7f29 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:59.697858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75c960-6941-4908-9f2b-2a2b3cef7f29 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:59.697953 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75c960-6941-4908-9f2b-2a2b3cef7f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:59.716233 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-df75c960-6941-4908-9f2b-2a2b3cef7f29 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:40:59.717418 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-df75c960-6941-4908-9f2b-2a2b3cef7f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:40:59.725778 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 682/1391] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:40:59.779994 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f477a7-6320-4d74-ab48-6d8652a284a7 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:40:59.794404 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f477a7-6320-4d74-ab48-6d8652a284a7 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:40:59.800117 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291ab4b-de40-4199-8f28-a70a31c4920f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:40:59.800757 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291ab4b-de40-4199-8f28-a70a31c4920f service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:40:59.801036 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291ab4b-de40-4199-8f28-a70a31c4920f service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:40:59.801304 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291ab4b-de40-4199-8f28-a70a31c4920f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:40:59.809720 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291ab4b-de40-4199-8f28-a70a31c4920f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:40:59.811302 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291ab4b-de40-4199-8f28-a70a31c4920f service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:40:59.821779 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 710/1392] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:02.347540 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a084b-60fb-4fbc-bb84-f85e919998ae None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:02.348712 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a084b-60fb-4fbc-bb84-f85e919998ae None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:02.349121 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a084b-60fb-4fbc-bb84-f85e919998ae None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:02.350941 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 683/1393] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:02.357154 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d795526-7bf6-4622-a06c-49c0c11099d5 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:02.357735 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d795526-7bf6-4622-a06c-49c0c11099d5 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:02.357735 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d795526-7bf6-4622-a06c-49c0c11099d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:02.377681 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-1d795526-7bf6-4622-a06c-49c0c11099d5 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:02.378888 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-1d795526-7bf6-4622-a06c-49c0c11099d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:02.391271 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 711/1394] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:41:02.439357 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a084b-60fb-4fbc-bb84-f85e919998ae None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:41:02.454296 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a084b-60fb-4fbc-bb84-f85e919998ae None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:41:02.460003 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767f2fc-6bdd-4936-83b6-a9b37bdf33a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:41:02.460751 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767f2fc-6bdd-4936-83b6-a9b37bdf33a3 service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:02.461247 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767f2fc-6bdd-4936-83b6-a9b37bdf33a3 service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:02.461702 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767f2fc-6bdd-4936-83b6-a9b37bdf33a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:02.470609 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767f2fc-6bdd-4936-83b6-a9b37bdf33a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:41:02.472363 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767f2fc-6bdd-4936-83b6-a9b37bdf33a3 service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:41:02.483897 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 684/1395] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:05.003489 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f636714-47f0-4a1a-80e0-e41ae3e49bd6 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:05.004110 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f636714-47f0-4a1a-80e0-e41ae3e49bd6 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:05.004110 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f636714-47f0-4a1a-80e0-e41ae3e49bd6 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:05.005835 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 712/1396] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:05.013326 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab3712-c8f8-4e38-af18-a3c9c3b3c9e5 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:05.013884 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab3712-c8f8-4e38-af18-a3c9c3b3c9e5 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:05.013884 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab3712-c8f8-4e38-af18-a3c9c3b3c9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:05.034651 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-9bab3712-c8f8-4e38-af18-a3c9c3b3c9e5 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:05.035971 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9bab3712-c8f8-4e38-af18-a3c9c3b3c9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:05.044600 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 685/1397] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:41:05.090753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f636714-47f0-4a1a-80e0-e41ae3e49bd6 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:41:05.105949 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f636714-47f0-4a1a-80e0-e41ae3e49bd6 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:41:05.111723 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910edb84-970e-48f5-917b-b55e814f7267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:41:05.112418 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910edb84-970e-48f5-917b-b55e814f7267 service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:05.112710 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910edb84-970e-48f5-917b-b55e814f7267 service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:05.112994 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910edb84-970e-48f5-917b-b55e814f7267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:05.122562 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910edb84-970e-48f5-917b-b55e814f7267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:41:05.124292 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910edb84-970e-48f5-917b-b55e814f7267 service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:41:05.135234 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 713/1398] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:07.628639 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64206fc6-8bbe-48c2-b720-6da3885c974d None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:07.629208 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64206fc6-8bbe-48c2-b720-6da3885c974d None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:07.629208 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64206fc6-8bbe-48c2-b720-6da3885c974d None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:07.631018 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 686/1399] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:07.637141 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e9afa-937f-41c4-add9-93037ee7ed9a None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:07.637689 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e9afa-937f-41c4-add9-93037ee7ed9a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:07.637788 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e9afa-937f-41c4-add9-93037ee7ed9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:07.660838 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-ad0e9afa-937f-41c4-add9-93037ee7ed9a None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:07.662135 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ad0e9afa-937f-41c4-add9-93037ee7ed9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:07.671064 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 714/1400] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:41:07.720015 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64206fc6-8bbe-48c2-b720-6da3885c974d None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:41:07.736136 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64206fc6-8bbe-48c2-b720-6da3885c974d None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:41:07.742902 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba3cd2-9859-4444-9415-1098c3c6edad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:41:07.743617 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba3cd2-9859-4444-9415-1098c3c6edad service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:07.744054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba3cd2-9859-4444-9415-1098c3c6edad service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:07.744054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba3cd2-9859-4444-9415-1098c3c6edad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:07.753184 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba3cd2-9859-4444-9415-1098c3c6edad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:41:07.754810 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba3cd2-9859-4444-9415-1098c3c6edad service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:41:07.764776 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 687/1401] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:41:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:10.273732 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3a102-7a3a-47c0-b80b-ebbf6b968b67 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:10.274466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3a102-7a3a-47c0-b80b-ebbf6b968b67 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:10.274466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3a102-7a3a-47c0-b80b-ebbf6b968b67 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:10.276159 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 715/1402] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:10.281525 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7e33c-de78-429d-8491-4c42ff0f1963 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:10.282003 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7e33c-de78-429d-8491-4c42ff0f1963 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:10.282092 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7e33c-de78-429d-8491-4c42ff0f1963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:10.300899 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-c9d7e33c-de78-429d-8491-4c42ff0f1963 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:10.302088 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-c9d7e33c-de78-429d-8491-4c42ff0f1963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:10.311158 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 688/1403] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:41:10.358423 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3a102-7a3a-47c0-b80b-ebbf6b968b67 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:41:10.372755 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3a102-7a3a-47c0-b80b-ebbf6b968b67 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:41:10.378278 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b4eab-4bb0-43e2-9793-f70ac70fc6d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:41:10.378915 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b4eab-4bb0-43e2-9793-f70ac70fc6d2 service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:10.379188 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b4eab-4bb0-43e2-9793-f70ac70fc6d2 service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:10.379457 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b4eab-4bb0-43e2-9793-f70ac70fc6d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:10.387923 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b4eab-4bb0-43e2-9793-f70ac70fc6d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:41:10.389501 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b4eab-4bb0-43e2-9793-f70ac70fc6d2 service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:41:10.398823 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 716/1404] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:11.997381 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c3de7-b728-4ef9-bae4-af76ccdc17ae None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:11.997956 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c3de7-b728-4ef9-bae4-af76ccdc17ae None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:11.997956 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c3de7-b728-4ef9-bae4-af76ccdc17ae None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:11.999866 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 689/1405] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:41:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:12.005196 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dab63-a719-4164-97a2-92e32e4bd919 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:12.005663 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dab63-a719-4164-97a2-92e32e4bd919 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:12.005761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662dab63-a719-4164-97a2-92e32e4bd919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:12.024074 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-662dab63-a719-4164-97a2-92e32e4bd919 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:12.025273 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-662dab63-a719-4164-97a2-92e32e4bd919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:12.033189 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 717/1406] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:41:12.090198 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f6079-b334-46c4-b3f7-92c55e3ddad0 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:12.090565 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f6079-b334-46c4-b3f7-92c55e3ddad0 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:12.090912 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f6079-b334-46c4-b3f7-92c55e3ddad0 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:12.092834 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 690/1407] 10.222.0.13 () {54 vars in 962 bytes} [Mon Jan 10 12:41:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:12.098036 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5b94b-933c-4971-9c31-3078eb18040a None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:12.098324 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5b94b-933c-4971-9c31-3078eb18040a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:12.098599 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5b94b-933c-4971-9c31-3078eb18040a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:12.147465 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-23a5b94b-933c-4971-9c31-3078eb18040a None None] MFA Rules not processed for user `f812f38c242d4530b3fc73013f66c9f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:12.148768 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-23a5b94b-933c-4971-9c31-3078eb18040a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:12.209165 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 718/1408] 10.222.0.13 () {58 vars in 1059 bytes} [Mon Jan 10 12:41:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:41:12.217447 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f6079-b334-46c4-b3f7-92c55e3ddad0 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:41:12.228945 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f6079-b334-46c4-b3f7-92c55e3ddad0 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:41:12.232826 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c63782-5675-43a4-a8f6-1733f3868834 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f812f38c242d4530b3fc73013f66c9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:41:12.233533 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c63782-5675-43a4-a8f6-1733f3868834 service glance] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:12.233903 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c63782-5675-43a4-a8f6-1733f3868834 service glance] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:12.234243 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c63782-5675-43a4-a8f6-1733f3868834 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:12.244081 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c63782-5675-43a4-a8f6-1733f3868834 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:41:12.245594 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c63782-5675-43a4-a8f6-1733f3868834 service glance] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:41:12.255803 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 691/1409] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:41:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:12.689303 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bc188-476f-41a2-8cb6-bb9c0a618399 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:12.689660 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bc188-476f-41a2-8cb6-bb9c0a618399 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:12.689992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bc188-476f-41a2-8cb6-bb9c0a618399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:12.743719 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-f57bc188-476f-41a2-8cb6-bb9c0a618399 None None] MFA Rules not processed for user `44e5602fd019411aa8f0e091ed533ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:12.744941 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f57bc188-476f-41a2-8cb6-bb9c0a618399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:12.811964 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 719/1410] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jan 10 12:41:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:41:12.827165 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607582b5-3a5c-4bc4-8b89-36867e7ea018 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:12.827451 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607582b5-3a5c-4bc4-8b89-36867e7ea018 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:12.827802 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607582b5-3a5c-4bc4-8b89-36867e7ea018 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:12.829646 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 692/1411] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:41:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:12.835354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8cd28-4600-47e1-afe6-87337fde40b8 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:12.835785 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8cd28-4600-47e1-afe6-87337fde40b8 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:12.836176 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8cd28-4600-47e1-afe6-87337fde40b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:12.854416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-f4c8cd28-4600-47e1-afe6-87337fde40b8 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:12.855637 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f4c8cd28-4600-47e1-afe6-87337fde40b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:12.856355 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adab407-9509-4874-a968-b2e1765198e3 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:12.856634 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adab407-9509-4874-a968-b2e1765198e3 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:12.856898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adab407-9509-4874-a968-b2e1765198e3 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:12.858719 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 693/1412] 10.222.0.13 () {54 vars in 942 bytes} [Mon Jan 10 12:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:12.863553 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 720/1413] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:41:12.867488 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825ddd4-9628-4933-a3ee-9d7d392a1950 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:12.867635 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825ddd4-9628-4933-a3ee-9d7d392a1950 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:12.867931 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825ddd4-9628-4933-a3ee-9d7d392a1950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:12.909546 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8cd28-4600-47e1-afe6-87337fde40b8 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:41:12.918105 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-0825ddd4-9628-4933-a3ee-9d7d392a1950 None None] MFA Rules not processed for user `1cd898c7c2974bb38998ebad22fd5a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:12.919319 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-0825ddd4-9628-4933-a3ee-9d7d392a1950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:12.923156 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8cd28-4600-47e1-afe6-87337fde40b8 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:41:12.929478 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e109da-c43a-49bf-9bc2-dd53abeb8104 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:41:12.930810 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e109da-c43a-49bf-9bc2-dd53abeb8104 service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:12.931086 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e109da-c43a-49bf-9bc2-dd53abeb8104 service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:12.931360 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e109da-c43a-49bf-9bc2-dd53abeb8104 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:12.940290 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e109da-c43a-49bf-9bc2-dd53abeb8104 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:41:12.941907 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e109da-c43a-49bf-9bc2-dd53abeb8104 service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:41:12.951357 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 721/1414] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:41:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:12.993356 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 694/1415] 10.222.0.13 () {58 vars in 1039 bytes} [Mon Jan 10 12:41:12 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:41:13.003010 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e109da-c43a-49bf-9bc2-dd53abeb8104 service nova] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:41:13.014807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e109da-c43a-49bf-9bc2-dd53abeb8104 service nova] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:41:13.025285 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3405f-0508-4e88-93f6-a94058e34abf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd898c7c2974bb38998ebad22fd5a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:41:13.025988 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3405f-0508-4e88-93f6-a94058e34abf service swift] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:13.026442 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3405f-0508-4e88-93f6-a94058e34abf service swift] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:13.026721 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3405f-0508-4e88-93f6-a94058e34abf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:13.036427 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3405f-0508-4e88-93f6-a94058e34abf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:41:13.038146 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3405f-0508-4e88-93f6-a94058e34abf service swift] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:41:13.047368 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 722/1416] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jan 10 12:41:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:41:15.404261 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286424ea-350d-4de7-9406-f1a475f8ade4 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:15.404850 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286424ea-350d-4de7-9406-f1a475f8ade4 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:15.404850 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286424ea-350d-4de7-9406-f1a475f8ade4 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:15.406587 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 695/1417] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:41:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:41:15.414731 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2400f7-7fcb-4e1e-a96f-f00d1375f8a3 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:15.414731 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2400f7-7fcb-4e1e-a96f-f00d1375f8a3 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:15.415390 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2400f7-7fcb-4e1e-a96f-f00d1375f8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:15.443955 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-de2400f7-7fcb-4e1e-a96f-f00d1375f8a3 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:15.446482 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-de2400f7-7fcb-4e1e-a96f-f00d1375f8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:15.459842 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 723/1418] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:41:15.519651 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286424ea-350d-4de7-9406-f1a475f8ade4 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:41:15.534580 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286424ea-350d-4de7-9406-f1a475f8ade4 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:41:15.542672 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d092e0-93c5-4f82-b8be-9734e71a5659 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:41:15.543406 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d092e0-93c5-4f82-b8be-9734e71a5659 service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:15.543819 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d092e0-93c5-4f82-b8be-9734e71a5659 service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:15.544096 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d092e0-93c5-4f82-b8be-9734e71a5659 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:15.552909 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d092e0-93c5-4f82-b8be-9734e71a5659 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:41:15.554505 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d092e0-93c5-4f82-b8be-9734e71a5659 service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:41:15.564629 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 696/1419] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:18.053392 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f846a-c321-44ce-938e-9a309cc12b0a None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:18.053930 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f846a-c321-44ce-938e-9a309cc12b0a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:18.053930 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f846a-c321-44ce-938e-9a309cc12b0a None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:18.055989 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 724/1420] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:41:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:18.061725 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc239f-487d-424f-87f6-cfbda650baa8 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:18.062174 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc239f-487d-424f-87f6-cfbda650baa8 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:18.062273 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc239f-487d-424f-87f6-cfbda650baa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:18.080259 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-d2dc239f-487d-424f-87f6-cfbda650baa8 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:18.081460 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-d2dc239f-487d-424f-87f6-cfbda650baa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:18.093932 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 697/1421] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:41:18.139946 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f846a-c321-44ce-938e-9a309cc12b0a None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:41:18.154662 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f846a-c321-44ce-938e-9a309cc12b0a None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:41:18.161684 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c44a1-108d-4ab8-81cf-34a5ef412104 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:41:18.162347 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c44a1-108d-4ab8-81cf-34a5ef412104 service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:18.162624 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c44a1-108d-4ab8-81cf-34a5ef412104 service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:18.162894 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c44a1-108d-4ab8-81cf-34a5ef412104 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:18.171798 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c44a1-108d-4ab8-81cf-34a5ef412104 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:41:18.173390 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c44a1-108d-4ab8-81cf-34a5ef412104 service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:41:18.182854 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 725/1422] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:41:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:36.184162 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1cbb0-ea2d-4437-995a-82e7cab81a73 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:36.185043 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1cbb0-ea2d-4437-995a-82e7cab81a73 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:36.185043 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1cbb0-ea2d-4437-995a-82e7cab81a73 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:36.188076 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 698/1423] 10.222.0.13 () {54 vars in 918 bytes} [Mon Jan 10 12:41:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:36.194352 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed63a1-3f93-409b-a2d1-81d6396a953e None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:36.195045 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed63a1-3f93-409b-a2d1-81d6396a953e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:36.195209 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed63a1-3f93-409b-a2d1-81d6396a953e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:36.216568 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-eeed63a1-3f93-409b-a2d1-81d6396a953e None None] MFA Rules not processed for user `c6aa01ebd7314f30a1c729ff2b50c975`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:36.217757 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-eeed63a1-3f93-409b-a2d1-81d6396a953e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:36.227315 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 726/1424] 10.222.0.13 () {58 vars in 1015 bytes} [Mon Jan 10 12:41:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:41:36.241767 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf581507-0999-44e4-b95a-9bd97a00131c None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:36.242049 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf581507-0999-44e4-b95a-9bd97a00131c None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:36.242367 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf581507-0999-44e4-b95a-9bd97a00131c None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:36.244215 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 699/1425] 10.222.0.13 () {54 vars in 918 bytes} [Mon Jan 10 12:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:36.249002 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b5839-efd7-4203-b1fd-db952c3d09db None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:36.249290 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b5839-efd7-4203-b1fd-db952c3d09db None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:36.249565 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b5839-efd7-4203-b1fd-db952c3d09db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:36.267862 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-1a6b5839-efd7-4203-b1fd-db952c3d09db None None] MFA Rules not processed for user `d68fa8e4f3a341a5b74ee32c85e59869`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:36.269047 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-1a6b5839-efd7-4203-b1fd-db952c3d09db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:36.279509 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 727/1426] 10.222.0.13 () {58 vars in 1015 bytes} [Mon Jan 10 12:41:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:41:39.132262 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd87034-566e-411f-bed7-384e15bfa4e6 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:39.132883 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd87034-566e-411f-bed7-384e15bfa4e6 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:39.132883 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd87034-566e-411f-bed7-384e15bfa4e6 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:39.135074 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 700/1427] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 12:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:39.142756 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc20f9-f92e-41f2-b1d7-acf52bcc58ba None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:39.143586 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc20f9-f92e-41f2-b1d7-acf52bcc58ba None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:39.143749 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc20f9-f92e-41f2-b1d7-acf52bcc58ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:39.166131 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-5ffc20f9-f92e-41f2-b1d7-acf52bcc58ba None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:39.167333 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-5ffc20f9-f92e-41f2-b1d7-acf52bcc58ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:39.177781 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 728/1428] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 12:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:41:39.222121 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd87034-566e-411f-bed7-384e15bfa4e6 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:41:39.238257 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd87034-566e-411f-bed7-384e15bfa4e6 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:41:39.244125 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a8b62-2937-43e0-b35c-8f793427b95f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:41:39.244751 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a8b62-2937-43e0-b35c-8f793427b95f service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:39.245029 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a8b62-2937-43e0-b35c-8f793427b95f service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:39.245296 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a8b62-2937-43e0-b35c-8f793427b95f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:39.253290 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a8b62-2937-43e0-b35c-8f793427b95f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:41:39.254877 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5a8b62-2937-43e0-b35c-8f793427b95f service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:41:39.264499 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 701/1429] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:41:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:40.896032 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b358331-186f-44fe-a55f-6eca7aa5907f None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:40.896782 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b358331-186f-44fe-a55f-6eca7aa5907f None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:40.896782 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b358331-186f-44fe-a55f-6eca7aa5907f None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:40.899932 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 729/1430] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 12:41:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:40.906021 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886236fc-cf8f-49ac-859a-5d9a30eaf84d None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:40.906469 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886236fc-cf8f-49ac-859a-5d9a30eaf84d None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:40.906591 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886236fc-cf8f-49ac-859a-5d9a30eaf84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:40.928235 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-886236fc-cf8f-49ac-859a-5d9a30eaf84d None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:40.929420 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-886236fc-cf8f-49ac-859a-5d9a30eaf84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:40.937979 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 702/1431] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 12:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:41:41.092579 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b358331-186f-44fe-a55f-6eca7aa5907f None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:41:41.111599 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b358331-186f-44fe-a55f-6eca7aa5907f None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:41:41.117548 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc55eb4-b5a9-4a2b-84ea-2e4dec1eb3c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:41:41.118182 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc55eb4-b5a9-4a2b-84ea-2e4dec1eb3c0 service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:41.118457 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc55eb4-b5a9-4a2b-84ea-2e4dec1eb3c0 service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:41.118723 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc55eb4-b5a9-4a2b-84ea-2e4dec1eb3c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:41.127966 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc55eb4-b5a9-4a2b-84ea-2e4dec1eb3c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:41:41.129554 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc55eb4-b5a9-4a2b-84ea-2e4dec1eb3c0 service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:41:41.142337 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 730/1432] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:41:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:42.729209 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c2a44-153b-4fc9-ace5-32449f310db8 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:42.730080 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c2a44-153b-4fc9-ace5-32449f310db8 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:42.730080 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c2a44-153b-4fc9-ace5-32449f310db8 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:42.733190 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 703/1433] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 12:41:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:42.740221 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516dd20-e2d0-4c7f-8fe4-44bf9645f5f6 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:42.740680 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516dd20-e2d0-4c7f-8fe4-44bf9645f5f6 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:42.740786 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516dd20-e2d0-4c7f-8fe4-44bf9645f5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:42.766697 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-f516dd20-e2d0-4c7f-8fe4-44bf9645f5f6 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:42.767918 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f516dd20-e2d0-4c7f-8fe4-44bf9645f5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:42.777299 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 731/1434] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 12:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:41:42.932700 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c2a44-153b-4fc9-ace5-32449f310db8 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:41:42.949182 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c2a44-153b-4fc9-ace5-32449f310db8 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:41:42.956528 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b1f86-a55e-4109-aec6-67381755097f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:41:42.957169 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b1f86-a55e-4109-aec6-67381755097f service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:42.957448 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b1f86-a55e-4109-aec6-67381755097f service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:42.957716 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b1f86-a55e-4109-aec6-67381755097f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:42.966739 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b1f86-a55e-4109-aec6-67381755097f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:41:42.968381 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b1f86-a55e-4109-aec6-67381755097f service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:41:42.978645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 704/1435] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:41:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:44.554069 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696f549-7805-4cbb-9bfa-a8554ee02dce None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:44.555027 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696f549-7805-4cbb-9bfa-a8554ee02dce None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:44.555181 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696f549-7805-4cbb-9bfa-a8554ee02dce None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:44.557160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 732/1436] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 12:41:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:44.563702 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeb491-982d-4430-a40b-7d537227784a None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:44.564158 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeb491-982d-4430-a40b-7d537227784a None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:44.564286 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeb491-982d-4430-a40b-7d537227784a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:44.591155 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-48aeb491-982d-4430-a40b-7d537227784a None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:44.592398 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-48aeb491-982d-4430-a40b-7d537227784a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:44.601808 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 705/1437] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 12:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:41:44.763747 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696f549-7805-4cbb-9bfa-a8554ee02dce None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:41:44.787357 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696f549-7805-4cbb-9bfa-a8554ee02dce None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:41:44.794635 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7b26f-f5d3-4365-92ff-95d898522234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:41:44.795276 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7b26f-f5d3-4365-92ff-95d898522234 service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:44.795539 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7b26f-f5d3-4365-92ff-95d898522234 service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:44.795923 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7b26f-f5d3-4365-92ff-95d898522234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:44.804315 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7b26f-f5d3-4365-92ff-95d898522234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:41:44.806079 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7b26f-f5d3-4365-92ff-95d898522234 service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:41:44.816041 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 733/1438] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:46.377106 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdc9fc-ba13-4bac-9434-cccbbf5f7077 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:46.377683 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdc9fc-ba13-4bac-9434-cccbbf5f7077 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:46.377683 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdc9fc-ba13-4bac-9434-cccbbf5f7077 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:46.379437 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 706/1439] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 12:41:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:46.385525 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c354f0-436f-4b71-9f46-5a2f364a6597 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:46.386235 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c354f0-436f-4b71-9f46-5a2f364a6597 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:46.386332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c354f0-436f-4b71-9f46-5a2f364a6597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:46.416032 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-07c354f0-436f-4b71-9f46-5a2f364a6597 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:46.417230 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-07c354f0-436f-4b71-9f46-5a2f364a6597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:46.426753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 734/1440] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 12:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:41:46.584886 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdc9fc-ba13-4bac-9434-cccbbf5f7077 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:41:46.602757 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdc9fc-ba13-4bac-9434-cccbbf5f7077 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:41:46.609738 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591291bf-f5bf-44c6-89fe-009f8883f883 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:41:46.610373 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591291bf-f5bf-44c6-89fe-009f8883f883 service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:46.610634 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591291bf-f5bf-44c6-89fe-009f8883f883 service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:46.610902 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591291bf-f5bf-44c6-89fe-009f8883f883 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:46.620228 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591291bf-f5bf-44c6-89fe-009f8883f883 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:41:46.621862 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591291bf-f5bf-44c6-89fe-009f8883f883 service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:41:46.631546 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 707/1441] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:48.184255 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5204c-a26d-4ac2-8700-160aa5df51a6 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:48.184857 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5204c-a26d-4ac2-8700-160aa5df51a6 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:48.184857 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5204c-a26d-4ac2-8700-160aa5df51a6 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:48.186959 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 735/1442] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 12:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:48.192344 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a2690-8d23-4398-8149-06a61a0293ab None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:48.192781 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a2690-8d23-4398-8149-06a61a0293ab None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:48.192892 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a2690-8d23-4398-8149-06a61a0293ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:48.212691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-501a2690-8d23-4398-8149-06a61a0293ab None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:48.213913 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-501a2690-8d23-4398-8149-06a61a0293ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:48.222968 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 708/1443] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 12:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:41:48.390796 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5204c-a26d-4ac2-8700-160aa5df51a6 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:41:48.410340 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5204c-a26d-4ac2-8700-160aa5df51a6 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:41:48.417274 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b93b8-37f5-4510-b0c9-1009904e1556 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:41:48.417913 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b93b8-37f5-4510-b0c9-1009904e1556 service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:48.418190 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b93b8-37f5-4510-b0c9-1009904e1556 service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:48.418459 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b93b8-37f5-4510-b0c9-1009904e1556 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:48.426665 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b93b8-37f5-4510-b0c9-1009904e1556 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:41:48.428296 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b93b8-37f5-4510-b0c9-1009904e1556 service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:41:48.438352 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 736/1444] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:41:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:49.958040 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb02d9c-6ad1-4efd-8b86-0ec8fc8fe8fb None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:49.958669 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb02d9c-6ad1-4efd-8b86-0ec8fc8fe8fb None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:49.958669 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb02d9c-6ad1-4efd-8b86-0ec8fc8fe8fb None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:49.960421 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 709/1445] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 12:41:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:49.965914 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2eedbd-3cfd-42b5-bc91-40a14365c2d3 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:49.966367 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2eedbd-3cfd-42b5-bc91-40a14365c2d3 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:49.966471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2eedbd-3cfd-42b5-bc91-40a14365c2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:49.986276 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-ce2eedbd-3cfd-42b5-bc91-40a14365c2d3 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:49.987398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ce2eedbd-3cfd-42b5-bc91-40a14365c2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:49.996137 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 737/1446] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 12:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:41:50.146330 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb02d9c-6ad1-4efd-8b86-0ec8fc8fe8fb None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:41:50.169286 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb02d9c-6ad1-4efd-8b86-0ec8fc8fe8fb None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:41:50.174745 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785dabf8-68fb-4a65-9114-f22f6485bd0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:41:50.175384 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785dabf8-68fb-4a65-9114-f22f6485bd0f service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:50.175706 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785dabf8-68fb-4a65-9114-f22f6485bd0f service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:50.175978 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785dabf8-68fb-4a65-9114-f22f6485bd0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:50.184686 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785dabf8-68fb-4a65-9114-f22f6485bd0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:41:50.186270 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785dabf8-68fb-4a65-9114-f22f6485bd0f service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:41:50.196537 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 710/1447] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:51.724743 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e211cc-f68e-46ac-b094-f168061a4834 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:51.725341 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e211cc-f68e-46ac-b094-f168061a4834 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:51.725341 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e211cc-f68e-46ac-b094-f168061a4834 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:51.727753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 738/1448] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 12:41:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:51.735416 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef32a6-64d3-48d0-92eb-647fac0ae312 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:51.735886 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef32a6-64d3-48d0-92eb-647fac0ae312 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:51.736446 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef32a6-64d3-48d0-92eb-647fac0ae312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:51.756234 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-aaef32a6-64d3-48d0-92eb-647fac0ae312 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:51.757426 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-aaef32a6-64d3-48d0-92eb-647fac0ae312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:51.767113 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 711/1449] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 12:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:41:51.925837 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e211cc-f68e-46ac-b094-f168061a4834 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:41:51.943413 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e211cc-f68e-46ac-b094-f168061a4834 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:41:51.954400 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fea6e-04e3-406d-8d33-65a878337e04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:41:51.955345 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fea6e-04e3-406d-8d33-65a878337e04 service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:51.955826 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fea6e-04e3-406d-8d33-65a878337e04 service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:51.956250 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fea6e-04e3-406d-8d33-65a878337e04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:51.966960 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fea6e-04e3-406d-8d33-65a878337e04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:41:51.968680 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fea6e-04e3-406d-8d33-65a878337e04 service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:41:51.978662 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 739/1450] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:53.492590 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f3bf8-5fff-45f1-a766-661c04fc9072 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:53.493249 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f3bf8-5fff-45f1-a766-661c04fc9072 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:53.493249 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f3bf8-5fff-45f1-a766-661c04fc9072 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:53.494952 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 712/1451] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 12:41:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:53.501249 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc195589-cd7a-4da2-970f-719a5df8f0c0 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:53.501698 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc195589-cd7a-4da2-970f-719a5df8f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:53.501843 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc195589-cd7a-4da2-970f-719a5df8f0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:53.529025 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-dc195589-cd7a-4da2-970f-719a5df8f0c0 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:53.530231 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-dc195589-cd7a-4da2-970f-719a5df8f0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:53.538768 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 740/1452] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 12:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:41:53.696107 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f3bf8-5fff-45f1-a766-661c04fc9072 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:41:53.714046 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f3bf8-5fff-45f1-a766-661c04fc9072 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:41:53.722557 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcce60e-7be0-434c-a41c-837e5a5c342d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:41:53.723577 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcce60e-7be0-434c-a41c-837e5a5c342d service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:53.723993 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcce60e-7be0-434c-a41c-837e5a5c342d service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:53.724396 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcce60e-7be0-434c-a41c-837e5a5c342d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:53.734173 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcce60e-7be0-434c-a41c-837e5a5c342d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:41:53.735854 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcce60e-7be0-434c-a41c-837e5a5c342d service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:41:53.745974 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 713/1453] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:41:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:56.058263 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259d332-07d5-4d5f-9af0-0e4b2b959a7e None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:56.059131 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259d332-07d5-4d5f-9af0-0e4b2b959a7e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:56.059131 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259d332-07d5-4d5f-9af0-0e4b2b959a7e None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:56.062287 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 741/1454] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 12:41:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:56.070364 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfa48d-b454-481a-9a19-c3bfb1d08431 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:56.071303 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfa48d-b454-481a-9a19-c3bfb1d08431 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:56.071615 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfa48d-b454-481a-9a19-c3bfb1d08431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:56.090384 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-b0bfa48d-b454-481a-9a19-c3bfb1d08431 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:56.091600 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-b0bfa48d-b454-481a-9a19-c3bfb1d08431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:56.100352 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 714/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 12:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:41:56.142658 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259d332-07d5-4d5f-9af0-0e4b2b959a7e None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:41:56.162331 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259d332-07d5-4d5f-9af0-0e4b2b959a7e None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:41:56.167754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8aff7-d423-450a-8242-c78483ae022f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:41:56.168394 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8aff7-d423-450a-8242-c78483ae022f service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:56.168669 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8aff7-d423-450a-8242-c78483ae022f service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:56.168919 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8aff7-d423-450a-8242-c78483ae022f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:56.178654 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8aff7-d423-450a-8242-c78483ae022f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:41:56.180354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8aff7-d423-450a-8242-c78483ae022f service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:41:56.192775 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 742/1456] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:41:58.766225 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20229a-b650-4b2c-973d-92fef3c68820 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:58.766779 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20229a-b650-4b2c-973d-92fef3c68820 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:58.766779 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20229a-b650-4b2c-973d-92fef3c68820 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:58.768600 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 715/1457] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 12:41:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:41:58.774856 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbf4dc-8933-4d93-99e4-1b8abb463ff8 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:58.775561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbf4dc-8933-4d93-99e4-1b8abb463ff8 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:58.775744 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbf4dc-8933-4d93-99e4-1b8abb463ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:58.804827 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-77bbf4dc-8933-4d93-99e4-1b8abb463ff8 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:41:58.806017 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-77bbf4dc-8933-4d93-99e4-1b8abb463ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:41:58.815083 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 743/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 12:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:41:58.855277 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20229a-b650-4b2c-973d-92fef3c68820 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:41:58.868076 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20229a-b650-4b2c-973d-92fef3c68820 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:41:58.872466 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7aaae-f7c4-4113-8ee7-eaea4501725d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:41:58.873099 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7aaae-f7c4-4113-8ee7-eaea4501725d service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:41:58.873375 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7aaae-f7c4-4113-8ee7-eaea4501725d service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:41:58.873641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7aaae-f7c4-4113-8ee7-eaea4501725d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:41:58.882634 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7aaae-f7c4-4113-8ee7-eaea4501725d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:41:58.884133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7aaae-f7c4-4113-8ee7-eaea4501725d service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:41:58.893246 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 716/1459] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:42:01.758979 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae88525-95e4-48e9-b6a2-2b3864e67b9c None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:01.759557 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae88525-95e4-48e9-b6a2-2b3864e67b9c None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:01.759557 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae88525-95e4-48e9-b6a2-2b3864e67b9c None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:01.761408 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 744/1460] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 12:42:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:42:01.769252 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdbb1d-ca5f-4b39-867e-abe392144b26 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:01.769830 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdbb1d-ca5f-4b39-867e-abe392144b26 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:01.769830 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdbb1d-ca5f-4b39-867e-abe392144b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:01.790104 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-e9fdbb1d-ca5f-4b39-867e-abe392144b26 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:42:01.791303 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e9fdbb1d-ca5f-4b39-867e-abe392144b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:42:01.800310 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 717/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 12:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:42:01.840604 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae88525-95e4-48e9-b6a2-2b3864e67b9c None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:42:01.854254 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae88525-95e4-48e9-b6a2-2b3864e67b9c None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:42:01.859118 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b28237-cf50-43c6-8ed2-17b6503c5a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:42:01.859788 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b28237-cf50-43c6-8ed2-17b6503c5a20 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:01.860064 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b28237-cf50-43c6-8ed2-17b6503c5a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:01.860330 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b28237-cf50-43c6-8ed2-17b6503c5a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:01.870468 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b28237-cf50-43c6-8ed2-17b6503c5a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:42:01.871960 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b28237-cf50-43c6-8ed2-17b6503c5a20 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:42:01.881177 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 745/1462] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:42:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:42:04.398078 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affd1f3-47f8-4c4c-ad79-e05c6436c31a None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:04.399784 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affd1f3-47f8-4c4c-ad79-e05c6436c31a None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:04.399784 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affd1f3-47f8-4c4c-ad79-e05c6436c31a None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:04.402070 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 718/1463] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 12:42:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:42:04.413271 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861facc2-017d-4e48-af94-85811274de4b None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:04.413745 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861facc2-017d-4e48-af94-85811274de4b None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:04.413919 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861facc2-017d-4e48-af94-85811274de4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:04.433393 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-861facc2-017d-4e48-af94-85811274de4b None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:42:04.434574 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-861facc2-017d-4e48-af94-85811274de4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:42:04.444364 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 746/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 12:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:42:04.487783 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affd1f3-47f8-4c4c-ad79-e05c6436c31a None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:42:04.506046 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affd1f3-47f8-4c4c-ad79-e05c6436c31a None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:42:04.510945 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5bffb-8c3e-4673-80f0-3c58197946a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:42:04.511603 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5bffb-8c3e-4673-80f0-3c58197946a0 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:04.511876 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5bffb-8c3e-4673-80f0-3c58197946a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:04.512139 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5bffb-8c3e-4673-80f0-3c58197946a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:04.521104 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5bffb-8c3e-4673-80f0-3c58197946a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:42:04.522536 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5bffb-8c3e-4673-80f0-3c58197946a0 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:42:04.532005 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 719/1465] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:42:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:42:07.071979 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9591ffa-bf79-4cb6-878b-090f5b127bd0 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:07.072829 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9591ffa-bf79-4cb6-878b-090f5b127bd0 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:07.072829 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9591ffa-bf79-4cb6-878b-090f5b127bd0 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:07.075575 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 747/1466] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 12:42:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:42:07.082420 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8bff4-99ca-4321-8f45-1ef37e3aa6b2 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:07.082881 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8bff4-99ca-4321-8f45-1ef37e3aa6b2 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:07.082987 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8bff4-99ca-4321-8f45-1ef37e3aa6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:07.103132 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-5ee8bff4-99ca-4321-8f45-1ef37e3aa6b2 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:42:07.104375 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5ee8bff4-99ca-4321-8f45-1ef37e3aa6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:42:07.115818 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 720/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 12:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:42:07.158028 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9591ffa-bf79-4cb6-878b-090f5b127bd0 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:42:07.173158 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9591ffa-bf79-4cb6-878b-090f5b127bd0 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:42:07.177600 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d443b-6e8d-4553-aded-8f40122c697b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:42:07.178230 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d443b-6e8d-4553-aded-8f40122c697b service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:07.178506 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d443b-6e8d-4553-aded-8f40122c697b service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:07.178775 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d443b-6e8d-4553-aded-8f40122c697b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:07.188773 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d443b-6e8d-4553-aded-8f40122c697b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:42:07.190204 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d443b-6e8d-4553-aded-8f40122c697b service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:42:07.199557 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 748/1468] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:42:09.673665 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b5bec-9d99-4c37-bf1b-16d989b8b1ed None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:09.674507 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b5bec-9d99-4c37-bf1b-16d989b8b1ed None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:09.674650 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b5bec-9d99-4c37-bf1b-16d989b8b1ed None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:09.677526 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 721/1469] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 12:42:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:42:09.684385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85848d68-1125-4ecc-9185-c5c40553e111 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:09.684825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85848d68-1125-4ecc-9185-c5c40553e111 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:09.684918 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85848d68-1125-4ecc-9185-c5c40553e111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:09.704630 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-85848d68-1125-4ecc-9185-c5c40553e111 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:42:09.705818 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-85848d68-1125-4ecc-9185-c5c40553e111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:42:09.714344 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 749/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 12:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:42:09.755930 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b5bec-9d99-4c37-bf1b-16d989b8b1ed None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:42:09.768566 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b5bec-9d99-4c37-bf1b-16d989b8b1ed None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:42:09.772558 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c9dd7-f738-4b94-891c-e53a7089ea21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:42:09.773218 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c9dd7-f738-4b94-891c-e53a7089ea21 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:09.773841 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c9dd7-f738-4b94-891c-e53a7089ea21 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:09.773841 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c9dd7-f738-4b94-891c-e53a7089ea21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:09.783683 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c9dd7-f738-4b94-891c-e53a7089ea21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:42:09.785117 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c9dd7-f738-4b94-891c-e53a7089ea21 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:42:09.794661 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 722/1471] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:42:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:42:12.234932 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807eeed7-4ec5-4773-9244-3b80234ba96a None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:12.235899 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807eeed7-4ec5-4773-9244-3b80234ba96a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:12.235899 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807eeed7-4ec5-4773-9244-3b80234ba96a None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:12.238705 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 750/1472] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 12:42:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:42:12.247466 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb07ed-9ecd-43b8-9cd5-bfa2120158c4 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:12.247956 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb07ed-9ecd-43b8-9cd5-bfa2120158c4 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:12.248052 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb07ed-9ecd-43b8-9cd5-bfa2120158c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:12.268972 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-42fb07ed-9ecd-43b8-9cd5-bfa2120158c4 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:42:12.270168 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-42fb07ed-9ecd-43b8-9cd5-bfa2120158c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:42:12.279428 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 723/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 12:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:42:12.325053 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807eeed7-4ec5-4773-9244-3b80234ba96a None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:42:12.337289 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807eeed7-4ec5-4773-9244-3b80234ba96a None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:42:12.341487 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78fe0f9-912f-4b5a-9f57-db3c45d33810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:42:12.342118 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fe0f9-912f-4b5a-9f57-db3c45d33810 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:12.342423 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fe0f9-912f-4b5a-9f57-db3c45d33810 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:12.342676 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fe0f9-912f-4b5a-9f57-db3c45d33810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:12.352596 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78fe0f9-912f-4b5a-9f57-db3c45d33810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:42:12.354028 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78fe0f9-912f-4b5a-9f57-db3c45d33810 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:42:12.363552 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 751/1474] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:42:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:42:14.780339 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cffd1-41cf-4e5f-a24b-dd159986ffcb None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:14.780901 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cffd1-41cf-4e5f-a24b-dd159986ffcb None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:14.780901 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cffd1-41cf-4e5f-a24b-dd159986ffcb None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:14.782664 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 724/1475] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 12:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:42:14.789826 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552aaa7-4e30-4422-808e-9aa2787309c0 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:14.790295 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552aaa7-4e30-4422-808e-9aa2787309c0 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:14.790392 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552aaa7-4e30-4422-808e-9aa2787309c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:14.812095 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-2552aaa7-4e30-4422-808e-9aa2787309c0 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:42:14.813514 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-2552aaa7-4e30-4422-808e-9aa2787309c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:42:14.824406 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 752/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 12:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:42:14.862869 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cffd1-41cf-4e5f-a24b-dd159986ffcb None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:42:14.874567 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cffd1-41cf-4e5f-a24b-dd159986ffcb None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:42:14.878311 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812b342-b067-459e-a4e0-5d3139b75c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:42:14.878968 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b342-b067-459e-a4e0-5d3139b75c1d service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:14.879246 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b342-b067-459e-a4e0-5d3139b75c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:14.879530 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b342-b067-459e-a4e0-5d3139b75c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:14.888765 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812b342-b067-459e-a4e0-5d3139b75c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:42:14.890196 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812b342-b067-459e-a4e0-5d3139b75c1d service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:42:14.899332 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 725/1477] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:42:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:42:17.313227 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c958-fdea-4593-a2ed-e5760aadf514 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:17.313918 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c958-fdea-4593-a2ed-e5760aadf514 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:17.313918 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c958-fdea-4593-a2ed-e5760aadf514 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:17.315580 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 753/1478] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 12:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:42:17.326090 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983e50c-7e90-4740-8489-867b86699ee0 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:17.326553 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983e50c-7e90-4740-8489-867b86699ee0 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:17.326663 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983e50c-7e90-4740-8489-867b86699ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:17.349424 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-5983e50c-7e90-4740-8489-867b86699ee0 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:42:17.350608 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5983e50c-7e90-4740-8489-867b86699ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:42:17.360998 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 726/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 12:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:42:17.399957 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c958-fdea-4593-a2ed-e5760aadf514 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:42:17.412437 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c958-fdea-4593-a2ed-e5760aadf514 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:42:17.416730 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76505b0d-9944-43b9-bb2f-b416102b319c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:42:17.417372 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76505b0d-9944-43b9-bb2f-b416102b319c service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:17.417648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76505b0d-9944-43b9-bb2f-b416102b319c service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:17.417919 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76505b0d-9944-43b9-bb2f-b416102b319c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:17.427353 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76505b0d-9944-43b9-bb2f-b416102b319c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:42:17.428830 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76505b0d-9944-43b9-bb2f-b416102b319c service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:42:17.438617 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 754/1480] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:42:19.882003 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b916cd-f3e4-47d9-bc8d-3d61d17ed844 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:19.882642 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b916cd-f3e4-47d9-bc8d-3d61d17ed844 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:19.882642 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b916cd-f3e4-47d9-bc8d-3d61d17ed844 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:19.885532 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 727/1481] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 12:42:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:42:19.892530 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01b53c-4a03-4b84-9548-d24af3c8593d None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:19.893069 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01b53c-4a03-4b84-9548-d24af3c8593d None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:19.893069 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01b53c-4a03-4b84-9548-d24af3c8593d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:19.911469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-bb01b53c-4a03-4b84-9548-d24af3c8593d None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:42:19.912685 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-bb01b53c-4a03-4b84-9548-d24af3c8593d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:42:19.921966 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 755/1482] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 12:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:42:19.961427 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b916cd-f3e4-47d9-bc8d-3d61d17ed844 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:42:19.973596 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b916cd-f3e4-47d9-bc8d-3d61d17ed844 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:42:19.977953 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb287a-5206-4b92-a562-5465f3e2f61c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:42:19.978618 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb287a-5206-4b92-a562-5465f3e2f61c service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:19.978882 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb287a-5206-4b92-a562-5465f3e2f61c service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:19.979162 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb287a-5206-4b92-a562-5465f3e2f61c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:19.988474 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb287a-5206-4b92-a562-5465f3e2f61c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:42:19.989846 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb287a-5206-4b92-a562-5465f3e2f61c service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:42:19.999258 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 728/1483] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:42:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:42:37.261962 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119f60c-a267-4589-8c3f-341c8ca6c97a None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:37.262540 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119f60c-a267-4589-8c3f-341c8ca6c97a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:37.262540 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119f60c-a267-4589-8c3f-341c8ca6c97a None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:37.264353 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 756/1484] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:42:37.269935 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f48016-6829-4390-a9eb-78b95b48d8b6 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:37.270358 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f48016-6829-4390-a9eb-78b95b48d8b6 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:37.270468 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f48016-6829-4390-a9eb-78b95b48d8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:37.290117 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-66f48016-6829-4390-a9eb-78b95b48d8b6 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:42:37.291297 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-66f48016-6829-4390-a9eb-78b95b48d8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:42:37.299745 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 729/1485] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:42:37.353631 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d390400-d14b-4ea1-baa4-b17242f19c15 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:37.353908 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d390400-d14b-4ea1-baa4-b17242f19c15 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:37.354177 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d390400-d14b-4ea1-baa4-b17242f19c15 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:37.355994 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 757/1486] 10.222.0.13 () {54 vars in 962 bytes} [Mon Jan 10 12:42:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:42:37.361164 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46ca47-183c-4665-ad5a-1e7337425a75 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:37.361444 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46ca47-183c-4665-ad5a-1e7337425a75 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:37.361708 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46ca47-183c-4665-ad5a-1e7337425a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:37.381317 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-9e46ca47-183c-4665-ad5a-1e7337425a75 None None] MFA Rules not processed for user `f812f38c242d4530b3fc73013f66c9f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:42:37.382505 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9e46ca47-183c-4665-ad5a-1e7337425a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:42:37.390439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 730/1487] 10.222.0.13 () {58 vars in 1059 bytes} [Mon Jan 10 12:42:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:42:37.397665 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d390400-d14b-4ea1-baa4-b17242f19c15 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:42:37.409981 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d390400-d14b-4ea1-baa4-b17242f19c15 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:42:37.414217 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e115563-fdc9-4612-82f3-0db90fb4c842 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f812f38c242d4530b3fc73013f66c9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:42:37.415394 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115563-fdc9-4612-82f3-0db90fb4c842 service glance] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:37.415706 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115563-fdc9-4612-82f3-0db90fb4c842 service glance] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:37.415946 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e115563-fdc9-4612-82f3-0db90fb4c842 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:37.424951 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e115563-fdc9-4612-82f3-0db90fb4c842 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:42:37.426383 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e115563-fdc9-4612-82f3-0db90fb4c842 service glance] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:42:37.435933 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 758/1488] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:42:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:42:39.942557 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bbeb2-6ab7-44ad-8575-0bd57cda8877 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:39.943100 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bbeb2-6ab7-44ad-8575-0bd57cda8877 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:39.943100 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4bbeb2-6ab7-44ad-8575-0bd57cda8877 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:39.944969 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 731/1489] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:42:39.951847 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc0224-b4f8-4042-8c9f-cec003e025a6 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:39.952302 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc0224-b4f8-4042-8c9f-cec003e025a6 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:39.952417 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc0224-b4f8-4042-8c9f-cec003e025a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:39.970147 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-30cc0224-b4f8-4042-8c9f-cec003e025a6 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:42:39.971345 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-30cc0224-b4f8-4042-8c9f-cec003e025a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:42:39.979879 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 759/1490] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:42:40.008865 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bbeb2-6ab7-44ad-8575-0bd57cda8877 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:42:40.024083 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4bbeb2-6ab7-44ad-8575-0bd57cda8877 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:42:40.031480 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfa2f5-97b5-4e29-9fc3-84930938f896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:42:40.032485 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfa2f5-97b5-4e29-9fc3-84930938f896 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:40.032845 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfa2f5-97b5-4e29-9fc3-84930938f896 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:40.033209 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfa2f5-97b5-4e29-9fc3-84930938f896 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:40.034278 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfa2f5-97b5-4e29-9fc3-84930938f896 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:42:40.037171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfa2f5-97b5-4e29-9fc3-84930938f896 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:42:40.057565 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 732/1491] 10.222.0.13 () {56 vars in 1108 bytes} [Mon Jan 10 12:42:40 2022] GET /identity/v3/projects => generated 2553 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:42:42.501425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280e3fb-4439-43f6-81b5-652b6aeac15d None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:42.502370 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280e3fb-4439-43f6-81b5-652b6aeac15d None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:42.502370 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280e3fb-4439-43f6-81b5-652b6aeac15d None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:42.505303 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 760/1492] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:42:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:42:42.512164 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078de31a-9685-4356-a06a-78337d2d71fb None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:42.512599 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078de31a-9685-4356-a06a-78337d2d71fb None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:42.512709 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078de31a-9685-4356-a06a-78337d2d71fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:42.532045 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-078de31a-9685-4356-a06a-78337d2d71fb None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:42:42.533240 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-078de31a-9685-4356-a06a-78337d2d71fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:42:42.544960 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 733/1493] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:42:42.601810 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280e3fb-4439-43f6-81b5-652b6aeac15d None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:42:42.619268 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280e3fb-4439-43f6-81b5-652b6aeac15d None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:42:42.625469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec99942-914d-4b06-b167-513981988d9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:42:42.626106 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec99942-914d-4b06-b167-513981988d9e service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:42.626382 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec99942-914d-4b06-b167-513981988d9e service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:42.626655 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec99942-914d-4b06-b167-513981988d9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:42.635553 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec99942-914d-4b06-b167-513981988d9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:42:42.637180 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec99942-914d-4b06-b167-513981988d9e service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:42:42.646841 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 761/1494] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:42:45.255178 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aff27-dd1b-4176-b47e-97ab9acefc20 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:45.255816 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aff27-dd1b-4176-b47e-97ab9acefc20 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:45.255816 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846aff27-dd1b-4176-b47e-97ab9acefc20 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:45.257538 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 734/1495] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:42:45.264698 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187603de-c493-4838-899e-9d4acdf96504 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:45.265487 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187603de-c493-4838-899e-9d4acdf96504 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:45.265639 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187603de-c493-4838-899e-9d4acdf96504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:45.287994 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-187603de-c493-4838-899e-9d4acdf96504 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:42:45.289204 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-187603de-c493-4838-899e-9d4acdf96504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:42:45.299191 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 762/1496] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:42:45.340133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846aff27-dd1b-4176-b47e-97ab9acefc20 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:42:45.353063 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846aff27-dd1b-4176-b47e-97ab9acefc20 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:42:45.357038 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34b1d5-2fae-4e70-ad4f-c3ae23df0234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:42:45.357670 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34b1d5-2fae-4e70-ad4f-c3ae23df0234 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:45.357946 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34b1d5-2fae-4e70-ad4f-c3ae23df0234 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:45.358230 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34b1d5-2fae-4e70-ad4f-c3ae23df0234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:45.367839 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34b1d5-2fae-4e70-ad4f-c3ae23df0234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:42:45.369352 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34b1d5-2fae-4e70-ad4f-c3ae23df0234 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:42:45.378630 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 735/1497] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:42:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:42:47.882107 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84b41a-6651-400e-b496-50219eefe191 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:47.882700 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84b41a-6651-400e-b496-50219eefe191 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:47.882700 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84b41a-6651-400e-b496-50219eefe191 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:47.884679 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 763/1498] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:42:47.892925 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb967f-2def-4fab-8102-8138c7692264 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:47.893367 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb967f-2def-4fab-8102-8138c7692264 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:47.893452 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb967f-2def-4fab-8102-8138c7692264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:47.913305 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-4afb967f-2def-4fab-8102-8138c7692264 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:42:47.914469 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-4afb967f-2def-4fab-8102-8138c7692264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:42:47.924432 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 736/1499] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:42:47.965058 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84b41a-6651-400e-b496-50219eefe191 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:42:47.977987 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84b41a-6651-400e-b496-50219eefe191 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:42:47.981940 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b2175-e50a-43ed-bd3e-5b413f2478f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:42:47.982536 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b2175-e50a-43ed-bd3e-5b413f2478f9 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:47.982854 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b2175-e50a-43ed-bd3e-5b413f2478f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:47.983119 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b2175-e50a-43ed-bd3e-5b413f2478f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:47.993744 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b2175-e50a-43ed-bd3e-5b413f2478f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:42:47.995110 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b2175-e50a-43ed-bd3e-5b413f2478f9 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:42:48.004371 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 764/1500] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:42:50.492735 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067622f-8a93-4236-9c59-17d67b44bc63 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:50.493375 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067622f-8a93-4236-9c59-17d67b44bc63 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:50.493375 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067622f-8a93-4236-9c59-17d67b44bc63 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:50.495126 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 737/1501] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:42:50.500620 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946f403-3ffd-46ec-8fde-eb6f0a7340a8 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:50.501079 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946f403-3ffd-46ec-8fde-eb6f0a7340a8 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:50.501191 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946f403-3ffd-46ec-8fde-eb6f0a7340a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:50.520731 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-a946f403-3ffd-46ec-8fde-eb6f0a7340a8 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:42:50.521909 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-a946f403-3ffd-46ec-8fde-eb6f0a7340a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:42:50.530487 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 765/1502] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:42:50.568058 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067622f-8a93-4236-9c59-17d67b44bc63 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:42:50.589674 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067622f-8a93-4236-9c59-17d67b44bc63 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:42:50.595551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7caeb-29c4-4f40-b733-09c957949f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:42:50.596431 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7caeb-29c4-4f40-b733-09c957949f5c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:50.596743 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7caeb-29c4-4f40-b733-09c957949f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:50.597014 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7caeb-29c4-4f40-b733-09c957949f5c admin admin] PATH_INFO: `/v3/projects/230e0a61baae4ee798a1e664588228fe` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:50.598334 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7caeb-29c4-4f40-b733-09c957949f5c admin admin] RBAC: Authorizing `identity:get_project(project_id=230e0a61baae4ee798a1e664588228fe)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:42:50.600252 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7caeb-29c4-4f40-b733-09c957949f5c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:42:50.601930 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 738/1503] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:42:50 2022] GET /identity/v3/projects/230e0a61baae4ee798a1e664588228fe => generated 344 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:42:50.613928 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946f403-3ffd-46ec-8fde-eb6f0a7340a8 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:42:50.624064 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946f403-3ffd-46ec-8fde-eb6f0a7340a8 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:42:50.628573 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377e0c9-e401-4adc-9721-f70197e1095f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:42:50.629222 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377e0c9-e401-4adc-9721-f70197e1095f service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:50.629503 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377e0c9-e401-4adc-9721-f70197e1095f service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:50.629765 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377e0c9-e401-4adc-9721-f70197e1095f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:50.639302 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377e0c9-e401-4adc-9721-f70197e1095f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:42:50.640789 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377e0c9-e401-4adc-9721-f70197e1095f service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:42:50.650203 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 766/1504] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:42:53.310180 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adf4d6-9db5-4ce6-aaf1-84d364cafef5 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:53.311124 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adf4d6-9db5-4ce6-aaf1-84d364cafef5 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:53.311124 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adf4d6-9db5-4ce6-aaf1-84d364cafef5 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:53.314319 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 739/1505] 10.222.0.13 () {54 vars in 926 bytes} [Mon Jan 10 12:42:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:42:53.319898 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dea1b8-5d47-435a-a28e-7ee4117bfb21 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:53.320394 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dea1b8-5d47-435a-a28e-7ee4117bfb21 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:53.320394 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dea1b8-5d47-435a-a28e-7ee4117bfb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:53.340035 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-18dea1b8-5d47-435a-a28e-7ee4117bfb21 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:42:53.341211 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-18dea1b8-5d47-435a-a28e-7ee4117bfb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:42:53.349473 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 767/1506] 10.222.0.13 () {58 vars in 1023 bytes} [Mon Jan 10 12:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:42:53.386112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adf4d6-9db5-4ce6-aaf1-84d364cafef5 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:42:53.403699 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adf4d6-9db5-4ce6-aaf1-84d364cafef5 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:42:53.409263 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab52d1-3c2f-4a70-9e05-009cd66cb026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:42:53.410116 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab52d1-3c2f-4a70-9e05-009cd66cb026 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:53.410393 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab52d1-3c2f-4a70-9e05-009cd66cb026 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:53.410641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab52d1-3c2f-4a70-9e05-009cd66cb026 admin admin] PATH_INFO: `/v3/projects/230e0a61baae4ee798a1e664588228fe` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:53.411982 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab52d1-3c2f-4a70-9e05-009cd66cb026 admin admin] RBAC: Authorizing `identity:get_project(project_id=230e0a61baae4ee798a1e664588228fe)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:42:53.413776 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab52d1-3c2f-4a70-9e05-009cd66cb026 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:42:53.415627 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 740/1507] 10.222.0.13 () {56 vars in 1207 bytes} [Mon Jan 10 12:42:53 2022] GET /identity/v3/projects/230e0a61baae4ee798a1e664588228fe => generated 344 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:42:53.427430 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dea1b8-5d47-435a-a28e-7ee4117bfb21 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:42:53.437715 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dea1b8-5d47-435a-a28e-7ee4117bfb21 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:42:53.441442 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bb651-3f01-4fdf-bedd-f14037c165ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:42:53.442095 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb651-3f01-4fdf-bedd-f14037c165ad service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:42:53.442368 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb651-3f01-4fdf-bedd-f14037c165ad service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:42:53.442632 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb651-3f01-4fdf-bedd-f14037c165ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:42:53.452015 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bb651-3f01-4fdf-bedd-f14037c165ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:42:53.453454 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bb651-3f01-4fdf-bedd-f14037c165ad service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:42:53.462466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 768/1508] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:42:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:44:13.380274 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652239a-a456-4222-9745-d26b46a3877a None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:44:13.380898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652239a-a456-4222-9745-d26b46a3877a None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:44:13.380898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652239a-a456-4222-9745-d26b46a3877a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:44:13.403620 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-b652239a-a456-4222-9745-d26b46a3877a None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:44:13.404813 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-b652239a-a456-4222-9745-d26b46a3877a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:44:13.415067 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 741/1509] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:44:13.425247 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236edc7-196e-4a69-8b32-e31cc4268ad9 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:44:13.425796 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236edc7-196e-4a69-8b32-e31cc4268ad9 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:44:13.425796 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236edc7-196e-4a69-8b32-e31cc4268ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:44:13.453292 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-3236edc7-196e-4a69-8b32-e31cc4268ad9 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:44:13.455180 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-3236edc7-196e-4a69-8b32-e31cc4268ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:44:13.469498 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 769/1510] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:44:13.476971 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652239a-a456-4222-9745-d26b46a3877a None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:44:13.487071 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652239a-a456-4222-9745-d26b46a3877a None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:44:13.493641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0c589-4c30-4638-bb54-dc64a22e7de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:44:13.494299 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c589-4c30-4638-bb54-dc64a22e7de9 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:44:13.494579 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c589-4c30-4638-bb54-dc64a22e7de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:44:13.494839 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0c589-4c30-4638-bb54-dc64a22e7de9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:44:13.495583 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0c589-4c30-4638-bb54-dc64a22e7de9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:44:13.495908 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0c589-4c30-4638-bb54-dc64a22e7de9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:44:13.497512 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe0c589-4c30-4638-bb54-dc64a22e7de9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:44:13.510018 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 742/1511] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:44:13.518885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236edc7-196e-4a69-8b32-e31cc4268ad9 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:44:13.534275 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236edc7-196e-4a69-8b32-e31cc4268ad9 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:44:13.542009 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d149b8-71ca-4b8b-ad76-2e6c478c5f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:44:13.542660 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d149b8-71ca-4b8b-ad76-2e6c478c5f55 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:44:13.542934 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d149b8-71ca-4b8b-ad76-2e6c478c5f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:44:13.543198 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d149b8-71ca-4b8b-ad76-2e6c478c5f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:44:13.543950 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d149b8-71ca-4b8b-ad76-2e6c478c5f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:44:13.545875 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d149b8-71ca-4b8b-ad76-2e6c478c5f55 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:44:13.591075 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 770/1512] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:44:13 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:44:13.597020 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0c589-4c30-4638-bb54-dc64a22e7de9 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:44:13.607799 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe0c589-4c30-4638-bb54-dc64a22e7de9 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:44:13.665336 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04200b31-1dbf-4ac8-b6aa-4dfd4c4012af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:44:13.666015 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04200b31-1dbf-4ac8-b6aa-4dfd4c4012af admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:44:13.666294 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04200b31-1dbf-4ac8-b6aa-4dfd4c4012af admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:44:13.666565 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04200b31-1dbf-4ac8-b6aa-4dfd4c4012af admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:44:13.667274 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04200b31-1dbf-4ac8-b6aa-4dfd4c4012af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:44:13.669241 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04200b31-1dbf-4ac8-b6aa-4dfd4c4012af admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:44:13.693711 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 743/1513] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:44:13 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:44:13.698113 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d149b8-71ca-4b8b-ad76-2e6c478c5f55 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:44:13.709038 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d149b8-71ca-4b8b-ad76-2e6c478c5f55 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:44:13.714734 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e47a72-0fdb-483e-9bf8-b6edf019e218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:44:13.715418 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e47a72-0fdb-483e-9bf8-b6edf019e218 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:44:13.715727 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e47a72-0fdb-483e-9bf8-b6edf019e218 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:44:13.715997 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e47a72-0fdb-483e-9bf8-b6edf019e218 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:44:13.716746 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e47a72-0fdb-483e-9bf8-b6edf019e218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:44:13.718365 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e47a72-0fdb-483e-9bf8-b6edf019e218 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:44:13.732510 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 771/1514] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:44:13.736842 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04200b31-1dbf-4ac8-b6aa-4dfd4c4012af admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:44:13.747219 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04200b31-1dbf-4ac8-b6aa-4dfd4c4012af admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:44:13.752032 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b706b-8e03-4760-8a7b-169674178119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:44:13.752687 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b706b-8e03-4760-8a7b-169674178119 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:44:13.752967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b706b-8e03-4760-8a7b-169674178119 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:44:13.753235 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b706b-8e03-4760-8a7b-169674178119 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:44:13.753973 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b706b-8e03-4760-8a7b-169674178119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:44:13.755600 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b706b-8e03-4760-8a7b-169674178119 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:44:13.769248 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 744/1515] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:44:13.773675 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e47a72-0fdb-483e-9bf8-b6edf019e218 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:44:13.783499 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e47a72-0fdb-483e-9bf8-b6edf019e218 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:44:13.788116 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6671b-54dd-4ad4-9fcf-0e148c8b49e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:44:13.789038 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6671b-54dd-4ad4-9fcf-0e148c8b49e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:44:13.789310 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6671b-54dd-4ad4-9fcf-0e148c8b49e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:44:13.789578 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6671b-54dd-4ad4-9fcf-0e148c8b49e1 admin admin] PATH_INFO: `/v3/projects/555b5a9430484bb9aad26b0c02413caf/users/9cbd3477fb3c4cb18f07b5c5860de629/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:44:13.804444 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6671b-54dd-4ad4-9fcf-0e148c8b49e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=555b5a9430484bb9aad26b0c02413caf, user_id=9cbd3477fb3c4cb18f07b5c5860de629, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:44:13.807380 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6671b-54dd-4ad4-9fcf-0e148c8b49e1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:44:13.824374 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 772/1516] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:44:13 2022] PUT /identity/v3/projects/555b5a9430484bb9aad26b0c02413caf/users/9cbd3477fb3c4cb18f07b5c5860de629/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:44:13.835920 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56278c48-0ca6-43c0-8a10-5161410a9a34 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:44:13.836287 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56278c48-0ca6-43c0-8a10-5161410a9a34 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:44:13.836648 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56278c48-0ca6-43c0-8a10-5161410a9a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:44:13.862649 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-56278c48-0ca6-43c0-8a10-5161410a9a34 None None] MFA Rules not processed for user `9cbd3477fb3c4cb18f07b5c5860de629`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:44:13.863865 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-56278c48-0ca6-43c0-8a10-5161410a9a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:44:13.928447 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 745/1517] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:44:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:44:13.940353 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6671b-54dd-4ad4-9fcf-0e148c8b49e1 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:44:14.016622 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6671b-54dd-4ad4-9fcf-0e148c8b49e1 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:44:14.024624 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347ee05-8404-4873-91a8-f8ec7c9b9e41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:44:14.025397 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347ee05-8404-4873-91a8-f8ec7c9b9e41 service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:44:14.025733 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347ee05-8404-4873-91a8-f8ec7c9b9e41 service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:44:14.026010 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347ee05-8404-4873-91a8-f8ec7c9b9e41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:44:14.035221 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347ee05-8404-4873-91a8-f8ec7c9b9e41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:44:14.036865 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347ee05-8404-4873-91a8-f8ec7c9b9e41 service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:44:14.046798 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 773/1518] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:44:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:44:14.121493 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9af5ee-4b25-481c-b10e-c43c98c7b7dc None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:44:14.121772 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9af5ee-4b25-481c-b10e-c43c98c7b7dc None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:44:14.122044 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9af5ee-4b25-481c-b10e-c43c98c7b7dc None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:44:14.123806 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 746/1519] 10.222.0.13 () {52 vars in 829 bytes} [Mon Jan 10 12:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:44:14.127627 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347ee05-8404-4873-91a8-f8ec7c9b9e41 service nova] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:44:14.194284 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347ee05-8404-4873-91a8-f8ec7c9b9e41 service nova] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:44:14.199811 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746e558-1940-45c1-bcc1-bd5e91869363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:44:14.200672 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746e558-1940-45c1-bcc1-bd5e91869363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:44:14.200954 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746e558-1940-45c1-bcc1-bd5e91869363 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:44:14.201213 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746e558-1940-45c1-bcc1-bd5e91869363 admin admin] PATH_INFO: `/v3/users/9cbd3477fb3c4cb18f07b5c5860de629` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:44:14.202456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746e558-1940-45c1-bcc1-bd5e91869363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cbd3477fb3c4cb18f07b5c5860de629)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:44:14.203484 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING py.warnings [None req-f746e558-1940-45c1-bcc1-bd5e91869363 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:44:14.203484 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: warnings.warn(msg) Jan 10 12:44:14.203484 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: Jan 10 12:44:14.204717 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746e558-1940-45c1-bcc1-bd5e91869363 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:44:14.272808 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f746e558-1940-45c1-bcc1-bd5e91869363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cbd3477fb3c4cb18f07b5c5860de629'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:44:14.285825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f746e558-1940-45c1-bcc1-bd5e91869363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cbd3477fb3c4cb18f07b5c5860de629'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:44:14.297485 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f746e558-1940-45c1-bcc1-bd5e91869363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cbd3477fb3c4cb18f07b5c5860de629'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:44:14.298337 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f746e558-1940-45c1-bcc1-bd5e91869363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cbd3477fb3c4cb18f07b5c5860de629'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:44:14.299272 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f746e558-1940-45c1-bcc1-bd5e91869363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cbd3477fb3c4cb18f07b5c5860de629'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:44:14.326284 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 774/1520] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:44:14 2022] DELETE /identity/v3/users/9cbd3477fb3c4cb18f07b5c5860de629 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:44:14.330874 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73e239-684d-466f-bff6-7ab8ea820c03 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:44:14.331155 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73e239-684d-466f-bff6-7ab8ea820c03 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:44:14.331418 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73e239-684d-466f-bff6-7ab8ea820c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:44:14.350280 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-5b73e239-684d-466f-bff6-7ab8ea820c03 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:44:14.352051 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5b73e239-684d-466f-bff6-7ab8ea820c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:44:14.412921 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 747/1521] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:44:14.424868 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746e558-1940-45c1-bcc1-bd5e91869363 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:44:14.426349 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f746e558-1940-45c1-bcc1-bd5e91869363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:44:14.484939 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746e558-1940-45c1-bcc1-bd5e91869363 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:44:14.489041 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e205bd9-11e2-4911-9594-95d2597ee73c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:44:14.489688 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e205bd9-11e2-4911-9594-95d2597ee73c service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:44:14.489972 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e205bd9-11e2-4911-9594-95d2597ee73c service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:44:14.490248 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e205bd9-11e2-4911-9594-95d2597ee73c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:44:14.500078 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e205bd9-11e2-4911-9594-95d2597ee73c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:44:14.501529 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e205bd9-11e2-4911-9594-95d2597ee73c service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:44:14.511414 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 775/1522] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:44:14.875058 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73e239-684d-466f-bff6-7ab8ea820c03 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:44:14.876485 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5b73e239-684d-466f-bff6-7ab8ea820c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:44:14.889919 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73e239-684d-466f-bff6-7ab8ea820c03 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:44:14.896102 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4f3e0-0b76-4663-b3d7-d2214af30bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:44:14.896907 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4f3e0-0b76-4663-b3d7-d2214af30bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:44:14.897171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4f3e0-0b76-4663-b3d7-d2214af30bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:44:14.897441 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4f3e0-0b76-4663-b3d7-d2214af30bd7 admin admin] PATH_INFO: `/v3/projects/555b5a9430484bb9aad26b0c02413caf` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:44:14.898738 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4f3e0-0b76-4663-b3d7-d2214af30bd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=555b5a9430484bb9aad26b0c02413caf)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:44:14.899873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-f9e4f3e0-0b76-4663-b3d7-d2214af30bd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:44:14.899873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:44:14.899873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:44:14.901057 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4f3e0-0b76-4663-b3d7-d2214af30bd7 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:44:14.963961 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-f9e4f3e0-0b76-4663-b3d7-d2214af30bd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '555b5a9430484bb9aad26b0c02413caf', 'request_id': 'req-f9e4f3e0-0b76-4663-b3d7-d2214af30bd7'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:44:14.973215 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-f9e4f3e0-0b76-4663-b3d7-d2214af30bd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '555b5a9430484bb9aad26b0c02413caf', 'request_id': 'req-f9e4f3e0-0b76-4663-b3d7-d2214af30bd7'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:44:14.979901 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-f9e4f3e0-0b76-4663-b3d7-d2214af30bd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '555b5a9430484bb9aad26b0c02413caf', 'request_id': 'req-f9e4f3e0-0b76-4663-b3d7-d2214af30bd7'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:44:14.999191 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-f9e4f3e0-0b76-4663-b3d7-d2214af30bd7 admin admin] The token cache is being invalidate because project 555b5a9430484bb9aad26b0c02413caf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:44:14.999390 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-f9e4f3e0-0b76-4663-b3d7-d2214af30bd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:44:15.000179 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-f9e4f3e0-0b76-4663-b3d7-d2214af30bd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:44:15.001997 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 748/1523] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:44:14 2022] DELETE /identity/v3/projects/555b5a9430484bb9aad26b0c02413caf => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:45:39.808086 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd310f7c-6a5b-4389-af1c-a6dd6ecf99a5 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:45:39.808719 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd310f7c-6a5b-4389-af1c-a6dd6ecf99a5 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:45:39.808719 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd310f7c-6a5b-4389-af1c-a6dd6ecf99a5 None None] PATH_INFO: `/v3` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:45:39.809926 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 776/1524] 10.222.0.15 () {54 vars in 925 bytes} [Mon Jan 10 12:45:39 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:45:39.817774 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9373a-fa19-4a43-97a1-83223a605ea6 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:45:39.818246 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9373a-fa19-4a43-97a1-83223a605ea6 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:45:39.818343 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9373a-fa19-4a43-97a1-83223a605ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:45:39.838637 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-3af9373a-fa19-4a43-97a1-83223a605ea6 None None] MFA Rules not processed for user `c6aa01ebd7314f30a1c729ff2b50c975`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:45:39.839897 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-3af9373a-fa19-4a43-97a1-83223a605ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:45:39.906777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 749/1525] 10.222.0.15 () {58 vars in 1015 bytes} [Mon Jan 10 12:45:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:45:40.698115 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ae9d6-9b67-4674-9467-ed9fbf3a4f84 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:45:40.698441 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ae9d6-9b67-4674-9467-ed9fbf3a4f84 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:45:40.698838 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ae9d6-9b67-4674-9467-ed9fbf3a4f84 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:45:40.701825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 777/1526] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 12:45:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:45:40.708891 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482ea84-fab2-47ab-854b-51462bcd9944 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:45:40.709352 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482ea84-fab2-47ab-854b-51462bcd9944 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:45:40.709811 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482ea84-fab2-47ab-854b-51462bcd9944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:45:40.736063 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-f482ea84-fab2-47ab-854b-51462bcd9944 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:45:40.737263 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-f482ea84-fab2-47ab-854b-51462bcd9944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:45:40.799503 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 750/1527] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 12:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:45:40.955290 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ae9d6-9b67-4674-9467-ed9fbf3a4f84 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:45:40.957467 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-545ae9d6-9b67-4674-9467-ed9fbf3a4f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:45:41.039433 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ae9d6-9b67-4674-9467-ed9fbf3a4f84 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:45:41.045882 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf30016-9be1-4633-ba79-ad941f666b2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:45:41.046590 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf30016-9be1-4633-ba79-ad941f666b2a service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:45:41.047089 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf30016-9be1-4633-ba79-ad941f666b2a service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:45:41.047554 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf30016-9be1-4633-ba79-ad941f666b2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:45:41.059289 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf30016-9be1-4633-ba79-ad941f666b2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:45:41.060926 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf30016-9be1-4633-ba79-ad941f666b2a service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:45:41.072728 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 778/1528] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:45:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:45:42.625478 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b1e2b-bb68-471b-a3ba-ecd9ce5d0727 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:45:42.626422 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b1e2b-bb68-471b-a3ba-ecd9ce5d0727 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:45:42.626422 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b1e2b-bb68-471b-a3ba-ecd9ce5d0727 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:45:42.629239 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 751/1529] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 12:45:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:45:42.636301 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6356ea6-6812-4ef5-85db-84b74d0814dc None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:45:42.637096 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6356ea6-6812-4ef5-85db-84b74d0814dc None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:45:42.637269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6356ea6-6812-4ef5-85db-84b74d0814dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:45:42.660250 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-c6356ea6-6812-4ef5-85db-84b74d0814dc None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:45:42.661462 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c6356ea6-6812-4ef5-85db-84b74d0814dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:45:42.670749 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 779/1530] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 12:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:45:42.828278 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b1e2b-bb68-471b-a3ba-ecd9ce5d0727 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:45:42.849192 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b1e2b-bb68-471b-a3ba-ecd9ce5d0727 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:45:42.856609 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7192389-61fd-4435-b80b-74284d1d5e49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:45:42.857249 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7192389-61fd-4435-b80b-74284d1d5e49 service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:45:42.857531 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7192389-61fd-4435-b80b-74284d1d5e49 service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:45:42.857804 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7192389-61fd-4435-b80b-74284d1d5e49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:45:42.866609 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7192389-61fd-4435-b80b-74284d1d5e49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:45:42.868313 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7192389-61fd-4435-b80b-74284d1d5e49 service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:45:42.878103 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 752/1531] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:45:43.439218 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77763451-e5f9-4d3b-b445-525a5e05d646 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:45:43.439481 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77763451-e5f9-4d3b-b445-525a5e05d646 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:45:43.439807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77763451-e5f9-4d3b-b445-525a5e05d646 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:45:43.441639 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 780/1532] 10.222.0.13 () {54 vars in 960 bytes} [Mon Jan 10 12:45:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:45:43.447001 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deb55a-6b79-4466-8ae7-e45ca5e91a23 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:45:43.447292 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deb55a-6b79-4466-8ae7-e45ca5e91a23 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:45:43.447582 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6deb55a-6b79-4466-8ae7-e45ca5e91a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:45:43.470625 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-d6deb55a-6b79-4466-8ae7-e45ca5e91a23 None None] MFA Rules not processed for user `c6aa01ebd7314f30a1c729ff2b50c975`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:45:43.471859 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-d6deb55a-6b79-4466-8ae7-e45ca5e91a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:45:43.482078 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 753/1533] 10.222.0.13 () {58 vars in 1057 bytes} [Mon Jan 10 12:45:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:45:43.489753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77763451-e5f9-4d3b-b445-525a5e05d646 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:45:43.507187 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77763451-e5f9-4d3b-b445-525a5e05d646 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:45:43.513456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de39205-14e2-4db2-b901-a13c875b3dd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6aa01ebd7314f30a1c729ff2b50c975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:45:43.514093 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de39205-14e2-4db2-b901-a13c875b3dd0 service placement] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:45:43.514364 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de39205-14e2-4db2-b901-a13c875b3dd0 service placement] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:45:43.514648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de39205-14e2-4db2-b901-a13c875b3dd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:45:43.523568 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de39205-14e2-4db2-b901-a13c875b3dd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:45:43.525320 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de39205-14e2-4db2-b901-a13c875b3dd0 service placement] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:45:43.535135 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 781/1534] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:45:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:45:54.868127 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc04be0-832a-43bd-89c6-200709468c13 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:45:54.869253 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc04be0-832a-43bd-89c6-200709468c13 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:45:54.869658 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc04be0-832a-43bd-89c6-200709468c13 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:45:54.872748 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 754/1535] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 12:45:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:45:54.878925 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68970aff-e0ff-41ef-bba4-9a91f5bafb10 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:45:54.879725 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68970aff-e0ff-41ef-bba4-9a91f5bafb10 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:45:54.879897 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68970aff-e0ff-41ef-bba4-9a91f5bafb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:45:54.902070 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-68970aff-e0ff-41ef-bba4-9a91f5bafb10 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:45:54.903303 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-68970aff-e0ff-41ef-bba4-9a91f5bafb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:45:54.912406 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 782/1536] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 12:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:45:55.071004 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc04be0-832a-43bd-89c6-200709468c13 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:45:55.088078 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc04be0-832a-43bd-89c6-200709468c13 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:45:55.094324 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a82ca3-54c5-49d8-a95f-3af87d8af567 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:45:55.094957 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a82ca3-54c5-49d8-a95f-3af87d8af567 service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:45:55.095233 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a82ca3-54c5-49d8-a95f-3af87d8af567 service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:45:55.095496 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a82ca3-54c5-49d8-a95f-3af87d8af567 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:45:55.103989 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a82ca3-54c5-49d8-a95f-3af87d8af567 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:45:55.106230 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a82ca3-54c5-49d8-a95f-3af87d8af567 service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:45:55.116037 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 755/1537] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:45:56.657960 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378088b-9b28-4d14-aa56-0175a642cb5c None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:45:56.658542 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378088b-9b28-4d14-aa56-0175a642cb5c None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:45:56.658542 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378088b-9b28-4d14-aa56-0175a642cb5c None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:45:56.660356 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 783/1538] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jan 10 12:45:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:45:56.666341 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d84d4-f902-4c36-a40d-045b4b9855fd None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:45:56.666800 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d84d4-f902-4c36-a40d-045b4b9855fd None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:45:56.667114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d84d4-f902-4c36-a40d-045b4b9855fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:45:56.691261 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-f92d84d4-f902-4c36-a40d-045b4b9855fd None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:45:56.692483 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-f92d84d4-f902-4c36-a40d-045b4b9855fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:45:56.701554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 756/1539] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jan 10 12:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:45:56.857196 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378088b-9b28-4d14-aa56-0175a642cb5c None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:45:56.877623 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378088b-9b28-4d14-aa56-0175a642cb5c None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:45:56.883784 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03777ae5-73a1-40e1-811d-cce20d435498 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:45:56.884424 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03777ae5-73a1-40e1-811d-cce20d435498 service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:45:56.884701 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03777ae5-73a1-40e1-811d-cce20d435498 service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:45:56.884970 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03777ae5-73a1-40e1-811d-cce20d435498 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:45:56.893679 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03777ae5-73a1-40e1-811d-cce20d435498 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:45:56.895279 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03777ae5-73a1-40e1-811d-cce20d435498 service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:45:56.905490 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 784/1540] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:45:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:46:01.218852 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0aae5-dd90-42be-84f9-96186900dd0b None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:46:01.219457 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0aae5-dd90-42be-84f9-96186900dd0b None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:46:01.219457 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0aae5-dd90-42be-84f9-96186900dd0b None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:46:01.221233 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 757/1541] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 12:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:46:01.227576 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e997679-8864-42d3-b1ba-94545e8a0570 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:46:01.228022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e997679-8864-42d3-b1ba-94545e8a0570 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:46:01.228128 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e997679-8864-42d3-b1ba-94545e8a0570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:46:01.254535 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-5e997679-8864-42d3-b1ba-94545e8a0570 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:46:01.255811 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-5e997679-8864-42d3-b1ba-94545e8a0570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:46:01.268529 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 785/1542] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 12:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:46:01.310194 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0aae5-dd90-42be-84f9-96186900dd0b None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:46:01.312657 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-c1f0aae5-dd90-42be-84f9-96186900dd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:46:01.380402 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0aae5-dd90-42be-84f9-96186900dd0b None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:46:01.387171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f910748-caeb-4881-83aa-3e38157c64cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:46:01.388118 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f910748-caeb-4881-83aa-3e38157c64cd service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:46:01.388519 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f910748-caeb-4881-83aa-3e38157c64cd service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:46:01.388858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f910748-caeb-4881-83aa-3e38157c64cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:46:01.404281 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f910748-caeb-4881-83aa-3e38157c64cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:46:01.405759 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f910748-caeb-4881-83aa-3e38157c64cd service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:46:01.415689 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 758/1543] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:46:03.868843 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b654f9-47c2-4684-a8d5-d8a45f53e3b6 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:46:03.869744 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b654f9-47c2-4684-a8d5-d8a45f53e3b6 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:46:03.869744 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b654f9-47c2-4684-a8d5-d8a45f53e3b6 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:46:03.872561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 786/1544] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 12:46:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:46:03.879004 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e62d38-6729-4a2e-b11f-5f97c37b95bb None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:46:03.879471 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e62d38-6729-4a2e-b11f-5f97c37b95bb None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:46:03.879621 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e62d38-6729-4a2e-b11f-5f97c37b95bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:46:03.901473 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-58e62d38-6729-4a2e-b11f-5f97c37b95bb None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:46:03.902677 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-58e62d38-6729-4a2e-b11f-5f97c37b95bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:46:03.911335 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 759/1545] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 12:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:46:03.953487 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b654f9-47c2-4684-a8d5-d8a45f53e3b6 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:46:03.955575 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-51b654f9-47c2-4684-a8d5-d8a45f53e3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:46:03.969659 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b654f9-47c2-4684-a8d5-d8a45f53e3b6 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:46:03.973859 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35547c2-be24-4796-90f9-22bf2ab31a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:46:03.974495 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35547c2-be24-4796-90f9-22bf2ab31a57 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:46:03.974771 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35547c2-be24-4796-90f9-22bf2ab31a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:46:03.975039 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35547c2-be24-4796-90f9-22bf2ab31a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:46:03.984644 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35547c2-be24-4796-90f9-22bf2ab31a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:46:03.986076 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35547c2-be24-4796-90f9-22bf2ab31a57 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:46:03.995729 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 787/1546] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:46:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:46:07.945409 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e652b-7f06-4a67-890f-6b81606b0157 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:46:07.946447 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e652b-7f06-4a67-890f-6b81606b0157 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:46:07.946447 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e652b-7f06-4a67-890f-6b81606b0157 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:46:07.949394 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 760/1547] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 12:46:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:46:07.958119 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf387ba-7fbc-4f08-99fc-c1be53e912b4 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:46:07.958869 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf387ba-7fbc-4f08-99fc-c1be53e912b4 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:46:07.959055 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf387ba-7fbc-4f08-99fc-c1be53e912b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:46:07.981067 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-6bf387ba-7fbc-4f08-99fc-c1be53e912b4 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:46:07.982273 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-6bf387ba-7fbc-4f08-99fc-c1be53e912b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:46:07.990793 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 788/1548] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 12:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:46:08.043958 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e652b-7f06-4a67-890f-6b81606b0157 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:46:08.046716 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-6c1e652b-7f06-4a67-890f-6b81606b0157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:46:08.115799 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e652b-7f06-4a67-890f-6b81606b0157 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:46:08.120096 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e468679-2aa1-4911-a576-9a1d90c8f9ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:46:08.120731 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e468679-2aa1-4911-a576-9a1d90c8f9ca service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:46:08.121002 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e468679-2aa1-4911-a576-9a1d90c8f9ca service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:46:08.121402 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e468679-2aa1-4911-a576-9a1d90c8f9ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:46:08.130575 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e468679-2aa1-4911-a576-9a1d90c8f9ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:46:08.132086 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e468679-2aa1-4911-a576-9a1d90c8f9ca service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:46:08.141864 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 761/1549] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:46:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:46:10.547599 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258c639-8c39-4b8f-87d8-a7f831d36002 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:46:10.548460 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258c639-8c39-4b8f-87d8-a7f831d36002 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:46:10.548631 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258c639-8c39-4b8f-87d8-a7f831d36002 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:46:10.551602 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 789/1550] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jan 10 12:46:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:46:10.562013 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0154d4e-0e88-4730-b087-a3d800062d53 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:46:10.562489 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0154d4e-0e88-4730-b087-a3d800062d53 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:46:10.562599 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0154d4e-0e88-4730-b087-a3d800062d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:46:10.582671 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-e0154d4e-0e88-4730-b087-a3d800062d53 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:46:10.583964 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e0154d4e-0e88-4730-b087-a3d800062d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:46:10.596659 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 762/1551] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jan 10 12:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:46:10.647622 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4830ac-ddab-473e-b562-9cf8e20e797a None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:46:10.647881 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4830ac-ddab-473e-b562-9cf8e20e797a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:46:10.648163 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4830ac-ddab-473e-b562-9cf8e20e797a None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:46:10.650006 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 790/1552] 10.222.0.13 () {54 vars in 963 bytes} [Mon Jan 10 12:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:46:10.656247 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf9ad3-818f-4b5e-a7f5-3b406f45f48a None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:46:10.656658 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf9ad3-818f-4b5e-a7f5-3b406f45f48a None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:46:10.657042 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf9ad3-818f-4b5e-a7f5-3b406f45f48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:46:10.687039 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-a7cf9ad3-818f-4b5e-a7f5-3b406f45f48a None None] MFA Rules not processed for user `dbaa0eb9e5b44a93a357473f8ec1a5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:46:10.688275 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-a7cf9ad3-818f-4b5e-a7f5-3b406f45f48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:46:10.696802 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 763/1553] 10.222.0.13 () {58 vars in 1060 bytes} [Mon Jan 10 12:46:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:46:10.705224 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4830ac-ddab-473e-b562-9cf8e20e797a None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:46:10.720636 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4830ac-ddab-473e-b562-9cf8e20e797a None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:46:10.724816 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8645d-8539-4992-8635-7e5e2116ffea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:46:10.725453 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8645d-8539-4992-8635-7e5e2116ffea service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:46:10.725735 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8645d-8539-4992-8635-7e5e2116ffea service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:46:10.726009 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8645d-8539-4992-8635-7e5e2116ffea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:46:10.737458 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8645d-8539-4992-8635-7e5e2116ffea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:46:10.739198 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8645d-8539-4992-8635-7e5e2116ffea service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:46:10.750400 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 791/1554] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:46:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:31.833521 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4c1e3-a44e-4c94-9510-b3f97116c7cf None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:31.834606 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4c1e3-a44e-4c94-9510-b3f97116c7cf None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:31.835093 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4c1e3-a44e-4c94-9510-b3f97116c7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:31.854052 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-71f4c1e3-a44e-4c94-9510-b3f97116c7cf None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:31.855644 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-71f4c1e3-a44e-4c94-9510-b3f97116c7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:31.871779 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 764/1555] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:31.881019 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3be5d8-3c0d-4228-b1bf-aad0d982588c None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:31.882174 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3be5d8-3c0d-4228-b1bf-aad0d982588c None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:31.882675 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3be5d8-3c0d-4228-b1bf-aad0d982588c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:31.908580 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-1a3be5d8-3c0d-4228-b1bf-aad0d982588c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:31.910006 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-1a3be5d8-3c0d-4228-b1bf-aad0d982588c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:31.926472 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 792/1556] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:31.931617 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4c1e3-a44e-4c94-9510-b3f97116c7cf None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:31.942043 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4c1e3-a44e-4c94-9510-b3f97116c7cf None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:31.952512 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544331f5-05f9-4570-b01b-acaff9b80b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:31.953194 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544331f5-05f9-4570-b01b-acaff9b80b0b admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:31.953470 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544331f5-05f9-4570-b01b-acaff9b80b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:31.953736 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544331f5-05f9-4570-b01b-acaff9b80b0b admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:31.954475 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544331f5-05f9-4570-b01b-acaff9b80b0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:47:31.954947 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544331f5-05f9-4570-b01b-acaff9b80b0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:31.956867 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544331f5-05f9-4570-b01b-acaff9b80b0b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:31.973876 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 765/1557] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:47:31.982425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3be5d8-3c0d-4228-b1bf-aad0d982588c None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:31.996730 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3be5d8-3c0d-4228-b1bf-aad0d982588c None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:32.008572 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefd7a3-28ac-4f71-a2a8-310395fc8bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:32.009719 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefd7a3-28ac-4f71-a2a8-310395fc8bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.009719 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefd7a3-28ac-4f71-a2a8-310395fc8bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.009719 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefd7a3-28ac-4f71-a2a8-310395fc8bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.009977 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefd7a3-28ac-4f71-a2a8-310395fc8bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:32.013029 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefd7a3-28ac-4f71-a2a8-310395fc8bd4 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:32.063362 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 793/1558] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:47:31 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:32.068646 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544331f5-05f9-4570-b01b-acaff9b80b0b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:32.079560 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544331f5-05f9-4570-b01b-acaff9b80b0b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:32.124657 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01249d82-89be-4221-a44b-e84b858b29f7 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.124880 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01249d82-89be-4221-a44b-e84b858b29f7 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.125136 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01249d82-89be-4221-a44b-e84b858b29f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.156557 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da52d1-7873-4d7f-a401-6dc942f2d8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:32.157676 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da52d1-7873-4d7f-a401-6dc942f2d8ce admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.158169 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da52d1-7873-4d7f-a401-6dc942f2d8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.158653 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da52d1-7873-4d7f-a401-6dc942f2d8ce admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.158950 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-01249d82-89be-4221-a44b-e84b858b29f7 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:32.159977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da52d1-7873-4d7f-a401-6dc942f2d8ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:32.160533 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-01249d82-89be-4221-a44b-e84b858b29f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:32.162404 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da52d1-7873-4d7f-a401-6dc942f2d8ce admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:32.185136 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 794/1559] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:32.194295 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479302a7-aa41-473f-a05f-d79b0a61f862 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.194627 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479302a7-aa41-473f-a05f-d79b0a61f862 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.194837 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479302a7-aa41-473f-a05f-d79b0a61f862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.203917 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 766/1560] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:32.205874 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da52d1-7873-4d7f-a401-6dc942f2d8ce admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:32.215763 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da52d1-7873-4d7f-a401-6dc942f2d8ce admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:32.224990 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-479302a7-aa41-473f-a05f-d79b0a61f862 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:32.226237 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-479302a7-aa41-473f-a05f-d79b0a61f862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:32.227852 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250d184-50d2-4470-b9e8-1c83c1420570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:32.228791 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250d184-50d2-4470-b9e8-1c83c1420570 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.229297 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250d184-50d2-4470-b9e8-1c83c1420570 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.229783 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250d184-50d2-4470-b9e8-1c83c1420570 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.230743 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250d184-50d2-4470-b9e8-1c83c1420570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:32.232654 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250d184-50d2-4470-b9e8-1c83c1420570 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:32.256267 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 767/1561] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:32.258165 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c315d-01d9-4338-9361-d0fc9d928db4 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.258781 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c315d-01d9-4338-9361-d0fc9d928db4 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.259272 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c315d-01d9-4338-9361-d0fc9d928db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.263874 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 795/1562] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:47:32.265802 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c560c6e-d068-45f0-865f-205263a31a28 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.265802 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c560c6e-d068-45f0-865f-205263a31a28 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.266006 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c560c6e-d068-45f0-865f-205263a31a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.284023 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-2b6c315d-01d9-4338-9361-d0fc9d928db4 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:32.285749 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-2b6c315d-01d9-4338-9361-d0fc9d928db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:32.294714 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 768/1563] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:32.295799 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c315d-01d9-4338-9361-d0fc9d928db4 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:32.303420 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-5c560c6e-d068-45f0-865f-205263a31a28 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:32.304648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-5c560c6e-d068-45f0-865f-205263a31a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:32.313525 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c315d-01d9-4338-9361-d0fc9d928db4 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:32.320407 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 796/1564] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:32.321035 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c560c6e-d068-45f0-865f-205263a31a28 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:32.326551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe08a2-7513-4ee8-8c84-193a3005020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:32.327585 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe08a2-7513-4ee8-8c84-193a3005020d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.328217 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe08a2-7513-4ee8-8c84-193a3005020d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.329192 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe08a2-7513-4ee8-8c84-193a3005020d admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.329989 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe08a2-7513-4ee8-8c84-193a3005020d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:32.332152 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe08a2-7513-4ee8-8c84-193a3005020d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:32.337789 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c560c6e-d068-45f0-865f-205263a31a28 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:32.342551 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be9fb2-e173-4a3b-9c38-c489426eaa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:32.343348 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be9fb2-e173-4a3b-9c38-c489426eaa53 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.343671 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be9fb2-e173-4a3b-9c38-c489426eaa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.343947 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be9fb2-e173-4a3b-9c38-c489426eaa53 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.344319 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 769/1565] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:32.345671 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f38195-126b-42c6-a7e4-05445a659b61 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.345964 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f38195-126b-42c6-a7e4-05445a659b61 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.346536 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f38195-126b-42c6-a7e4-05445a659b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.348223 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be9fb2-e173-4a3b-9c38-c489426eaa53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:47:32.348867 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be9fb2-e173-4a3b-9c38-c489426eaa53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:32.350589 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be9fb2-e173-4a3b-9c38-c489426eaa53 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:32.363009 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 797/1566] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:47:32.366201 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a4bf7-1243-4c2c-985e-e987219512d6 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.366201 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a4bf7-1243-4c2c-985e-e987219512d6 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.366201 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a4bf7-1243-4c2c-985e-e987219512d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.367504 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-55f38195-126b-42c6-a7e4-05445a659b61 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:32.368743 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-55f38195-126b-42c6-a7e4-05445a659b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:32.376761 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 770/1567] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:32.377938 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504eb332-6df5-4664-b0e2-82ae3755969b None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.378357 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504eb332-6df5-4664-b0e2-82ae3755969b None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.378657 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504eb332-6df5-4664-b0e2-82ae3755969b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.384563 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-6b2a4bf7-1243-4c2c-985e-e987219512d6 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:32.385787 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-6b2a4bf7-1243-4c2c-985e-e987219512d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:32.393684 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 798/1568] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:32.394958 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18b9f2-8005-4733-84b2-aa52dd181d62 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.396476 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-504eb332-6df5-4664-b0e2-82ae3755969b None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:32.397636 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18b9f2-8005-4733-84b2-aa52dd181d62 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.397763 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-504eb332-6df5-4664-b0e2-82ae3755969b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:32.398061 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18b9f2-8005-4733-84b2-aa52dd181d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.405820 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 771/1569] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:32.406566 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff315b3-e4cc-43a6-bb53-f137d5640c0a None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.406848 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff315b3-e4cc-43a6-bb53-f137d5640c0a None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.407116 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff315b3-e4cc-43a6-bb53-f137d5640c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.416113 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-ec18b9f2-8005-4733-84b2-aa52dd181d62 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:32.417282 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ec18b9f2-8005-4733-84b2-aa52dd181d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:32.424619 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-eff315b3-e4cc-43a6-bb53-f137d5640c0a None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:32.425033 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 799/1570] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:32.425867 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-eff315b3-e4cc-43a6-bb53-f137d5640c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:32.426306 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18b9f2-8005-4733-84b2-aa52dd181d62 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:32.434938 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 772/1571] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:32.436625 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5417a08-157c-4f6e-83cf-fe8c2806c513 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.436911 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5417a08-157c-4f6e-83cf-fe8c2806c513 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.437181 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5417a08-157c-4f6e-83cf-fe8c2806c513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.440318 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18b9f2-8005-4733-84b2-aa52dd181d62 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:32.447352 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d29cde-12b3-4953-8b66-c9095468fb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:32.448289 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d29cde-12b3-4953-8b66-c9095468fb4f admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.448572 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d29cde-12b3-4953-8b66-c9095468fb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.448863 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d29cde-12b3-4953-8b66-c9095468fb4f admin admin] PATH_INFO: `/v3/projects/30d54bc5b800487db219940267292ed4/users/5883f052c7b64d74b361cd1c8f689061/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.457384 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-d5417a08-157c-4f6e-83cf-fe8c2806c513 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:32.458589 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-d5417a08-157c-4f6e-83cf-fe8c2806c513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:32.463612 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d29cde-12b3-4953-8b66-c9095468fb4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d54bc5b800487db219940267292ed4, user_id=5883f052c7b64d74b361cd1c8f689061, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:32.466304 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d29cde-12b3-4953-8b66-c9095468fb4f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:32.466940 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 773/1572] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:32.467665 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5417a08-157c-4f6e-83cf-fe8c2806c513 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:32.478170 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5417a08-157c-4f6e-83cf-fe8c2806c513 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:32.484532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 800/1573] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:32 2022] PUT /identity/v3/projects/30d54bc5b800487db219940267292ed4/users/5883f052c7b64d74b361cd1c8f689061/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:32.485821 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13d81e-ed66-4190-b9a2-f34aa03b1b3e None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.486104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13d81e-ed66-4190-b9a2-f34aa03b1b3e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.486373 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13d81e-ed66-4190-b9a2-f34aa03b1b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.503296 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-2e13d81e-ed66-4190-b9a2-f34aa03b1b3e None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:32.504473 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-2e13d81e-ed66-4190-b9a2-f34aa03b1b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:32.534586 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fea62f-9eb8-4870-96b0-ff7931580a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:32.535416 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fea62f-9eb8-4870-96b0-ff7931580a9a admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.535760 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fea62f-9eb8-4870-96b0-ff7931580a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.536030 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fea62f-9eb8-4870-96b0-ff7931580a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.536733 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fea62f-9eb8-4870-96b0-ff7931580a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:32.538674 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fea62f-9eb8-4870-96b0-ff7931580a9a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:32.562168 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 801/1574] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:32.563487 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d730f0-22c0-4d9d-b712-e6eb379a40a4 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.563803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d730f0-22c0-4d9d-b712-e6eb379a40a4 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.564077 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d730f0-22c0-4d9d-b712-e6eb379a40a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.569157 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 774/1575] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:32.569945 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fea62f-9eb8-4870-96b0-ff7931580a9a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:32.583334 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-b7d730f0-22c0-4d9d-b712-e6eb379a40a4 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:32.584594 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b7d730f0-22c0-4d9d-b712-e6eb379a40a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:32.631282 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fea62f-9eb8-4870-96b0-ff7931580a9a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:32.635928 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86decf8-af16-4506-b95f-b48b8f40d8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:32.636615 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86decf8-af16-4506-b95f-b48b8f40d8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.636892 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86decf8-af16-4506-b95f-b48b8f40d8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.637157 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86decf8-af16-4506-b95f-b48b8f40d8f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.637895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86decf8-af16-4506-b95f-b48b8f40d8f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:47:32.638197 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86decf8-af16-4506-b95f-b48b8f40d8f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:32.639863 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86decf8-af16-4506-b95f-b48b8f40d8f9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:32.642621 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 802/1576] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:32.644013 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba2416-ba4c-4811-a76b-f7d97a283cea None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.644289 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba2416-ba4c-4811-a76b-f7d97a283cea None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.644566 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba2416-ba4c-4811-a76b-f7d97a283cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.652070 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 775/1577] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:47:32.652967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86decf8-af16-4506-b95f-b48b8f40d8f9 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:32.662878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86decf8-af16-4506-b95f-b48b8f40d8f9 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:32.663205 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-7aba2416-ba4c-4811-a76b-f7d97a283cea None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:32.664415 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-7aba2416-ba4c-4811-a76b-f7d97a283cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:32.667598 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998d45c-00cb-42e9-b15c-00d56c7d57a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:32.668247 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998d45c-00cb-42e9-b15c-00d56c7d57a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.668529 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998d45c-00cb-42e9-b15c-00d56c7d57a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.670167 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998d45c-00cb-42e9-b15c-00d56c7d57a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.670923 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998d45c-00cb-42e9-b15c-00d56c7d57a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:47:32.671214 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998d45c-00cb-42e9-b15c-00d56c7d57a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:32.672538 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 803/1578] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:32.672878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998d45c-00cb-42e9-b15c-00d56c7d57a7 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:32.673825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6d8a9-dc52-4504-ab8f-e3fd0d7015dc None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.674229 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6d8a9-dc52-4504-ab8f-e3fd0d7015dc None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.674569 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6d8a9-dc52-4504-ab8f-e3fd0d7015dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.685794 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 776/1579] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:47:32.687334 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15ecfd-b5b1-415b-86ad-7575e95e4b0e None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.687604 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15ecfd-b5b1-415b-86ad-7575e95e4b0e None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.687875 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15ecfd-b5b1-415b-86ad-7575e95e4b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.693406 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-f3a6d8a9-dc52-4504-ab8f-e3fd0d7015dc None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:32.694636 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f3a6d8a9-dc52-4504-ab8f-e3fd0d7015dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:32.702641 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 804/1580] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:32.703563 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6d8a9-dc52-4504-ab8f-e3fd0d7015dc None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:32.705431 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-2a15ecfd-b5b1-415b-86ad-7575e95e4b0e None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:32.706805 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-2a15ecfd-b5b1-415b-86ad-7575e95e4b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:32.713049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6d8a9-dc52-4504-ab8f-e3fd0d7015dc None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:32.714609 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 777/1581] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:32.715419 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15ecfd-b5b1-415b-86ad-7575e95e4b0e None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:32.719325 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccd27e-b256-4664-97ad-6ce6e5811b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:32.719325 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccd27e-b256-4664-97ad-6ce6e5811b7b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.719325 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccd27e-b256-4664-97ad-6ce6e5811b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.719668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccd27e-b256-4664-97ad-6ce6e5811b7b admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.720243 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccd27e-b256-4664-97ad-6ce6e5811b7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:47:32.720548 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccd27e-b256-4664-97ad-6ce6e5811b7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:32.722224 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccd27e-b256-4664-97ad-6ce6e5811b7b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:32.725148 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15ecfd-b5b1-415b-86ad-7575e95e4b0e None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:32.731340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1aa58b-d31e-4411-8fce-4330f6ce7e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:32.731340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aa58b-d31e-4411-8fce-4330f6ce7e45 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.731340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aa58b-d31e-4411-8fce-4330f6ce7e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.731340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aa58b-d31e-4411-8fce-4330f6ce7e45 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.731769 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1aa58b-d31e-4411-8fce-4330f6ce7e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:32.733763 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1aa58b-d31e-4411-8fce-4330f6ce7e45 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:32.736373 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 805/1582] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:47:32.744035 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccd27e-b256-4664-97ad-6ce6e5811b7b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:32.754068 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccd27e-b256-4664-97ad-6ce6e5811b7b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:32.760350 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b675a8c-bd76-418e-ae6c-3f370ea2fade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:32.764061 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 778/1583] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/users => generated 295 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:32.764206 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b675a8c-bd76-418e-ae6c-3f370ea2fade admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.764292 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1aa58b-d31e-4411-8fce-4330f6ce7e45 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:32.764379 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b675a8c-bd76-418e-ae6c-3f370ea2fade admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.764379 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b675a8c-bd76-418e-ae6c-3f370ea2fade admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.764379 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b675a8c-bd76-418e-ae6c-3f370ea2fade admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:47:32.764379 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b675a8c-bd76-418e-ae6c-3f370ea2fade admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:32.764967 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b675a8c-bd76-418e-ae6c-3f370ea2fade admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:32.771143 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1aa58b-d31e-4411-8fce-4330f6ce7e45 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:32.776047 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a1ec6-9120-456e-a84f-7f71ef8420c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:32.776714 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a1ec6-9120-456e-a84f-7f71ef8420c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.776993 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a1ec6-9120-456e-a84f-7f71ef8420c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.777270 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a1ec6-9120-456e-a84f-7f71ef8420c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.777977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a1ec6-9120-456e-a84f-7f71ef8420c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:32.780133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a1ec6-9120-456e-a84f-7f71ef8420c4 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:32.782057 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 806/1584] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:47:32.787428 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b675a8c-bd76-418e-ae6c-3f370ea2fade admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:32.792796 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b675a8c-bd76-418e-ae6c-3f370ea2fade admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:32.797653 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19149b-5843-4ba2-a98a-30a3687073d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:32.798660 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19149b-5843-4ba2-a98a-30a3687073d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.798944 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19149b-5843-4ba2-a98a-30a3687073d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.799240 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19149b-5843-4ba2-a98a-30a3687073d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.800018 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19149b-5843-4ba2-a98a-30a3687073d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:47:32.800412 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19149b-5843-4ba2-a98a-30a3687073d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:32.802501 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19149b-5843-4ba2-a98a-30a3687073d3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:32.817128 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 779/1585] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:32.817128 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a1ec6-9120-456e-a84f-7f71ef8420c4 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:32.817415 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 807/1586] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:47:32.817415 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19149b-5843-4ba2-a98a-30a3687073d3 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:32.832977 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19149b-5843-4ba2-a98a-30a3687073d3 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:32.881832 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a1ec6-9120-456e-a84f-7f71ef8420c4 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:32.886427 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b033c-d749-4cb2-991c-8ad7765c9b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:32.887160 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b033c-d749-4cb2-991c-8ad7765c9b0d admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.887442 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b033c-d749-4cb2-991c-8ad7765c9b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.887752 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657f79d-b730-41cc-b13b-41ff674d1069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:32.888180 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b033c-d749-4cb2-991c-8ad7765c9b0d admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.888418 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657f79d-b730-41cc-b13b-41ff674d1069 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.888525 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b033c-d749-4cb2-991c-8ad7765c9b0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:32.888694 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657f79d-b730-41cc-b13b-41ff674d1069 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.888980 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657f79d-b730-41cc-b13b-41ff674d1069 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.889690 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657f79d-b730-41cc-b13b-41ff674d1069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:47:32.889991 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657f79d-b730-41cc-b13b-41ff674d1069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:32.890375 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b033c-d749-4cb2-991c-8ad7765c9b0d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:32.891603 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657f79d-b730-41cc-b13b-41ff674d1069 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:32.903703 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 808/1587] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:47:32.904565 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657f79d-b730-41cc-b13b-41ff674d1069 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:32.918068 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 780/1588] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:32.919108 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b033c-d749-4cb2-991c-8ad7765c9b0d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:32.958700 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657f79d-b730-41cc-b13b-41ff674d1069 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:32.980523 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b033c-d749-4cb2-991c-8ad7765c9b0d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:32.985232 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b4d53-5467-47ef-aa0a-df0099389145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:32.985913 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b4d53-5467-47ef-aa0a-df0099389145 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:32.986187 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b4d53-5467-47ef-aa0a-df0099389145 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:32.986452 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b4d53-5467-47ef-aa0a-df0099389145 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:32.987148 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b4d53-5467-47ef-aa0a-df0099389145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:32.989576 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b4d53-5467-47ef-aa0a-df0099389145 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.005928 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e85fb4-00ae-4d71-8b7a-4d029b319bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.006645 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e85fb4-00ae-4d71-8b7a-4d029b319bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.006863 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e85fb4-00ae-4d71-8b7a-4d029b319bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.007170 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e85fb4-00ae-4d71-8b7a-4d029b319bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.014699 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 781/1589] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:47:32 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:33.015539 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b4d53-5467-47ef-aa0a-df0099389145 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.020215 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e85fb4-00ae-4d71-8b7a-4d029b319bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.021705 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e85fb4-00ae-4d71-8b7a-4d029b319bc9 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.031918 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 809/1590] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:33.032773 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e85fb4-00ae-4d71-8b7a-4d029b319bc9 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.042118 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e85fb4-00ae-4d71-8b7a-4d029b319bc9 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.080935 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b4d53-5467-47ef-aa0a-df0099389145 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.093027 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0a273-f91a-4a06-bc75-87dddc13d81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.093027 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0a273-f91a-4a06-bc75-87dddc13d81b admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.093383 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0a273-f91a-4a06-bc75-87dddc13d81b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.093847 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0a273-f91a-4a06-bc75-87dddc13d81b admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.094253 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0a273-f91a-4a06-bc75-87dddc13d81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.096782 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0a273-f91a-4a06-bc75-87dddc13d81b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.108158 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 782/1591] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:33.109005 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0a273-f91a-4a06-bc75-87dddc13d81b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.121404 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0a273-f91a-4a06-bc75-87dddc13d81b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.123626 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816bbe8-1d3a-4861-96ba-da3355da9b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.124628 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816bbe8-1d3a-4861-96ba-da3355da9b09 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.125253 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816bbe8-1d3a-4861-96ba-da3355da9b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.125703 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816bbe8-1d3a-4861-96ba-da3355da9b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.126431 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816bbe8-1d3a-4861-96ba-da3355da9b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.126624 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d6ec3-194a-489c-8039-7970ee6b29bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.127273 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d6ec3-194a-489c-8039-7970ee6b29bb admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.127576 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d6ec3-194a-489c-8039-7970ee6b29bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.127850 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d6ec3-194a-489c-8039-7970ee6b29bb admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.128702 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d6ec3-194a-489c-8039-7970ee6b29bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.128934 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816bbe8-1d3a-4861-96ba-da3355da9b09 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.130645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d6ec3-194a-489c-8039-7970ee6b29bb admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.152500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 783/1592] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:47:33 2022] POST /identity/v3/users => generated 285 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:33.156082 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d6ec3-194a-489c-8039-7970ee6b29bb admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.158172 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 810/1593] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:47:33 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:33.159017 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816bbe8-1d3a-4861-96ba-da3355da9b09 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.167619 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d6ec3-194a-489c-8039-7970ee6b29bb admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.229948 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816bbe8-1d3a-4861-96ba-da3355da9b09 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.237899 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a98af-53ae-4520-814d-f0727be7e6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.240266 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a98af-53ae-4520-814d-f0727be7e6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.240623 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a98af-53ae-4520-814d-f0727be7e6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.240990 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a98af-53ae-4520-814d-f0727be7e6f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.242226 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a98af-53ae-4520-814d-f0727be7e6f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.243367 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28812d-18ac-4ca8-99f5-47b5ed2ca0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.244391 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28812d-18ac-4ca8-99f5-47b5ed2ca0bc admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.244544 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28812d-18ac-4ca8-99f5-47b5ed2ca0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.244816 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28812d-18ac-4ca8-99f5-47b5ed2ca0bc admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.245389 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a98af-53ae-4520-814d-f0727be7e6f1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.245570 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28812d-18ac-4ca8-99f5-47b5ed2ca0bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.248074 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28812d-18ac-4ca8-99f5-47b5ed2ca0bc admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.274952 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 811/1594] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:47:33 2022] POST /identity/v3/projects => generated 393 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:33.275944 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a98af-53ae-4520-814d-f0727be7e6f1 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.283233 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 784/1595] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:47:33 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:33.284088 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28812d-18ac-4ca8-99f5-47b5ed2ca0bc admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.349573 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28812d-18ac-4ca8-99f5-47b5ed2ca0bc admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.349830 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a98af-53ae-4520-814d-f0727be7e6f1 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.354313 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593ffab-4509-44b3-922a-eae5748f378e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.355063 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593ffab-4509-44b3-922a-eae5748f378e admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.355228 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ae34c-9c0e-41af-b333-f5e404496870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.355461 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593ffab-4509-44b3-922a-eae5748f378e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.355938 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593ffab-4509-44b3-922a-eae5748f378e admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.356061 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ae34c-9c0e-41af-b333-f5e404496870 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.356213 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ae34c-9c0e-41af-b333-f5e404496870 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.356528 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ae34c-9c0e-41af-b333-f5e404496870 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.356890 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593ffab-4509-44b3-922a-eae5748f378e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.357230 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ae34c-9c0e-41af-b333-f5e404496870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.359021 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593ffab-4509-44b3-922a-eae5748f378e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.359235 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ae34c-9c0e-41af-b333-f5e404496870 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.384791 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 785/1596] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:47:33 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:33.386305 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593ffab-4509-44b3-922a-eae5748f378e admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.391699 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 812/1597] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:47:33 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:33.391699 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ae34c-9c0e-41af-b333-f5e404496870 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.396983 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593ffab-4509-44b3-922a-eae5748f378e admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.401983 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ae34c-9c0e-41af-b333-f5e404496870 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.402437 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3502107-3479-40fb-ae5c-d536c99c3e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.403290 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3502107-3479-40fb-ae5c-d536c99c3e91 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.403687 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3502107-3479-40fb-ae5c-d536c99c3e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.404007 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3502107-3479-40fb-ae5c-d536c99c3e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.404826 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3502107-3479-40fb-ae5c-d536c99c3e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.406551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3502107-3479-40fb-ae5c-d536c99c3e91 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.409765 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c0193-049b-4230-b345-0de2ebd1824f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.410583 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c0193-049b-4230-b345-0de2ebd1824f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.410922 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c0193-049b-4230-b345-0de2ebd1824f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.411255 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c0193-049b-4230-b345-0de2ebd1824f admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.412109 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c0193-049b-4230-b345-0de2ebd1824f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.413780 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c0193-049b-4230-b345-0de2ebd1824f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.418768 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 786/1598] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:33.419824 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3502107-3479-40fb-ae5c-d536c99c3e91 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.430968 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3502107-3479-40fb-ae5c-d536c99c3e91 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.435939 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 813/1599] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:33.437271 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990729d7-d9fe-4237-b19e-e538c54a6288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.437541 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c0193-049b-4230-b345-0de2ebd1824f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.438321 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990729d7-d9fe-4237-b19e-e538c54a6288 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.439007 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990729d7-d9fe-4237-b19e-e538c54a6288 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.439474 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990729d7-d9fe-4237-b19e-e538c54a6288 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.440549 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990729d7-d9fe-4237-b19e-e538c54a6288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.442804 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990729d7-d9fe-4237-b19e-e538c54a6288 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.454173 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c0193-049b-4230-b345-0de2ebd1824f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.461018 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd06237-277f-4fbe-92b6-b69ed48d9aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.462225 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd06237-277f-4fbe-92b6-b69ed48d9aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.462490 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd06237-277f-4fbe-92b6-b69ed48d9aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.462890 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd06237-277f-4fbe-92b6-b69ed48d9aa3 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.463783 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd06237-277f-4fbe-92b6-b69ed48d9aa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.465817 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd06237-277f-4fbe-92b6-b69ed48d9aa3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.469049 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 787/1600] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:47:33 2022] POST /identity/v3/users => generated 291 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:33.469921 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990729d7-d9fe-4237-b19e-e538c54a6288 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.481666 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990729d7-d9fe-4237-b19e-e538c54a6288 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.487165 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55752683-bd3d-461f-a883-df4b533b8ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.488196 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55752683-bd3d-461f-a883-df4b533b8ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.488619 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55752683-bd3d-461f-a883-df4b533b8ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.489131 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55752683-bd3d-461f-a883-df4b533b8ff0 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.492685 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 814/1601] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:47:33 2022] POST /identity/v3/users => generated 297 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:33.492850 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55752683-bd3d-461f-a883-df4b533b8ff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.492976 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd06237-277f-4fbe-92b6-b69ed48d9aa3 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.493081 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55752683-bd3d-461f-a883-df4b533b8ff0 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.502449 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd06237-277f-4fbe-92b6-b69ed48d9aa3 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.508220 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31505b-60f5-408f-a54f-5d8e106a2af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.508975 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31505b-60f5-408f-a54f-5d8e106a2af6 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.509434 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31505b-60f5-408f-a54f-5d8e106a2af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.509547 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31505b-60f5-408f-a54f-5d8e106a2af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.510260 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31505b-60f5-408f-a54f-5d8e106a2af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.512039 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31505b-60f5-408f-a54f-5d8e106a2af6 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.517213 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 788/1602] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:47:33 2022] POST /identity/v3/users => generated 283 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:33.521732 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55752683-bd3d-461f-a883-df4b533b8ff0 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.525650 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 815/1603] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:33.529625 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31505b-60f5-408f-a54f-5d8e106a2af6 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.532144 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55752683-bd3d-461f-a883-df4b533b8ff0 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.537188 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11737f0-8345-47ad-9d6a-58ce68f3da88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.537959 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11737f0-8345-47ad-9d6a-58ce68f3da88 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.538304 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11737f0-8345-47ad-9d6a-58ce68f3da88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.538671 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11737f0-8345-47ad-9d6a-58ce68f3da88 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.539490 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11737f0-8345-47ad-9d6a-58ce68f3da88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.539942 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31505b-60f5-408f-a54f-5d8e106a2af6 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.541272 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11737f0-8345-47ad-9d6a-58ce68f3da88 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.544875 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e1498-0863-4790-b946-ba44a92c5573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.545800 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e1498-0863-4790-b946-ba44a92c5573 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.546082 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e1498-0863-4790-b946-ba44a92c5573 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.546352 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e1498-0863-4790-b946-ba44a92c5573 admin admin] PATH_INFO: `/v3/projects/4be23531f9014bfebfd2d51c8502d6ce/users/8c5ac449d0494ab585c0aeccb9541016/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.552675 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 789/1604] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:33.557029 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11737f0-8345-47ad-9d6a-58ce68f3da88 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.562356 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e1498-0863-4790-b946-ba44a92c5573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be23531f9014bfebfd2d51c8502d6ce, user_id=8c5ac449d0494ab585c0aeccb9541016, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.565164 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e1498-0863-4790-b946-ba44a92c5573 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.569063 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11737f0-8345-47ad-9d6a-58ce68f3da88 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.574466 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbdaa9-1570-4a3a-9798-092dbabf0970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.575319 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbdaa9-1570-4a3a-9798-092dbabf0970 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.575889 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbdaa9-1570-4a3a-9798-092dbabf0970 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.576123 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbdaa9-1570-4a3a-9798-092dbabf0970 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.577086 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbdaa9-1570-4a3a-9798-092dbabf0970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.578763 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbdaa9-1570-4a3a-9798-092dbabf0970 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.584223 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 816/1605] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:33 2022] PUT /identity/v3/projects/4be23531f9014bfebfd2d51c8502d6ce/users/8c5ac449d0494ab585c0aeccb9541016/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:33.584223 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e1498-0863-4790-b946-ba44a92c5573 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.593663 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 790/1606] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:33.594539 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbdaa9-1570-4a3a-9798-092dbabf0970 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.604965 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbdaa9-1570-4a3a-9798-092dbabf0970 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.652483 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e1498-0863-4790-b946-ba44a92c5573 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.657489 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa2e89-91f0-43d1-80de-870dedb5143c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.658392 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa2e89-91f0-43d1-80de-870dedb5143c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.658709 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa2e89-91f0-43d1-80de-870dedb5143c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.658969 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa2e89-91f0-43d1-80de-870dedb5143c admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.659775 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa2e89-91f0-43d1-80de-870dedb5143c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.661388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa2e89-91f0-43d1-80de-870dedb5143c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.666980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac348d-457c-49f7-8389-b0e13a2f4068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.667685 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac348d-457c-49f7-8389-b0e13a2f4068 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.667967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac348d-457c-49f7-8389-b0e13a2f4068 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.668238 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac348d-457c-49f7-8389-b0e13a2f4068 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.668976 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac348d-457c-49f7-8389-b0e13a2f4068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.670565 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac348d-457c-49f7-8389-b0e13a2f4068 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.674024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 817/1607] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:33.677855 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa2e89-91f0-43d1-80de-870dedb5143c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.684304 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 791/1608] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:33.684304 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac348d-457c-49f7-8389-b0e13a2f4068 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.690267 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa2e89-91f0-43d1-80de-870dedb5143c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.693112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac348d-457c-49f7-8389-b0e13a2f4068 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.695354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef4d33-c103-4a9a-ba40-5b4ddd00838e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.696081 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef4d33-c103-4a9a-ba40-5b4ddd00838e admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.696343 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef4d33-c103-4a9a-ba40-5b4ddd00838e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.696645 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef4d33-c103-4a9a-ba40-5b4ddd00838e admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.697343 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef4d33-c103-4a9a-ba40-5b4ddd00838e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.697781 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a03271-93e0-4160-adf2-c0546d86cf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.698439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a03271-93e0-4160-adf2-c0546d86cf52 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.698716 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a03271-93e0-4160-adf2-c0546d86cf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.698953 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef4d33-c103-4a9a-ba40-5b4ddd00838e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.699065 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a03271-93e0-4160-adf2-c0546d86cf52 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.699735 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a03271-93e0-4160-adf2-c0546d86cf52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.701321 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a03271-93e0-4160-adf2-c0546d86cf52 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.709245 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 818/1609] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:33.709245 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef4d33-c103-4a9a-ba40-5b4ddd00838e admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.712587 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 792/1610] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:33.713481 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d05a0-f266-40dc-bdca-65fb250203ca None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.713911 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d05a0-f266-40dc-bdca-65fb250203ca None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.714187 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d05a0-f266-40dc-bdca-65fb250203ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.723856 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef4d33-c103-4a9a-ba40-5b4ddd00838e admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.732724 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-c49d05a0-f266-40dc-bdca-65fb250203ca None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:33.733625 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-c49d05a0-f266-40dc-bdca-65fb250203ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:33.741514 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 793/1611] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:33.742388 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d05a0-f266-40dc-bdca-65fb250203ca None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.743263 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31548fd8-c98b-415c-b947-3b6df98fb046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.744211 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31548fd8-c98b-415c-b947-3b6df98fb046 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.747816 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31548fd8-c98b-415c-b947-3b6df98fb046 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.749260 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31548fd8-c98b-415c-b947-3b6df98fb046 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.750735 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31548fd8-c98b-415c-b947-3b6df98fb046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.752639 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d05a0-f266-40dc-bdca-65fb250203ca None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.752907 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31548fd8-c98b-415c-b947-3b6df98fb046 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.758131 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eff045-2dad-452c-b999-d9f4df7f456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.759063 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eff045-2dad-452c-b999-d9f4df7f456d admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.759353 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eff045-2dad-452c-b999-d9f4df7f456d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.759623 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eff045-2dad-452c-b999-d9f4df7f456d admin admin] PATH_INFO: `/v3/projects/07d9a12650304c4e92265bc0cfccca59/users/a554bead9589408985f3d09594e86d2d/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.765395 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 819/1612] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:33.766398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31548fd8-c98b-415c-b947-3b6df98fb046 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.776675 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31548fd8-c98b-415c-b947-3b6df98fb046 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.780349 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eff045-2dad-452c-b999-d9f4df7f456d admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d9a12650304c4e92265bc0cfccca59, user_id=a554bead9589408985f3d09594e86d2d, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.781892 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7a9c0-ff6d-420d-a8b0-73ee2c2c8b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.782615 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7a9c0-ff6d-420d-a8b0-73ee2c2c8b82 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.782895 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7a9c0-ff6d-420d-a8b0-73ee2c2c8b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.783166 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7a9c0-ff6d-420d-a8b0-73ee2c2c8b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.783941 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7a9c0-ff6d-420d-a8b0-73ee2c2c8b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.784243 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eff045-2dad-452c-b999-d9f4df7f456d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.785567 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7a9c0-ff6d-420d-a8b0-73ee2c2c8b82 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.797357 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 820/1613] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:33.798340 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7a9c0-ff6d-420d-a8b0-73ee2c2c8b82 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.812814 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 794/1614] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:33 2022] PUT /identity/v3/projects/07d9a12650304c4e92265bc0cfccca59/users/a554bead9589408985f3d09594e86d2d/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:33.812814 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eff045-2dad-452c-b999-d9f4df7f456d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.816288 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7a9c0-ff6d-420d-a8b0-73ee2c2c8b82 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.871637 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eff045-2dad-452c-b999-d9f4df7f456d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.876276 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f02d0b-7357-4ab4-9dee-f8307b9d18c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.876955 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f02d0b-7357-4ab4-9dee-f8307b9d18c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.877236 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f02d0b-7357-4ab4-9dee-f8307b9d18c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.877504 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f02d0b-7357-4ab4-9dee-f8307b9d18c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.878373 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f02d0b-7357-4ab4-9dee-f8307b9d18c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.880528 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f02d0b-7357-4ab4-9dee-f8307b9d18c0 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.882214 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c130af-12fd-43f3-997c-dc7598ed673c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.883440 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c130af-12fd-43f3-997c-dc7598ed673c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.883967 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c130af-12fd-43f3-997c-dc7598ed673c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.884561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c130af-12fd-43f3-997c-dc7598ed673c admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.885916 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c130af-12fd-43f3-997c-dc7598ed673c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.888517 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c130af-12fd-43f3-997c-dc7598ed673c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.902301 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 795/1615] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:33.902301 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f02d0b-7357-4ab4-9dee-f8307b9d18c0 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.903044 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 821/1616] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:33.903044 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c130af-12fd-43f3-997c-dc7598ed673c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.914607 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f02d0b-7357-4ab4-9dee-f8307b9d18c0 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:33.919437 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d4886-cecf-4b5b-aded-0950b74d4321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:33.920391 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d4886-cecf-4b5b-aded-0950b74d4321 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:33.920668 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d4886-cecf-4b5b-aded-0950b74d4321 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:33.920933 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d4886-cecf-4b5b-aded-0950b74d4321 admin admin] PATH_INFO: `/v3/projects/b731c137a19649a193f5a7da2315b01a/users/b56f7c0ce6da4c068ce6a2720a093bb2/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:33.938490 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d4886-cecf-4b5b-aded-0950b74d4321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b731c137a19649a193f5a7da2315b01a, user_id=b56f7c0ce6da4c068ce6a2720a093bb2, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:33.941294 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d4886-cecf-4b5b-aded-0950b74d4321 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:33.958853 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 796/1617] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:33 2022] PUT /identity/v3/projects/b731c137a19649a193f5a7da2315b01a/users/b56f7c0ce6da4c068ce6a2720a093bb2/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:33.960149 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d4886-cecf-4b5b-aded-0950b74d4321 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:33.963946 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c130af-12fd-43f3-997c-dc7598ed673c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:34.020395 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4098f5-e6b6-4f4c-aab4-ded29f820178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:34.021060 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4098f5-e6b6-4f4c-aab4-ded29f820178 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:34.021343 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4098f5-e6b6-4f4c-aab4-ded29f820178 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:34.021616 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4098f5-e6b6-4f4c-aab4-ded29f820178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:34.034330 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d4886-cecf-4b5b-aded-0950b74d4321 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:34.039656 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754b5e3-0050-49ba-b210-108fe52f164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:34.040596 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754b5e3-0050-49ba-b210-108fe52f164f admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:34.040870 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754b5e3-0050-49ba-b210-108fe52f164f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:34.041138 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754b5e3-0050-49ba-b210-108fe52f164f admin admin] PATH_INFO: `/v3/projects/cc2f029676f249c681ad86a3f68525e4/users/0513eaec53d241f398508dec85f017d7/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:34.062104 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754b5e3-0050-49ba-b210-108fe52f164f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2f029676f249c681ad86a3f68525e4, user_id=0513eaec53d241f398508dec85f017d7, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:34.064820 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754b5e3-0050-49ba-b210-108fe52f164f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:34.079703 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 797/1618] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:33 2022] PUT /identity/v3/projects/cc2f029676f249c681ad86a3f68525e4/users/0513eaec53d241f398508dec85f017d7/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:34.080499 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754b5e3-0050-49ba-b210-108fe52f164f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:34.084255 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4098f5-e6b6-4f4c-aab4-ded29f820178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:34.085706 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4098f5-e6b6-4f4c-aab4-ded29f820178 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:34.094971 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 822/1619] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:34.096463 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48ac01-b43f-4643-98bf-d9e2b2fad7fe None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:34.096740 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48ac01-b43f-4643-98bf-d9e2b2fad7fe None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:34.097246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48ac01-b43f-4643-98bf-d9e2b2fad7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:34.129114 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-6c48ac01-b43f-4643-98bf-d9e2b2fad7fe None None] MFA Rules not processed for user `a554bead9589408985f3d09594e86d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:34.130794 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-6c48ac01-b43f-4643-98bf-d9e2b2fad7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:34.142915 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754b5e3-0050-49ba-b210-108fe52f164f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:34.148569 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4122e3-f8a5-42e9-be6c-a43b25056c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:34.149469 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4122e3-f8a5-42e9-be6c-a43b25056c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:34.149744 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4122e3-f8a5-42e9-be6c-a43b25056c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:34.150009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4122e3-f8a5-42e9-be6c-a43b25056c86 admin admin] PATH_INFO: `/v3/projects/d85ef3da3ad3436eb027c224e9ecbc9e/users/87065ba1c8f444a4bc06d19e2c1befcc/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:34.166690 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4122e3-f8a5-42e9-be6c-a43b25056c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85ef3da3ad3436eb027c224e9ecbc9e, user_id=87065ba1c8f444a4bc06d19e2c1befcc, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:34.170077 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4122e3-f8a5-42e9-be6c-a43b25056c86 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:34.199660 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 798/1620] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:34 2022] PUT /identity/v3/projects/d85ef3da3ad3436eb027c224e9ecbc9e/users/87065ba1c8f444a4bc06d19e2c1befcc/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:34.200661 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4122e3-f8a5-42e9-be6c-a43b25056c86 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:34.210990 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 823/1621] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:34.212350 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185cef3-f3ea-471d-be60-7f8b9776266c None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:34.212743 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185cef3-f3ea-471d-be60-7f8b9776266c None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:34.213102 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185cef3-f3ea-471d-be60-7f8b9776266c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:34.245462 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-7185cef3-f3ea-471d-be60-7f8b9776266c None None] MFA Rules not processed for user `5883f052c7b64d74b361cd1c8f689061`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:34.247150 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-7185cef3-f3ea-471d-be60-7f8b9776266c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:34.270097 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4122e3-f8a5-42e9-be6c-a43b25056c86 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:34.279215 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a35414-58d7-4326-a9c1-0399cb355b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:34.280276 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a35414-58d7-4326-a9c1-0399cb355b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:34.280731 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a35414-58d7-4326-a9c1-0399cb355b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:34.281075 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a35414-58d7-4326-a9c1-0399cb355b9f admin admin] PATH_INFO: `/v3/projects/fa8a84712949453485b7d57a7933fda7/users/74258dc93cea4d37af7553c438edf4de/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:34.298065 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a35414-58d7-4326-a9c1-0399cb355b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8a84712949453485b7d57a7933fda7, user_id=74258dc93cea4d37af7553c438edf4de, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:34.301807 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a35414-58d7-4326-a9c1-0399cb355b9f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:34.317874 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 799/1622] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:34 2022] PUT /identity/v3/projects/fa8a84712949453485b7d57a7933fda7/users/74258dc93cea4d37af7553c438edf4de/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:34.318962 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a35414-58d7-4326-a9c1-0399cb355b9f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:34.339720 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 824/1623] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:34.339720 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae370b4-4fcb-4cbd-b676-b3ca546755ee None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:34.339720 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae370b4-4fcb-4cbd-b676-b3ca546755ee None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:34.339720 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae370b4-4fcb-4cbd-b676-b3ca546755ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:34.377579 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-7ae370b4-4fcb-4cbd-b676-b3ca546755ee None None] MFA Rules not processed for user `b56f7c0ce6da4c068ce6a2720a093bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:34.379707 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-7ae370b4-4fcb-4cbd-b676-b3ca546755ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:34.411031 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a35414-58d7-4326-a9c1-0399cb355b9f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:34.416816 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98af683-dd7a-4cfa-9100-3c96edad5a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:34.417645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98af683-dd7a-4cfa-9100-3c96edad5a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:34.417922 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98af683-dd7a-4cfa-9100-3c96edad5a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:34.418189 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98af683-dd7a-4cfa-9100-3c96edad5a97 admin admin] PATH_INFO: `/v3/projects/de46aa3bf673456885b6c388c16c901b/users/c7c2b5d01a124f3e94bc557b641f77a1/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:34.433784 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98af683-dd7a-4cfa-9100-3c96edad5a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de46aa3bf673456885b6c388c16c901b, user_id=c7c2b5d01a124f3e94bc557b641f77a1, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:34.436874 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98af683-dd7a-4cfa-9100-3c96edad5a97 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:34.452769 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 825/1624] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:34.452769 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b95cab-cbe4-4adf-b634-ade6a3b4517c None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:34.452769 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b95cab-cbe4-4adf-b634-ade6a3b4517c None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:34.452769 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b95cab-cbe4-4adf-b634-ade6a3b4517c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:34.455408 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 800/1625] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:34 2022] PUT /identity/v3/projects/de46aa3bf673456885b6c388c16c901b/users/c7c2b5d01a124f3e94bc557b641f77a1/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:34.457107 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376642d6-11bd-422b-8566-12ee88b375b7 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:34.457393 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376642d6-11bd-422b-8566-12ee88b375b7 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:34.457664 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376642d6-11bd-422b-8566-12ee88b375b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:34.478172 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-a8b95cab-cbe4-4adf-b634-ade6a3b4517c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:34.479811 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-a8b95cab-cbe4-4adf-b634-ade6a3b4517c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:34.486899 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-376642d6-11bd-422b-8566-12ee88b375b7 None None] MFA Rules not processed for user `87065ba1c8f444a4bc06d19e2c1befcc`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:34.488304 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-376642d6-11bd-422b-8566-12ee88b375b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:34.599970 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 826/1626] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:34.599970 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b95cab-cbe4-4adf-b634-ade6a3b4517c None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:34.616339 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b95cab-cbe4-4adf-b634-ade6a3b4517c None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:34.618843 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 801/1627] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:34.627194 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1811c26-b126-4d30-89f3-2a532af75d1e None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:34.632361 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1811c26-b126-4d30-89f3-2a532af75d1e None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:34.632361 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1811c26-b126-4d30-89f3-2a532af75d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:34.636858 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15617653-7dab-4190-8c03-49c33c88d6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:34.637632 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15617653-7dab-4190-8c03-49c33c88d6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:34.637991 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15617653-7dab-4190-8c03-49c33c88d6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:34.638268 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15617653-7dab-4190-8c03-49c33c88d6e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:34.638986 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15617653-7dab-4190-8c03-49c33c88d6e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:34.640953 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15617653-7dab-4190-8c03-49c33c88d6e3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:34.670450 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-e1811c26-b126-4d30-89f3-2a532af75d1e None None] MFA Rules not processed for user `74258dc93cea4d37af7553c438edf4de`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:34.671655 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e1811c26-b126-4d30-89f3-2a532af75d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:34.684818 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 827/1628] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:47:34 2022] POST /identity/v3/projects => generated 369 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:34.686899 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14034233-4a9e-406c-a515-b95195dfb110 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:34.687190 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14034233-4a9e-406c-a515-b95195dfb110 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:34.687465 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14034233-4a9e-406c-a515-b95195dfb110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:34.707948 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-14034233-4a9e-406c-a515-b95195dfb110 None None] MFA Rules not processed for user `5883f052c7b64d74b361cd1c8f689061`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:34.709180 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-14034233-4a9e-406c-a515-b95195dfb110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:34.779646 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 828/1629] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:34.781016 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc41276-025b-4876-a4db-66974adde3fb None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:34.781389 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc41276-025b-4876-a4db-66974adde3fb None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:34.781758 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc41276-025b-4876-a4db-66974adde3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:34.793237 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 802/1630] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:34.797129 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1811c26-b126-4d30-89f3-2a532af75d1e None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:34.808333 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-fdc41276-025b-4876-a4db-66974adde3fb None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:34.810340 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-fdc41276-025b-4876-a4db-66974adde3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:34.866841 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1811c26-b126-4d30-89f3-2a532af75d1e None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:34.890045 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 829/1631] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:34.890911 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc41276-025b-4876-a4db-66974adde3fb None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:34.967073 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533d9c-dc2f-415c-9786-a518908d3874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:34.968168 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533d9c-dc2f-415c-9786-a518908d3874 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:34.968911 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533d9c-dc2f-415c-9786-a518908d3874 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:34.969514 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533d9c-dc2f-415c-9786-a518908d3874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:34.983799 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc41276-025b-4876-a4db-66974adde3fb None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:34.996969 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895bd31-9133-4f41-af30-b2a07a4ee8e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:34.998776 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895bd31-9133-4f41-af30-b2a07a4ee8e8 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:34.998776 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895bd31-9133-4f41-af30-b2a07a4ee8e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:34.998776 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895bd31-9133-4f41-af30-b2a07a4ee8e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:35.011656 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895bd31-9133-4f41-af30-b2a07a4ee8e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:35.013772 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895bd31-9133-4f41-af30-b2a07a4ee8e8 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:35.030616 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 830/1632] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:35.032005 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895bd31-9133-4f41-af30-b2a07a4ee8e8 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:35.044791 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895bd31-9133-4f41-af30-b2a07a4ee8e8 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:35.054673 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744cfbf-0c29-49a1-9651-377fa03c7b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:35.055379 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744cfbf-0c29-49a1-9651-377fa03c7b43 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:35.055814 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744cfbf-0c29-49a1-9651-377fa03c7b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:35.056020 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b533d9c-dc2f-415c-9786-a518908d3874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:35.056171 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744cfbf-0c29-49a1-9651-377fa03c7b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:35.056786 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744cfbf-0c29-49a1-9651-377fa03c7b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:35.057491 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b533d9c-dc2f-415c-9786-a518908d3874 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:35.058694 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744cfbf-0c29-49a1-9651-377fa03c7b43 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:35.071292 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 803/1633] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:34 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:35.073355 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533d9c-dc2f-415c-9786-a518908d3874 service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:35.087043 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533d9c-dc2f-415c-9786-a518908d3874 service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:35.093262 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fff93-b23a-4627-a838-e70d272732d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:35.094109 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fff93-b23a-4627-a838-e70d272732d8 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:35.094388 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fff93-b23a-4627-a838-e70d272732d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:35.094535 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 831/1634] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:47:35 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:35.094759 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fff93-b23a-4627-a838-e70d272732d8 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:35.095317 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744cfbf-0c29-49a1-9651-377fa03c7b43 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:35.095476 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fff93-b23a-4627-a838-e70d272732d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:35.097619 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fff93-b23a-4627-a838-e70d272732d8 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:35.127875 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 804/1635] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:47:35 2022] POST /identity/v3/users => generated 291 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:35.132032 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95f699-0157-4f61-a12f-d91bf1ed8410 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:35.132644 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95f699-0157-4f61-a12f-d91bf1ed8410 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:35.132644 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95f699-0157-4f61-a12f-d91bf1ed8410 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:35.136202 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 805/1636] 10.222.0.13 () {54 vars in 961 bytes} [Mon Jan 10 12:47:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:47:35.136889 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95f699-0157-4f61-a12f-d91bf1ed8410 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:35.178649 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744cfbf-0c29-49a1-9651-377fa03c7b43 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:35.183725 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a305c-6a70-4380-9713-481fe82b71a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:35.185251 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a305c-6a70-4380-9713-481fe82b71a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:35.186623 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a305c-6a70-4380-9713-481fe82b71a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:35.186909 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a305c-6a70-4380-9713-481fe82b71a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:35.187668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a305c-6a70-4380-9713-481fe82b71a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:35.190620 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a305c-6a70-4380-9713-481fe82b71a6 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:35.216172 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95f699-0157-4f61-a12f-d91bf1ed8410 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:35.221369 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1c06c-5f92-472e-9f29-33ac4573b2f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:35.222486 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1c06c-5f92-472e-9f29-33ac4573b2f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:35.223138 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1c06c-5f92-472e-9f29-33ac4573b2f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:35.223653 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1c06c-5f92-472e-9f29-33ac4573b2f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:35.229381 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 832/1637] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:47:35 2022] POST /identity/v3/projects => generated 363 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:35.229381 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a305c-6a70-4380-9713-481fe82b71a6 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:35.241505 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1c06c-5f92-472e-9f29-33ac4573b2f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:35.243889 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1c06c-5f92-472e-9f29-33ac4573b2f8 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:35.258026 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 806/1638] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:35.259314 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1c06c-5f92-472e-9f29-33ac4573b2f8 service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:35.273801 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1c06c-5f92-472e-9f29-33ac4573b2f8 service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:35.321080 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a305c-6a70-4380-9713-481fe82b71a6 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:35.326979 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b4a97-bc03-478e-b7ba-c89b14964a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:35.327881 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b4a97-bc03-478e-b7ba-c89b14964a9f admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:35.328151 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b4a97-bc03-478e-b7ba-c89b14964a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:35.328418 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b4a97-bc03-478e-b7ba-c89b14964a9f admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:35.329761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b4a97-bc03-478e-b7ba-c89b14964a9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:35.331212 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b4a97-bc03-478e-b7ba-c89b14964a9f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:35.366854 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 833/1639] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:47:35 2022] POST /identity/v3/users => generated 296 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:35.370282 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c25d5-4210-4478-b042-38765aa4a1b8 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:35.371501 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c25d5-4210-4478-b042-38765aa4a1b8 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:35.371796 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c25d5-4210-4478-b042-38765aa4a1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:35.397580 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f0bfe-9c80-421a-9148-a31bfb234758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:35.398287 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f0bfe-9c80-421a-9148-a31bfb234758 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:35.398609 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f0bfe-9c80-421a-9148-a31bfb234758 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:35.398879 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f0bfe-9c80-421a-9148-a31bfb234758 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:35.401050 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f0bfe-9c80-421a-9148-a31bfb234758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:35.404557 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f0bfe-9c80-421a-9148-a31bfb234758 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:35.416572 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-2f9c25d5-4210-4478-b042-38765aa4a1b8 None None] MFA Rules not processed for user `d68fa8e4f3a341a5b74ee32c85e59869`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:35.417845 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-2f9c25d5-4210-4478-b042-38765aa4a1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:35.430684 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 807/1640] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:35.430684 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f0bfe-9c80-421a-9148-a31bfb234758 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:35.449672 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f0bfe-9c80-421a-9148-a31bfb234758 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:35.462660 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf065ad-9f8a-4b98-8adc-c781e3d6db2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:35.463368 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf065ad-9f8a-4b98-8adc-c781e3d6db2f admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:35.463704 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf065ad-9f8a-4b98-8adc-c781e3d6db2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:35.463978 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf065ad-9f8a-4b98-8adc-c781e3d6db2f admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:35.464829 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf065ad-9f8a-4b98-8adc-c781e3d6db2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:35.469531 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf065ad-9f8a-4b98-8adc-c781e3d6db2f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:35.523240 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 808/1641] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:47:35 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:35.524190 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf065ad-9f8a-4b98-8adc-c781e3d6db2f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:35.548005 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf065ad-9f8a-4b98-8adc-c781e3d6db2f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:35.568458 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 834/1642] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Jan 10 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:35.569339 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c25d5-4210-4478-b042-38765aa4a1b8 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:35.571850 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d539d4b-beb3-4a75-aaa2-d0d0abf984ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:35.571850 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d539d4b-beb3-4a75-aaa2-d0d0abf984ea admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:35.571850 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d539d4b-beb3-4a75-aaa2-d0d0abf984ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:35.572104 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d539d4b-beb3-4a75-aaa2-d0d0abf984ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:35.572782 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d539d4b-beb3-4a75-aaa2-d0d0abf984ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:35.575782 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d539d4b-beb3-4a75-aaa2-d0d0abf984ea admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:35.595506 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c25d5-4210-4478-b042-38765aa4a1b8 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:35.597686 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 809/1643] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:35.598865 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d539d4b-beb3-4a75-aaa2-d0d0abf984ea admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:35.606918 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06df5d-7feb-4813-a186-9fda4014909a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:35.607854 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06df5d-7feb-4813-a186-9fda4014909a admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:35.608164 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06df5d-7feb-4813-a186-9fda4014909a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:35.608429 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06df5d-7feb-4813-a186-9fda4014909a admin admin] PATH_INFO: `/v3/projects/8081686877274ec691ea5ea13d3d9bfc/users/87de8f4a57934127b11965006d94397b/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:35.619100 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d539d4b-beb3-4a75-aaa2-d0d0abf984ea admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:35.628459 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06df5d-7feb-4813-a186-9fda4014909a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8081686877274ec691ea5ea13d3d9bfc, user_id=87de8f4a57934127b11965006d94397b, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:35.632079 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06df5d-7feb-4813-a186-9fda4014909a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:35.633767 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93433846-46af-4aa5-98f3-7c63c07180a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:35.634564 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93433846-46af-4aa5-98f3-7c63c07180a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:35.634848 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93433846-46af-4aa5-98f3-7c63c07180a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:35.635243 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93433846-46af-4aa5-98f3-7c63c07180a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:35.636177 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93433846-46af-4aa5-98f3-7c63c07180a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:35.639267 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93433846-46af-4aa5-98f3-7c63c07180a7 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:35.649904 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 835/1644] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:35 2022] PUT /identity/v3/projects/8081686877274ec691ea5ea13d3d9bfc/users/87de8f4a57934127b11965006d94397b/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:35.651634 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06df5d-7feb-4813-a186-9fda4014909a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:35.662912 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 810/1645] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:35.666841 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93433846-46af-4aa5-98f3-7c63c07180a7 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:35.680411 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93433846-46af-4aa5-98f3-7c63c07180a7 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:35.766373 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06df5d-7feb-4813-a186-9fda4014909a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:35.776565 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c78f26-28d2-4e67-98fa-c6954086a606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:35.776790 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc831ea-ae2d-4194-8f32-d3edc08abc76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:35.777373 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc831ea-ae2d-4194-8f32-d3edc08abc76 service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:35.777649 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc831ea-ae2d-4194-8f32-d3edc08abc76 service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:35.777773 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c78f26-28d2-4e67-98fa-c6954086a606 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:35.777921 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc831ea-ae2d-4194-8f32-d3edc08abc76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:35.778182 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c78f26-28d2-4e67-98fa-c6954086a606 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:35.778599 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c78f26-28d2-4e67-98fa-c6954086a606 admin admin] PATH_INFO: `/v3/projects/380288d7425a41e98d3acdca88a72e97/users/2753de43fcae4ffc9b9ca158ea1f1ee9/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:35.819566 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c78f26-28d2-4e67-98fa-c6954086a606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380288d7425a41e98d3acdca88a72e97, user_id=2753de43fcae4ffc9b9ca158ea1f1ee9, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:35.822524 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c78f26-28d2-4e67-98fa-c6954086a606 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:35.865126 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 811/1646] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:35 2022] PUT /identity/v3/projects/380288d7425a41e98d3acdca88a72e97/users/2753de43fcae4ffc9b9ca158ea1f1ee9/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:35.866451 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c78f26-28d2-4e67-98fa-c6954086a606 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:35.940555 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc831ea-ae2d-4194-8f32-d3edc08abc76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:35.945141 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc831ea-ae2d-4194-8f32-d3edc08abc76 service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:35.983967 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 836/1647] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:35.984938 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc831ea-ae2d-4194-8f32-d3edc08abc76 service nova] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:35.997955 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c78f26-28d2-4e67-98fa-c6954086a606 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:36.004908 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04b03c-1fec-4dbe-9223-3b4be3ee9257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:36.005833 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04b03c-1fec-4dbe-9223-3b4be3ee9257 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:36.006484 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04b03c-1fec-4dbe-9223-3b4be3ee9257 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:36.006917 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc831ea-ae2d-4194-8f32-d3edc08abc76 service nova] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:36.007073 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04b03c-1fec-4dbe-9223-3b4be3ee9257 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:36.008040 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04b03c-1fec-4dbe-9223-3b4be3ee9257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:36.010689 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04b03c-1fec-4dbe-9223-3b4be3ee9257 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:36.022457 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b168c1-3c39-443e-ba43-c8cae6b48f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:36.023636 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b168c1-3c39-443e-ba43-c8cae6b48f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:36.024046 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b168c1-3c39-443e-ba43-c8cae6b48f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:36.024506 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b168c1-3c39-443e-ba43-c8cae6b48f73 admin admin] PATH_INFO: `/v3/projects/482cb17cc95d4e8c989f4d1ffcbbc14e/users/dc366453efaa427b90446c616814e7f6/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:36.025711 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 812/1648] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:36.030873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04b03c-1fec-4dbe-9223-3b4be3ee9257 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:36.046104 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04b03c-1fec-4dbe-9223-3b4be3ee9257 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:36.053390 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a6b33-01aa-4dfc-8170-fdd68d6ecaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:36.054447 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6b33-01aa-4dfc-8170-fdd68d6ecaba admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:36.054942 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6b33-01aa-4dfc-8170-fdd68d6ecaba admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:36.056229 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b168c1-3c39-443e-ba43-c8cae6b48f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=482cb17cc95d4e8c989f4d1ffcbbc14e, user_id=dc366453efaa427b90446c616814e7f6, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:36.057729 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a6b33-01aa-4dfc-8170-fdd68d6ecaba admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:36.058787 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a6b33-01aa-4dfc-8170-fdd68d6ecaba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:36.059021 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b168c1-3c39-443e-ba43-c8cae6b48f73 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:36.062078 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a6b33-01aa-4dfc-8170-fdd68d6ecaba admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:36.081262 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 813/1650] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:36.081262 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a6b33-01aa-4dfc-8170-fdd68d6ecaba admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:36.081833 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 837/1650] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:35 2022] PUT /identity/v3/projects/482cb17cc95d4e8c989f4d1ffcbbc14e/users/dc366453efaa427b90446c616814e7f6/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:36.083049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b168c1-3c39-443e-ba43-c8cae6b48f73 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:36.092393 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a6b33-01aa-4dfc-8170-fdd68d6ecaba admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:36.149101 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b168c1-3c39-443e-ba43-c8cae6b48f73 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:36.155206 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d62a5a-24e0-4c5b-93c5-cf7408484bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:36.155658 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d62a5a-24e0-4c5b-93c5-cf7408484bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:36.155935 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d62a5a-24e0-4c5b-93c5-cf7408484bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:36.156203 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d62a5a-24e0-4c5b-93c5-cf7408484bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:36.156944 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d62a5a-24e0-4c5b-93c5-cf7408484bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:36.158849 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d62a5a-24e0-4c5b-93c5-cf7408484bb7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:36.170151 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 838/1651] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:36.174163 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d62a5a-24e0-4c5b-93c5-cf7408484bb7 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:36.185362 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d62a5a-24e0-4c5b-93c5-cf7408484bb7 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:36.192157 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdea904-db44-4c70-ad05-2ffee8f9f39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:36.193139 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdea904-db44-4c70-ad05-2ffee8f9f39a admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:36.193343 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdea904-db44-4c70-ad05-2ffee8f9f39a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:36.193594 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdea904-db44-4c70-ad05-2ffee8f9f39a admin admin] PATH_INFO: `/v3/projects/380288d7425a41e98d3acdca88a72e97/users/2753de43fcae4ffc9b9ca158ea1f1ee9/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:36.196003 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdea904-db44-4c70-ad05-2ffee8f9f39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=380288d7425a41e98d3acdca88a72e97, user_id=2753de43fcae4ffc9b9ca158ea1f1ee9, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:36.198806 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdea904-db44-4c70-ad05-2ffee8f9f39a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:36.205153 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532b2b4-e3bc-4561-9162-998a2eff1a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:36.206071 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532b2b4-e3bc-4561-9162-998a2eff1a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:36.206396 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532b2b4-e3bc-4561-9162-998a2eff1a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:36.206664 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532b2b4-e3bc-4561-9162-998a2eff1a47 admin admin] PATH_INFO: `/v3/projects/8081686877274ec691ea5ea13d3d9bfc/users/87de8f4a57934127b11965006d94397b/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:36.296965 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 839/1652] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:36 2022] PUT /identity/v3/projects/380288d7425a41e98d3acdca88a72e97/users/2753de43fcae4ffc9b9ca158ea1f1ee9/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:36.296965 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdea904-db44-4c70-ad05-2ffee8f9f39a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:36.297235 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532b2b4-e3bc-4561-9162-998a2eff1a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8081686877274ec691ea5ea13d3d9bfc, user_id=87de8f4a57934127b11965006d94397b, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:36.297235 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532b2b4-e3bc-4561-9162-998a2eff1a47 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:36.297235 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 814/1653] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:36 2022] PUT /identity/v3/projects/8081686877274ec691ea5ea13d3d9bfc/users/87de8f4a57934127b11965006d94397b/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:36.297235 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870eee5-67ae-4237-b0c8-9093d5b34502 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:36.297235 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870eee5-67ae-4237-b0c8-9093d5b34502 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:36.297235 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870eee5-67ae-4237-b0c8-9093d5b34502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:36.375135 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-2870eee5-67ae-4237-b0c8-9093d5b34502 None None] MFA Rules not processed for user `2753de43fcae4ffc9b9ca158ea1f1ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:36.376423 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-2870eee5-67ae-4237-b0c8-9093d5b34502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:36.379663 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdea904-db44-4c70-ad05-2ffee8f9f39a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:36.462162 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae2e73-bc20-498f-8299-1b8b9b9956e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:36.464389 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae2e73-bc20-498f-8299-1b8b9b9956e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:36.464682 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae2e73-bc20-498f-8299-1b8b9b9956e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:36.465014 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae2e73-bc20-498f-8299-1b8b9b9956e4 admin admin] PATH_INFO: `/v3/projects/482cb17cc95d4e8c989f4d1ffcbbc14e/users/dc366453efaa427b90446c616814e7f6/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:36.468311 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae2e73-bc20-498f-8299-1b8b9b9956e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=482cb17cc95d4e8c989f4d1ffcbbc14e, user_id=dc366453efaa427b90446c616814e7f6, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:36.470446 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 815/1654] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:36.471613 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae2e73-bc20-498f-8299-1b8b9b9956e4 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:36.476067 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c873cf-210a-47bb-a536-99f10aecf71a None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:36.477580 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c873cf-210a-47bb-a536-99f10aecf71a None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:36.477864 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c873cf-210a-47bb-a536-99f10aecf71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:36.501667 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 840/1655] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:36 2022] PUT /identity/v3/projects/482cb17cc95d4e8c989f4d1ffcbbc14e/users/dc366453efaa427b90446c616814e7f6/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:36.517872 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8a6bf-6874-4f5e-9674-5f6cc35f7c81 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:36.518259 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8a6bf-6874-4f5e-9674-5f6cc35f7c81 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:36.518470 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8a6bf-6874-4f5e-9674-5f6cc35f7c81 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:36.521523 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-62c873cf-210a-47bb-a536-99f10aecf71a None None] MFA Rules not processed for user `87de8f4a57934127b11965006d94397b`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:36.523374 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-62c873cf-210a-47bb-a536-99f10aecf71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:36.534584 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 841/1656] 10.222.0.13 () {54 vars in 912 bytes} [Mon Jan 10 12:47:36 2022] GET /identity => generated 270 bytes in 32 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:47:36.536595 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8a6bf-6874-4f5e-9674-5f6cc35f7c81 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:36.674180 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 816/1657] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:36 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:36.674180 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a419fab-4b48-4d84-89df-581bb573059d None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:36.674180 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a419fab-4b48-4d84-89df-581bb573059d None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:36.674180 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a419fab-4b48-4d84-89df-581bb573059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:36.677818 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8a6bf-6874-4f5e-9674-5f6cc35f7c81 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:36.682495 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10623a28-0bbf-491a-ad74-610313be0d5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:36.682495 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10623a28-0bbf-491a-ad74-610313be0d5e service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:36.682971 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10623a28-0bbf-491a-ad74-610313be0d5e service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:36.683310 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10623a28-0bbf-491a-ad74-610313be0d5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:36.722181 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-1a419fab-4b48-4d84-89df-581bb573059d None None] MFA Rules not processed for user `d68fa8e4f3a341a5b74ee32c85e59869`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:36.723595 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-1a419fab-4b48-4d84-89df-581bb573059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:36.781093 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10623a28-0bbf-491a-ad74-610313be0d5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:36.782618 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10623a28-0bbf-491a-ad74-610313be0d5e service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:36.794145 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 842/1658] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:36.795524 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d7646-3987-4a6d-bf46-10fa290e992d None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:36.795824 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d7646-3987-4a6d-bf46-10fa290e992d None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:36.796100 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d7646-3987-4a6d-bf46-10fa290e992d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:36.832477 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-468d7646-3987-4a6d-bf46-10fa290e992d None None] MFA Rules not processed for user `dc366453efaa427b90446c616814e7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:36.834127 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-468d7646-3987-4a6d-bf46-10fa290e992d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:36.880633 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 817/1659] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jan 10 12:47:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:36.881519 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a419fab-4b48-4d84-89df-581bb573059d None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:36.908160 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a419fab-4b48-4d84-89df-581bb573059d None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:36.913104 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8867a-05de-471d-830e-d630ab0132a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:36.917862 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8867a-05de-471d-830e-d630ab0132a9 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:36.918435 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8867a-05de-471d-830e-d630ab0132a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:36.921211 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 843/1660] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:36 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:36.921371 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8867a-05de-471d-830e-d630ab0132a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:36.921730 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d7646-3987-4a6d-bf46-10fa290e992d None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:36.923319 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-468d7646-3987-4a6d-bf46-10fa290e992d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:36.946438 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8867a-05de-471d-830e-d630ab0132a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:36.947981 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8867a-05de-471d-830e-d630ab0132a9 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:36.966615 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 818/1661] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:36 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:36.967721 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8867a-05de-471d-830e-d630ab0132a9 service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:36.978406 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8867a-05de-471d-830e-d630ab0132a9 service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:36.984282 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fe7a9-ed72-440b-96ae-0fa299ce2fa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:36.985161 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fe7a9-ed72-440b-96ae-0fa299ce2fa9 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:36.985561 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fe7a9-ed72-440b-96ae-0fa299ce2fa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:36.985968 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fe7a9-ed72-440b-96ae-0fa299ce2fa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:36.987279 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d7646-3987-4a6d-bf46-10fa290e992d None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:36.991663 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627edce2-f35c-4532-9708-c925751f6089 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f812f38c242d4530b3fc73013f66c9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:36.992387 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627edce2-f35c-4532-9708-c925751f6089 service glance] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:36.992662 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627edce2-f35c-4532-9708-c925751f6089 service glance] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:36.992926 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627edce2-f35c-4532-9708-c925751f6089 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:37.004304 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627edce2-f35c-4532-9708-c925751f6089 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:37.006015 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627edce2-f35c-4532-9708-c925751f6089 service glance] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:37.021942 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 844/1662] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:37.078352 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627edce2-f35c-4532-9708-c925751f6089 service glance] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:37.094350 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fe7a9-ed72-440b-96ae-0fa299ce2fa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:37.096801 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fe7a9-ed72-440b-96ae-0fa299ce2fa9 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:37.103851 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627edce2-f35c-4532-9708-c925751f6089 service glance] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:37.111158 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 819/1663] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:37.113210 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bbd50-1966-4995-adef-7f4133aec333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:37.114203 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bbd50-1966-4995-adef-7f4133aec333 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:37.114597 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bbd50-1966-4995-adef-7f4133aec333 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:37.114991 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bbd50-1966-4995-adef-7f4133aec333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:37.129100 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bbd50-1966-4995-adef-7f4133aec333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:37.131564 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bbd50-1966-4995-adef-7f4133aec333 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:37.154279 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 845/1664] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:37 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:37.282896 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fe7a9-ed72-440b-96ae-0fa299ce2fa9 service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:37.308630 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fe7a9-ed72-440b-96ae-0fa299ce2fa9 service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:37.323151 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f1313-a684-4635-8fda-256d2fd77b68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:37.324279 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f1313-a684-4635-8fda-256d2fd77b68 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:37.325566 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f1313-a684-4635-8fda-256d2fd77b68 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:37.325959 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f1313-a684-4635-8fda-256d2fd77b68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:37.477554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f1313-a684-4635-8fda-256d2fd77b68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:37.481577 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f1313-a684-4635-8fda-256d2fd77b68 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:37.502993 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bbd50-1966-4995-adef-7f4133aec333 service cinder] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:37.514172 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bbd50-1966-4995-adef-7f4133aec333 service cinder] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:37.522430 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 820/1665] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:37.525470 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db628c-2695-4ba1-94a6-78e760cdc2b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:37.527825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db628c-2695-4ba1-94a6-78e760cdc2b3 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:37.528641 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db628c-2695-4ba1-94a6-78e760cdc2b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:37.529447 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db628c-2695-4ba1-94a6-78e760cdc2b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:37.738922 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db628c-2695-4ba1-94a6-78e760cdc2b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:37.740425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db628c-2695-4ba1-94a6-78e760cdc2b3 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:37.761730 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 846/1666] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:47:37.888564 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6844b27-e617-4fe3-a0a9-7698fb4573f5 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:37.889237 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6844b27-e617-4fe3-a0a9-7698fb4573f5 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:37.889739 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6844b27-e617-4fe3-a0a9-7698fb4573f5 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:37.892352 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 821/1667] 10.222.0.13 () {54 vars in 961 bytes} [Mon Jan 10 12:47:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:47:37.901745 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd505d8-f5ba-424a-9f77-065ecc77b47e None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:37.902344 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd505d8-f5ba-424a-9f77-065ecc77b47e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:37.902843 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd505d8-f5ba-424a-9f77-065ecc77b47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:37.925157 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-cbd505d8-f5ba-424a-9f77-065ecc77b47e None None] MFA Rules not processed for user `d68fa8e4f3a341a5b74ee32c85e59869`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:37.926940 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-cbd505d8-f5ba-424a-9f77-065ecc77b47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:37.944014 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65807395-21d8-47c9-89fa-163537e69f2b None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:37.944531 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65807395-21d8-47c9-89fa-163537e69f2b None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:37.945107 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65807395-21d8-47c9-89fa-163537e69f2b None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:37.949547 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 822/1668] 10.222.0.13 () {54 vars in 912 bytes} [Mon Jan 10 12:47:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:47:37.954405 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 847/1669] 10.222.0.13 () {58 vars in 1058 bytes} [Mon Jan 10 12:47:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:37.956564 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615fe66-f049-471a-878f-d7be7ab47125 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:37.956930 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615fe66-f049-471a-878f-d7be7ab47125 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:37.957423 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615fe66-f049-471a-878f-d7be7ab47125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:37.980832 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-d615fe66-f049-471a-878f-d7be7ab47125 None None] MFA Rules not processed for user `d68fa8e4f3a341a5b74ee32c85e59869`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:37.982760 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-d615fe66-f049-471a-878f-d7be7ab47125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:38.018054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 823/1670] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jan 10 12:47:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:47:38.027768 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd505d8-f5ba-424a-9f77-065ecc77b47e None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:38.041526 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd505d8-f5ba-424a-9f77-065ecc77b47e None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:38.060306 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b30ca-eb03-49bb-b534-57b25fd77122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:38.063424 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b30ca-eb03-49bb-b534-57b25fd77122 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:38.063764 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b30ca-eb03-49bb-b534-57b25fd77122 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:38.064009 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b30ca-eb03-49bb-b534-57b25fd77122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:38.082481 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be61442-7b87-40e9-bb60-5edb92770bbe None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:38.082798 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be61442-7b87-40e9-bb60-5edb92770bbe None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:38.083053 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be61442-7b87-40e9-bb60-5edb92770bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:38.108255 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b30ca-eb03-49bb-b534-57b25fd77122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:38.110018 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b30ca-eb03-49bb-b534-57b25fd77122 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:38.145066 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-3be61442-7b87-40e9-bb60-5edb92770bbe None None] MFA Rules not processed for user `0513eaec53d241f398508dec85f017d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:38.146443 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-3be61442-7b87-40e9-bb60-5edb92770bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:38.151119 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 848/1671] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:38.269956 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faf9c4-b609-4fc6-b995-f9470394bf02 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:38.270317 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faf9c4-b609-4fc6-b995-f9470394bf02 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:38.270659 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faf9c4-b609-4fc6-b995-f9470394bf02 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:38.273135 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 849/1672] 10.222.0.13 () {54 vars in 912 bytes} [Mon Jan 10 12:47:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:47:38.278545 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc11454-e8c7-4bb8-9088-7906feeaa822 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:38.278880 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc11454-e8c7-4bb8-9088-7906feeaa822 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:38.279398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc11454-e8c7-4bb8-9088-7906feeaa822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:38.362318 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 824/1673] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:38.369033 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-0bc11454-e8c7-4bb8-9088-7906feeaa822 None None] MFA Rules not processed for user `fa3a96ff9ab74aeb88465b14de3038eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:38.371415 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-0bc11454-e8c7-4bb8-9088-7906feeaa822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:38.426555 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb8574-0223-46ae-a56e-7689a6fa4294 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:38.427146 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb8574-0223-46ae-a56e-7689a6fa4294 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:38.427610 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb8574-0223-46ae-a56e-7689a6fa4294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:38.458800 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-0ceb8574-0223-46ae-a56e-7689a6fa4294 None None] MFA Rules not processed for user `0513eaec53d241f398508dec85f017d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:38.465148 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-0ceb8574-0223-46ae-a56e-7689a6fa4294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:38.504828 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 825/1674] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:38.508915 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 850/1675] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jan 10 12:47:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:47:38.518175 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb8574-0223-46ae-a56e-7689a6fa4294 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:38.544887 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc11454-e8c7-4bb8-9088-7906feeaa822 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:38.558116 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc11454-e8c7-4bb8-9088-7906feeaa822 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:38.572373 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb8574-0223-46ae-a56e-7689a6fa4294 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:38.578077 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bc5aa-160b-447f-9650-7b5346bda637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:38.578897 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bc5aa-160b-447f-9650-7b5346bda637 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:38.579028 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bc5aa-160b-447f-9650-7b5346bda637 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:38.584278 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bc5aa-160b-447f-9650-7b5346bda637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:38.601067 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf1010-1e3d-4aee-a60d-c43e574a91fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:38.601743 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf1010-1e3d-4aee-a60d-c43e574a91fb service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:38.602021 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf1010-1e3d-4aee-a60d-c43e574a91fb service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:38.602295 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf1010-1e3d-4aee-a60d-c43e574a91fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:38.616450 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bc5aa-160b-447f-9650-7b5346bda637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:38.620803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bc5aa-160b-447f-9650-7b5346bda637 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:38.628753 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf1010-1e3d-4aee-a60d-c43e574a91fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:38.630542 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf1010-1e3d-4aee-a60d-c43e574a91fb service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:38.647577 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 851/1676] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:38.676114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 826/1677] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:47:39.768209 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6df14-6ba5-468d-aa2c-549ab9073c38 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:39.768747 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6df14-6ba5-468d-aa2c-549ab9073c38 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:39.769040 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6df14-6ba5-468d-aa2c-549ab9073c38 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:39.771099 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 852/1678] 10.222.0.13 () {54 vars in 912 bytes} [Mon Jan 10 12:47:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:47:39.782102 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2e6dc-d456-4479-ad14-fed05da9fb11 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:39.782860 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2e6dc-d456-4479-ad14-fed05da9fb11 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:39.783584 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2e6dc-d456-4479-ad14-fed05da9fb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:39.820375 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-e0a2e6dc-d456-4479-ad14-fed05da9fb11 None None] MFA Rules not processed for user `fa3a96ff9ab74aeb88465b14de3038eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:39.824407 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e0a2e6dc-d456-4479-ad14-fed05da9fb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:39.848698 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 827/1679] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jan 10 12:47:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:39.863494 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6df14-6ba5-468d-aa2c-549ab9073c38 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:39.882423 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6df14-6ba5-468d-aa2c-549ab9073c38 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:39.895632 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982c49a-3906-41bd-90dd-6ca7f44f07a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:39.896892 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982c49a-3906-41bd-90dd-6ca7f44f07a3 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:39.897388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982c49a-3906-41bd-90dd-6ca7f44f07a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:39.898055 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982c49a-3906-41bd-90dd-6ca7f44f07a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:39.924561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982c49a-3906-41bd-90dd-6ca7f44f07a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:39.929383 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982c49a-3906-41bd-90dd-6ca7f44f07a3 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:39.956466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 853/1680] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:40.115664 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2e6dc-d456-4479-ad14-fed05da9fb11 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:40.329856 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2e6dc-d456-4479-ad14-fed05da9fb11 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:40.341492 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff7b2b-e5db-46be-a286-8db009537801 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6aa01ebd7314f30a1c729ff2b50c975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:40.342418 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff7b2b-e5db-46be-a286-8db009537801 service placement] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:40.343699 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff7b2b-e5db-46be-a286-8db009537801 service placement] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:40.345072 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff7b2b-e5db-46be-a286-8db009537801 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:40.349491 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-59ff7b2b-e5db-46be-a286-8db009537801 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:40.387190 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff7b2b-e5db-46be-a286-8db009537801 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:40.394046 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff7b2b-e5db-46be-a286-8db009537801 service placement] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:40.419026 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 828/1681] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:41.197203 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982c49a-3906-41bd-90dd-6ca7f44f07a3 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:41.354729 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982c49a-3906-41bd-90dd-6ca7f44f07a3 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:41.370279 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5bc2e-26d4-4873-8cdd-213b46bf9970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:41.371639 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5bc2e-26d4-4873-8cdd-213b46bf9970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:41.371985 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5bc2e-26d4-4873-8cdd-213b46bf9970 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:41.374095 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5bc2e-26d4-4873-8cdd-213b46bf9970 admin admin] PATH_INFO: `/v3/users/74258dc93cea4d37af7553c438edf4de` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:41.376201 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5bc2e-26d4-4873-8cdd-213b46bf9970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74258dc93cea4d37af7553c438edf4de)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:41.378750 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5bc2e-26d4-4873-8cdd-213b46bf9970 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:41.451651 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-bcb5bc2e-26d4-4873-8cdd-213b46bf9970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74258dc93cea4d37af7553c438edf4de'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:41.463187 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-bcb5bc2e-26d4-4873-8cdd-213b46bf9970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74258dc93cea4d37af7553c438edf4de'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:41.500399 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-bcb5bc2e-26d4-4873-8cdd-213b46bf9970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74258dc93cea4d37af7553c438edf4de'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:41.502089 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-bcb5bc2e-26d4-4873-8cdd-213b46bf9970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74258dc93cea4d37af7553c438edf4de'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:41.504365 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-bcb5bc2e-26d4-4873-8cdd-213b46bf9970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74258dc93cea4d37af7553c438edf4de'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:41.547602 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 854/1682] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:47:41 2022] DELETE /identity/v3/users/74258dc93cea4d37af7553c438edf4de => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:41.552672 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b323f6-e258-49b6-a878-1d8696b03738 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:41.554021 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b323f6-e258-49b6-a878-1d8696b03738 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:41.554454 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b323f6-e258-49b6-a878-1d8696b03738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:41.578242 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-84b323f6-e258-49b6-a878-1d8696b03738 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:41.579907 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-84b323f6-e258-49b6-a878-1d8696b03738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:41.708033 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 829/1683] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:41.921262 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5bc2e-26d4-4873-8cdd-213b46bf9970 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:41.923207 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-bcb5bc2e-26d4-4873-8cdd-213b46bf9970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:42.022403 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5bc2e-26d4-4873-8cdd-213b46bf9970 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:42.056037 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7aaf2-ec08-4188-8ccc-e8b601f683d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:42.056550 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7aaf2-ec08-4188-8ccc-e8b601f683d8 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:42.056833 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7aaf2-ec08-4188-8ccc-e8b601f683d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:42.057094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7aaf2-ec08-4188-8ccc-e8b601f683d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:42.086441 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7aaf2-ec08-4188-8ccc-e8b601f683d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:42.090401 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7aaf2-ec08-4188-8ccc-e8b601f683d8 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:42.123103 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 855/1684] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:42.488617 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be89ab7-f4fe-46a4-bd9d-f6e8d253b17c None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:42.489796 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be89ab7-f4fe-46a4-bd9d-f6e8d253b17c None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:42.490335 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be89ab7-f4fe-46a4-bd9d-f6e8d253b17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:42.564945 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-0be89ab7-f4fe-46a4-bd9d-f6e8d253b17c None None] MFA Rules not processed for user `8c5ac449d0494ab585c0aeccb9541016`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:42.570362 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-0be89ab7-f4fe-46a4-bd9d-f6e8d253b17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:42.694969 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 830/1685] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:42.891173 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7aaf2-ec08-4188-8ccc-e8b601f683d8 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:42.898651 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be89ab7-f4fe-46a4-bd9d-f6e8d253b17c None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:42.899408 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-1ca7aaf2-ec08-4188-8ccc-e8b601f683d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:42.900567 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-0be89ab7-f4fe-46a4-bd9d-f6e8d253b17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:42.919916 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be89ab7-f4fe-46a4-bd9d-f6e8d253b17c None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:42.926153 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4ee81-8b71-449c-afce-671a4c70d229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:42.927240 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4ee81-8b71-449c-afce-671a4c70d229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:42.927867 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4ee81-8b71-449c-afce-671a4c70d229 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:42.928283 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4ee81-8b71-449c-afce-671a4c70d229 admin admin] PATH_INFO: `/v3/users/a554bead9589408985f3d09594e86d2d` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:42.929872 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4ee81-8b71-449c-afce-671a4c70d229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a554bead9589408985f3d09594e86d2d)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:42.931483 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: WARNING py.warnings [None req-8fa4ee81-8b71-449c-afce-671a4c70d229 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:47:42.931483 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: warnings.warn(msg) Jan 10 12:47:42.931483 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: Jan 10 12:47:42.933075 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4ee81-8b71-449c-afce-671a4c70d229 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:43.024736 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7aaf2-ec08-4188-8ccc-e8b601f683d8 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:43.032528 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc189147-218d-4cd7-82f7-296fb0a8b86a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:43.033364 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc189147-218d-4cd7-82f7-296fb0a8b86a service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:43.033642 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc189147-218d-4cd7-82f7-296fb0a8b86a service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:43.033908 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc189147-218d-4cd7-82f7-296fb0a8b86a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:43.036050 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-8fa4ee81-8b71-449c-afce-671a4c70d229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a554bead9589408985f3d09594e86d2d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:43.037359 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-8fa4ee81-8b71-449c-afce-671a4c70d229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a554bead9589408985f3d09594e86d2d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:43.040104 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-8fa4ee81-8b71-449c-afce-671a4c70d229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a554bead9589408985f3d09594e86d2d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:43.054741 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc189147-218d-4cd7-82f7-296fb0a8b86a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:43.056699 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc189147-218d-4cd7-82f7-296fb0a8b86a service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:43.068064 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 856/1686] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:43.082426 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-8fa4ee81-8b71-449c-afce-671a4c70d229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a554bead9589408985f3d09594e86d2d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:43.106230 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-8fa4ee81-8b71-449c-afce-671a4c70d229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a554bead9589408985f3d09594e86d2d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:43.129666 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 831/1687] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:47:42 2022] DELETE /identity/v3/users/a554bead9589408985f3d09594e86d2d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:43.131341 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50177e8-a48a-4374-afbf-5da275acca36 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:43.131676 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50177e8-a48a-4374-afbf-5da275acca36 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:43.131954 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50177e8-a48a-4374-afbf-5da275acca36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:43.187995 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4ee81-8b71-449c-afce-671a4c70d229 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:43.188744 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-d50177e8-a48a-4374-afbf-5da275acca36 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:43.190246 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-8fa4ee81-8b71-449c-afce-671a4c70d229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:43.190724 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d50177e8-a48a-4374-afbf-5da275acca36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:43.312226 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 857/1688] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:43.327759 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50177e8-a48a-4374-afbf-5da275acca36 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:43.330403 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d50177e8-a48a-4374-afbf-5da275acca36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:43.375500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4ee81-8b71-449c-afce-671a4c70d229 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:43.394759 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f3892-4d4a-4508-9ba0-1a8f44958cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:43.396430 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f3892-4d4a-4508-9ba0-1a8f44958cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:43.396815 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f3892-4d4a-4508-9ba0-1a8f44958cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:43.397192 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f3892-4d4a-4508-9ba0-1a8f44958cc1 admin admin] PATH_INFO: `/v3/projects/fa8a84712949453485b7d57a7933fda7` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:43.398512 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f3892-4d4a-4508-9ba0-1a8f44958cc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa8a84712949453485b7d57a7933fda7)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:43.400692 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f3892-4d4a-4508-9ba0-1a8f44958cc1 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:43.405909 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50177e8-a48a-4374-afbf-5da275acca36 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:43.413095 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45eb28-e5ff-48ef-a8cc-0ae42046e3a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:43.413869 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45eb28-e5ff-48ef-a8cc-0ae42046e3a9 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:43.414215 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45eb28-e5ff-48ef-a8cc-0ae42046e3a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:43.414766 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45eb28-e5ff-48ef-a8cc-0ae42046e3a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:43.433609 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45eb28-e5ff-48ef-a8cc-0ae42046e3a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:43.439087 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45eb28-e5ff-48ef-a8cc-0ae42046e3a9 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:43.462353 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 858/1689] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:47:43.502198 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-904f3892-4d4a-4508-9ba0-1a8f44958cc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa8a84712949453485b7d57a7933fda7', 'request_id': 'req-904f3892-4d4a-4508-9ba0-1a8f44958cc1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:43.522795 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-904f3892-4d4a-4508-9ba0-1a8f44958cc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa8a84712949453485b7d57a7933fda7', 'request_id': 'req-904f3892-4d4a-4508-9ba0-1a8f44958cc1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:43.529484 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-904f3892-4d4a-4508-9ba0-1a8f44958cc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa8a84712949453485b7d57a7933fda7', 'request_id': 'req-904f3892-4d4a-4508-9ba0-1a8f44958cc1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:43.555994 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-904f3892-4d4a-4508-9ba0-1a8f44958cc1 admin admin] The token cache is being invalidate because project fa8a84712949453485b7d57a7933fda7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:47:43.556308 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-904f3892-4d4a-4508-9ba0-1a8f44958cc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:43.557346 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-904f3892-4d4a-4508-9ba0-1a8f44958cc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:43.564215 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 832/1690] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:47:43 2022] DELETE /identity/v3/projects/fa8a84712949453485b7d57a7933fda7 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:43.565766 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45eb28-e5ff-48ef-a8cc-0ae42046e3a9 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:43.578650 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45eb28-e5ff-48ef-a8cc-0ae42046e3a9 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:43.746042 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a44491-485f-4188-ac81-ce9d5aa89d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:43.747047 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a44491-485f-4188-ac81-ce9d5aa89d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:43.747368 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a44491-485f-4188-ac81-ce9d5aa89d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:43.749890 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a44491-485f-4188-ac81-ce9d5aa89d44 admin admin] PATH_INFO: `/v3/users/dc366453efaa427b90446c616814e7f6` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:43.772851 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a44491-485f-4188-ac81-ce9d5aa89d44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc366453efaa427b90446c616814e7f6)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:43.774801 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a44491-485f-4188-ac81-ce9d5aa89d44 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:43.893398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-04a44491-485f-4188-ac81-ce9d5aa89d44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc366453efaa427b90446c616814e7f6'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:43.905688 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-04a44491-485f-4188-ac81-ce9d5aa89d44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc366453efaa427b90446c616814e7f6'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:43.916540 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-04a44491-485f-4188-ac81-ce9d5aa89d44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc366453efaa427b90446c616814e7f6'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:43.917857 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-04a44491-485f-4188-ac81-ce9d5aa89d44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc366453efaa427b90446c616814e7f6'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:43.919482 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-04a44491-485f-4188-ac81-ce9d5aa89d44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc366453efaa427b90446c616814e7f6'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:43.970081 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 859/1691] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:47:43 2022] DELETE /identity/v3/users/dc366453efaa427b90446c616814e7f6 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:44.498657 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f3892-4d4a-4508-9ba0-1a8f44958cc1 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:44.500796 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-904f3892-4d4a-4508-9ba0-1a8f44958cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:44.536846 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f3892-4d4a-4508-9ba0-1a8f44958cc1 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:44.645384 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc29eb-124f-492b-b948-8213c793034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:44.645997 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc29eb-124f-492b-b948-8213c793034a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:44.646527 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc29eb-124f-492b-b948-8213c793034a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:44.647005 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc29eb-124f-492b-b948-8213c793034a admin admin] PATH_INFO: `/v3/projects/07d9a12650304c4e92265bc0cfccca59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:44.649172 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc29eb-124f-492b-b948-8213c793034a admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d9a12650304c4e92265bc0cfccca59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:44.651939 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc29eb-124f-492b-b948-8213c793034a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:44.736724 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-69fc29eb-124f-492b-b948-8213c793034a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d9a12650304c4e92265bc0cfccca59', 'request_id': 'req-69fc29eb-124f-492b-b948-8213c793034a'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:44.754435 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-69fc29eb-124f-492b-b948-8213c793034a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d9a12650304c4e92265bc0cfccca59', 'request_id': 'req-69fc29eb-124f-492b-b948-8213c793034a'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:44.761771 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-69fc29eb-124f-492b-b948-8213c793034a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d9a12650304c4e92265bc0cfccca59', 'request_id': 'req-69fc29eb-124f-492b-b948-8213c793034a'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:44.785906 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-69fc29eb-124f-492b-b948-8213c793034a admin admin] The token cache is being invalidate because project 07d9a12650304c4e92265bc0cfccca59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:47:44.786432 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-69fc29eb-124f-492b-b948-8213c793034a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:44.787396 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-69fc29eb-124f-492b-b948-8213c793034a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:44.791595 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 833/1692] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:47:44 2022] DELETE /identity/v3/projects/07d9a12650304c4e92265bc0cfccca59 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:44.795922 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a44491-485f-4188-ac81-ce9d5aa89d44 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:44.797635 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-04a44491-485f-4188-ac81-ce9d5aa89d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:44.826080 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a44491-485f-4188-ac81-ce9d5aa89d44 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:44.934501 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73791425-bfec-4c0e-aa9f-f1c9c8d4946f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:44.936987 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73791425-bfec-4c0e-aa9f-f1c9c8d4946f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:44.937457 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73791425-bfec-4c0e-aa9f-f1c9c8d4946f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:44.938247 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73791425-bfec-4c0e-aa9f-f1c9c8d4946f admin admin] PATH_INFO: `/v3/users/87de8f4a57934127b11965006d94397b` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:44.941761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73791425-bfec-4c0e-aa9f-f1c9c8d4946f admin admin] RBAC: Authorizing `identity:delete_user(user_id=87de8f4a57934127b11965006d94397b)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:44.944095 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73791425-bfec-4c0e-aa9f-f1c9c8d4946f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:45.038147 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-73791425-bfec-4c0e-aa9f-f1c9c8d4946f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87de8f4a57934127b11965006d94397b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:45.051442 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-73791425-bfec-4c0e-aa9f-f1c9c8d4946f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87de8f4a57934127b11965006d94397b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:45.067855 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-73791425-bfec-4c0e-aa9f-f1c9c8d4946f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87de8f4a57934127b11965006d94397b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:45.068927 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-73791425-bfec-4c0e-aa9f-f1c9c8d4946f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87de8f4a57934127b11965006d94397b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:45.070413 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-73791425-bfec-4c0e-aa9f-f1c9c8d4946f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87de8f4a57934127b11965006d94397b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:45.092567 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 860/1693] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:47:44 2022] DELETE /identity/v3/users/87de8f4a57934127b11965006d94397b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:45.879449 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc29eb-124f-492b-b948-8213c793034a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:45.880896 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-69fc29eb-124f-492b-b948-8213c793034a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:45.910303 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc29eb-124f-492b-b948-8213c793034a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:46.056551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bdd87-ca44-4190-ae9f-cb9e802337cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:46.057797 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bdd87-ca44-4190-ae9f-cb9e802337cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:46.058166 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bdd87-ca44-4190-ae9f-cb9e802337cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:46.058328 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bdd87-ca44-4190-ae9f-cb9e802337cb admin admin] PATH_INFO: `/v3/projects/482cb17cc95d4e8c989f4d1ffcbbc14e` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:46.059633 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bdd87-ca44-4190-ae9f-cb9e802337cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=482cb17cc95d4e8c989f4d1ffcbbc14e)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:46.062083 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bdd87-ca44-4190-ae9f-cb9e802337cb admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:46.219330 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-dd5bdd87-ca44-4190-ae9f-cb9e802337cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '482cb17cc95d4e8c989f4d1ffcbbc14e', 'request_id': 'req-dd5bdd87-ca44-4190-ae9f-cb9e802337cb'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:46.239601 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-dd5bdd87-ca44-4190-ae9f-cb9e802337cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '482cb17cc95d4e8c989f4d1ffcbbc14e', 'request_id': 'req-dd5bdd87-ca44-4190-ae9f-cb9e802337cb'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:46.263276 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-dd5bdd87-ca44-4190-ae9f-cb9e802337cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '482cb17cc95d4e8c989f4d1ffcbbc14e', 'request_id': 'req-dd5bdd87-ca44-4190-ae9f-cb9e802337cb'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:46.297863 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-dd5bdd87-ca44-4190-ae9f-cb9e802337cb admin admin] The token cache is being invalidate because project 482cb17cc95d4e8c989f4d1ffcbbc14e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:47:46.298424 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-dd5bdd87-ca44-4190-ae9f-cb9e802337cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:46.302553 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-dd5bdd87-ca44-4190-ae9f-cb9e802337cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:46.308893 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 834/1694] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:47:45 2022] DELETE /identity/v3/projects/482cb17cc95d4e8c989f4d1ffcbbc14e => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:47:46.316765 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bcd14-1624-4ac0-9ace-6ccbb025c7cf None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:46.317291 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bcd14-1624-4ac0-9ace-6ccbb025c7cf None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:46.317291 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bcd14-1624-4ac0-9ace-6ccbb025c7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:46.351136 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-f68bcd14-1624-4ac0-9ace-6ccbb025c7cf None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:46.354394 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f68bcd14-1624-4ac0-9ace-6ccbb025c7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:46.453712 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bdd87-ca44-4190-ae9f-cb9e802337cb admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:46.455330 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-dd5bdd87-ca44-4190-ae9f-cb9e802337cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:46.541543 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 861/1695] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:46.543062 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bee2f4-dbe8-4e81-bce9-355c74276f91 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:46.543546 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bee2f4-dbe8-4e81-bce9-355c74276f91 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:46.543975 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bee2f4-dbe8-4e81-bce9-355c74276f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:46.592924 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-22bee2f4-dbe8-4e81-bce9-355c74276f91 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:46.599056 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-22bee2f4-dbe8-4e81-bce9-355c74276f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:46.647887 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 862/1696] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:46.649129 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bee2f4-dbe8-4e81-bce9-355c74276f91 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:46.688740 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bee2f4-dbe8-4e81-bce9-355c74276f91 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:46.706663 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b4281-3f46-449d-a740-a8c93cd2ddbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:46.707694 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b4281-3f46-449d-a740-a8c93cd2ddbd admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:46.708191 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b4281-3f46-449d-a740-a8c93cd2ddbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:46.708722 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b4281-3f46-449d-a740-a8c93cd2ddbd admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:46.710349 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b4281-3f46-449d-a740-a8c93cd2ddbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:47:46.710850 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b4281-3f46-449d-a740-a8c93cd2ddbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:46.721197 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b4281-3f46-449d-a740-a8c93cd2ddbd admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:46.753833 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 863/1697] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:47:46.755036 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b4281-3f46-449d-a740-a8c93cd2ddbd admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:46.765302 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b4281-3f46-449d-a740-a8c93cd2ddbd admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:46.771014 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421c373-74f5-4d5f-950f-7d4651a8672f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:46.772090 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421c373-74f5-4d5f-950f-7d4651a8672f admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:46.772618 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421c373-74f5-4d5f-950f-7d4651a8672f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:46.775127 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421c373-74f5-4d5f-950f-7d4651a8672f admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:46.776203 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421c373-74f5-4d5f-950f-7d4651a8672f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:46.778833 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421c373-74f5-4d5f-950f-7d4651a8672f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:46.802092 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bdd87-ca44-4190-ae9f-cb9e802337cb admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:46.819954 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bac88-275b-466a-bc6a-af9c072f9ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:46.823941 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bac88-275b-466a-bc6a-af9c072f9ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:46.825303 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bac88-275b-466a-bc6a-af9c072f9ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:46.827947 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bac88-275b-466a-bc6a-af9c072f9ff2 admin admin] PATH_INFO: `/v3/projects/8081686877274ec691ea5ea13d3d9bfc` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:46.833558 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5bac88-275b-466a-bc6a-af9c072f9ff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8081686877274ec691ea5ea13d3d9bfc)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:46.835705 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5bac88-275b-466a-bc6a-af9c072f9ff2 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:46.844202 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 864/1698] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:47:46 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:46.852130 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c9127-8425-4dfd-be4c-068688ee7968 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:46.852561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c9127-8425-4dfd-be4c-068688ee7968 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:46.853604 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c9127-8425-4dfd-be4c-068688ee7968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:46.899225 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-833c9127-8425-4dfd-be4c-068688ee7968 None None] MFA Rules not processed for user `44e5602fd019411aa8f0e091ed533ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:46.900846 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-833c9127-8425-4dfd-be4c-068688ee7968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:46.953901 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6b5bac88-275b-466a-bc6a-af9c072f9ff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8081686877274ec691ea5ea13d3d9bfc', 'request_id': 'req-6b5bac88-275b-466a-bc6a-af9c072f9ff2'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:46.975479 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6b5bac88-275b-466a-bc6a-af9c072f9ff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8081686877274ec691ea5ea13d3d9bfc', 'request_id': 'req-6b5bac88-275b-466a-bc6a-af9c072f9ff2'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:46.982980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6b5bac88-275b-466a-bc6a-af9c072f9ff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8081686877274ec691ea5ea13d3d9bfc', 'request_id': 'req-6b5bac88-275b-466a-bc6a-af9c072f9ff2'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:47.009898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6b5bac88-275b-466a-bc6a-af9c072f9ff2 admin admin] The token cache is being invalidate because project 8081686877274ec691ea5ea13d3d9bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:47:47.010582 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6b5bac88-275b-466a-bc6a-af9c072f9ff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:47.012135 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6b5bac88-275b-466a-bc6a-af9c072f9ff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:47.017382 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 835/1699] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:47:46 2022] DELETE /identity/v3/projects/8081686877274ec691ea5ea13d3d9bfc => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:47:47.023412 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bac88-275b-466a-bc6a-af9c072f9ff2 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:47.029362 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-6b5bac88-275b-466a-bc6a-af9c072f9ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:47.059992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 865/1700] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jan 10 12:47:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:47.061803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514a28d-ca25-40e1-9d18-f6673f0cdd51 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:47.062096 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514a28d-ca25-40e1-9d18-f6673f0cdd51 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:47.062372 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514a28d-ca25-40e1-9d18-f6673f0cdd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:47.110552 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-5514a28d-ca25-40e1-9d18-f6673f0cdd51 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:47.115620 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-5514a28d-ca25-40e1-9d18-f6673f0cdd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:47.294220 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 866/1701] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:47.295691 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586e823-1060-4660-a04a-81c0580f4833 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:47.295928 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586e823-1060-4660-a04a-81c0580f4833 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:47.296197 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586e823-1060-4660-a04a-81c0580f4833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:47.318741 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bac88-275b-466a-bc6a-af9c072f9ff2 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:47.322970 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-5586e823-1060-4660-a04a-81c0580f4833 None None] MFA Rules not processed for user `8c5ac449d0494ab585c0aeccb9541016`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:47.324290 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-5586e823-1060-4660-a04a-81c0580f4833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:47.348778 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47751ec-8593-45aa-9b02-3d858785c06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:47.348778 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47751ec-8593-45aa-9b02-3d858785c06f admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:47.348778 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47751ec-8593-45aa-9b02-3d858785c06f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:47.348778 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47751ec-8593-45aa-9b02-3d858785c06f admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:47.349249 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47751ec-8593-45aa-9b02-3d858785c06f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:47.349249 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47751ec-8593-45aa-9b02-3d858785c06f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:47.395589 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 867/1702] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:47.397321 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1fa2b-0477-461f-88b2-ab747033443e None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:47.397744 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1fa2b-0477-461f-88b2-ab747033443e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:47.398210 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1fa2b-0477-461f-88b2-ab747033443e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:47.410266 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 836/1703] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:47:47 2022] POST /identity/v3/users => generated 288 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:47.411696 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47751ec-8593-45aa-9b02-3d858785c06f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:47.429013 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47751ec-8593-45aa-9b02-3d858785c06f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:47.438420 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d5da7-c967-4cdb-9cea-f86d1554e7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:47.439667 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d5da7-c967-4cdb-9cea-f86d1554e7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:47.440094 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d5da7-c967-4cdb-9cea-f86d1554e7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:47.440725 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d5da7-c967-4cdb-9cea-f86d1554e7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:47.442208 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d5da7-c967-4cdb-9cea-f86d1554e7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:47.444154 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44d5da7-c967-4cdb-9cea-f86d1554e7d0 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:47.457839 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 837/1704] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:47:47.458906 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d5da7-c967-4cdb-9cea-f86d1554e7d0 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:47.461073 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-b44d5da7-c967-4cdb-9cea-f86d1554e7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:47.465227 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-e9b1fa2b-0477-461f-88b2-ab747033443e None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:47.467885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-e9b1fa2b-0477-461f-88b2-ab747033443e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:47.485766 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 868/1705] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:47.485766 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1fa2b-0477-461f-88b2-ab747033443e None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:47.500640 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1fa2b-0477-461f-88b2-ab747033443e None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:47.512058 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc6589-492b-4db6-af9a-7a55e0d1c235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:47.514347 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc6589-492b-4db6-af9a-7a55e0d1c235 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:47.514628 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc6589-492b-4db6-af9a-7a55e0d1c235 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:47.515338 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc6589-492b-4db6-af9a-7a55e0d1c235 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:47.523448 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc6589-492b-4db6-af9a-7a55e0d1c235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:47.525880 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc6589-492b-4db6-af9a-7a55e0d1c235 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:47.558844 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 869/1706] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:47.559743 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc6589-492b-4db6-af9a-7a55e0d1c235 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:47.584360 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc6589-492b-4db6-af9a-7a55e0d1c235 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:47.590287 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6f94b-09e6-4c74-8018-4f5aee30e49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:47.591223 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6f94b-09e6-4c74-8018-4f5aee30e49f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:47.591739 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6f94b-09e6-4c74-8018-4f5aee30e49f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:47.592153 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6f94b-09e6-4c74-8018-4f5aee30e49f admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:47.593630 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6f94b-09e6-4c74-8018-4f5aee30e49f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:47:47.594567 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6f94b-09e6-4c74-8018-4f5aee30e49f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:47.599777 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6f94b-09e6-4c74-8018-4f5aee30e49f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:47.612402 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d5da7-c967-4cdb-9cea-f86d1554e7d0 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:47.635707 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9c867-68ec-4880-90ad-ae616875aac3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd898c7c2974bb38998ebad22fd5a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:47.636638 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9c867-68ec-4880-90ad-ae616875aac3 service swift] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:47.638473 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9c867-68ec-4880-90ad-ae616875aac3 service swift] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:47.639612 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9c867-68ec-4880-90ad-ae616875aac3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:47.641403 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 870/1707] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:47:47.642475 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6f94b-09e6-4c74-8018-4f5aee30e49f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:47.658577 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6f94b-09e6-4c74-8018-4f5aee30e49f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:47.674115 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917453f5-1061-47ba-9464-ad3cc3d0cff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:47.675323 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917453f5-1061-47ba-9464-ad3cc3d0cff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:47.675904 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917453f5-1061-47ba-9464-ad3cc3d0cff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:47.676562 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917453f5-1061-47ba-9464-ad3cc3d0cff5 admin admin] PATH_INFO: `/v3/projects/2acf7749ee264fce851228a4a1c1faa3/users/fffa339b3f074cdd8b1733ff47637c82/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:47.713451 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917453f5-1061-47ba-9464-ad3cc3d0cff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2acf7749ee264fce851228a4a1c1faa3, user_id=fffa339b3f074cdd8b1733ff47637c82, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:47.716541 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917453f5-1061-47ba-9464-ad3cc3d0cff5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:47.756199 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 871/1708] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:47 2022] PUT /identity/v3/projects/2acf7749ee264fce851228a4a1c1faa3/users/fffa339b3f074cdd8b1733ff47637c82/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:47.757401 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917453f5-1061-47ba-9464-ad3cc3d0cff5 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:47.816601 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9c867-68ec-4880-90ad-ae616875aac3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:47.820393 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9c867-68ec-4880-90ad-ae616875aac3 service swift] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:47.840030 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 838/1709] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jan 10 12:47:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:47:47.841488 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb20ed0-540f-411b-8943-69f85bc33d2a None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:47.841777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb20ed0-540f-411b-8943-69f85bc33d2a None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:47.842083 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb20ed0-540f-411b-8943-69f85bc33d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:47.858918 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917453f5-1061-47ba-9464-ad3cc3d0cff5 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:47.873959 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b10f62-fbb7-47ae-870c-4e41aa76abda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:47.874651 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b10f62-fbb7-47ae-870c-4e41aa76abda admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:47.874931 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b10f62-fbb7-47ae-870c-4e41aa76abda admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:47.875204 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b10f62-fbb7-47ae-870c-4e41aa76abda admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:47.875951 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b10f62-fbb7-47ae-870c-4e41aa76abda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:47.883747 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b10f62-fbb7-47ae-870c-4e41aa76abda admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:47.913137 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-6eb20ed0-540f-411b-8943-69f85bc33d2a None None] MFA Rules not processed for user `fffa339b3f074cdd8b1733ff47637c82`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:47.917786 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-6eb20ed0-540f-411b-8943-69f85bc33d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:47.941487 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 872/1710] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:47:47 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:47.942986 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b10f62-fbb7-47ae-870c-4e41aa76abda admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:47.949368 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-12b10f62-fbb7-47ae-870c-4e41aa76abda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:48.142931 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 839/1711] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:48.145300 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb20ed0-540f-411b-8943-69f85bc33d2a None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:48.159106 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb20ed0-540f-411b-8943-69f85bc33d2a None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:48.227740 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b10f62-fbb7-47ae-870c-4e41aa76abda admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:48.259177 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2866133-9f39-4528-a59c-b9c9dfa1ce29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:48.264526 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2866133-9f39-4528-a59c-b9c9dfa1ce29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:48.266639 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2866133-9f39-4528-a59c-b9c9dfa1ce29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:48.266943 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2866133-9f39-4528-a59c-b9c9dfa1ce29 admin admin] PATH_INFO: `/v3/users/b56f7c0ce6da4c068ce6a2720a093bb2` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:48.276414 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec506d-9b8b-40bf-ac45-1eccec9eb98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:48.277193 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec506d-9b8b-40bf-ac45-1eccec9eb98f admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:48.277368 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2866133-9f39-4528-a59c-b9c9dfa1ce29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b56f7c0ce6da4c068ce6a2720a093bb2)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:48.277533 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec506d-9b8b-40bf-ac45-1eccec9eb98f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:48.281761 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec506d-9b8b-40bf-ac45-1eccec9eb98f admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:48.284118 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec506d-9b8b-40bf-ac45-1eccec9eb98f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:48.290548 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2866133-9f39-4528-a59c-b9c9dfa1ce29 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:48.291075 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec506d-9b8b-40bf-ac45-1eccec9eb98f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:48.338921 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 840/1712] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:47:48 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:48.342667 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d86ae-54e9-41e7-94fd-6e9af5989fbb None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:48.343797 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d86ae-54e9-41e7-94fd-6e9af5989fbb None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:48.349576 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d86ae-54e9-41e7-94fd-6e9af5989fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:48.485499 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c2866133-9f39-4528-a59c-b9c9dfa1ce29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b56f7c0ce6da4c068ce6a2720a093bb2'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:48.521957 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c2866133-9f39-4528-a59c-b9c9dfa1ce29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b56f7c0ce6da4c068ce6a2720a093bb2'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:48.527302 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-317d86ae-54e9-41e7-94fd-6e9af5989fbb None None] MFA Rules not processed for user `c7c2b5d01a124f3e94bc557b641f77a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:48.528610 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-317d86ae-54e9-41e7-94fd-6e9af5989fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:48.551692 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c2866133-9f39-4528-a59c-b9c9dfa1ce29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b56f7c0ce6da4c068ce6a2720a093bb2'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:48.552405 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c2866133-9f39-4528-a59c-b9c9dfa1ce29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b56f7c0ce6da4c068ce6a2720a093bb2'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:48.553034 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c2866133-9f39-4528-a59c-b9c9dfa1ce29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b56f7c0ce6da4c068ce6a2720a093bb2'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:48.612089 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 873/1713] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:47:47 2022] DELETE /identity/v3/users/b56f7c0ce6da4c068ce6a2720a093bb2 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:48.615405 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2866133-9f39-4528-a59c-b9c9dfa1ce29 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:48.617218 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c2866133-9f39-4528-a59c-b9c9dfa1ce29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:48.825457 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 841/1714] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:48.826456 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d86ae-54e9-41e7-94fd-6e9af5989fbb None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:48.851802 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-317d86ae-54e9-41e7-94fd-6e9af5989fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:48.904752 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d86ae-54e9-41e7-94fd-6e9af5989fbb None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:48.922991 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2866133-9f39-4528-a59c-b9c9dfa1ce29 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:48.925779 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc9e74-315f-4a06-925e-b6d7068cdd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:48.929554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc9e74-315f-4a06-925e-b6d7068cdd8f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:48.930689 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc9e74-315f-4a06-925e-b6d7068cdd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:48.933139 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc9e74-315f-4a06-925e-b6d7068cdd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:48.937746 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1464c61-899a-49a5-8b25-fed4a024cf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:48.939012 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1464c61-899a-49a5-8b25-fed4a024cf8c admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:48.939420 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1464c61-899a-49a5-8b25-fed4a024cf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:48.939554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc9e74-315f-4a06-925e-b6d7068cdd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:48.939892 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1464c61-899a-49a5-8b25-fed4a024cf8c admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:48.941209 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc9e74-315f-4a06-925e-b6d7068cdd8f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:48.942012 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1464c61-899a-49a5-8b25-fed4a024cf8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:48.945585 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1464c61-899a-49a5-8b25-fed4a024cf8c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:48.974374 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 842/1715] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:48.989529 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d5df2-d134-4fe8-860f-d1698c093b0d None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:48.989982 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d5df2-d134-4fe8-860f-d1698c093b0d None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:48.990264 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d5df2-d134-4fe8-860f-d1698c093b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:48.998821 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 874/1716] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:47:48 2022] POST /identity/v3/projects => generated 377 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:49.000467 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1464c61-899a-49a5-8b25-fed4a024cf8c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:49.007503 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f1464c61-899a-49a5-8b25-fed4a024cf8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:49.052913 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-0b9d5df2-d134-4fe8-860f-d1698c093b0d None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:49.054907 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-0b9d5df2-d134-4fe8-860f-d1698c093b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:49.281403 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1464c61-899a-49a5-8b25-fed4a024cf8c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:49.304112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 843/1717] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:49.306664 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300d00b-0651-41f7-a808-4f9dd4f09802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:49.309021 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300d00b-0651-41f7-a808-4f9dd4f09802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:49.309322 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300d00b-0651-41f7-a808-4f9dd4f09802 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:49.309600 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300d00b-0651-41f7-a808-4f9dd4f09802 admin admin] PATH_INFO: `/v3/users/87065ba1c8f444a4bc06d19e2c1befcc` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:49.311202 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50072c3d-56f1-49fa-b2f8-569c5ef3d5cf None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:49.311498 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50072c3d-56f1-49fa-b2f8-569c5ef3d5cf None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:49.311797 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50072c3d-56f1-49fa-b2f8-569c5ef3d5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:49.313916 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300d00b-0651-41f7-a808-4f9dd4f09802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87065ba1c8f444a4bc06d19e2c1befcc)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:49.318225 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300d00b-0651-41f7-a808-4f9dd4f09802 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:49.373732 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-50072c3d-56f1-49fa-b2f8-569c5ef3d5cf None None] MFA Rules not processed for user `c7c2b5d01a124f3e94bc557b641f77a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:49.374917 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-50072c3d-56f1-49fa-b2f8-569c5ef3d5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:49.537341 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0300d00b-0651-41f7-a808-4f9dd4f09802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87065ba1c8f444a4bc06d19e2c1befcc'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:49.546914 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 844/1718] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:49.549295 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50072c3d-56f1-49fa-b2f8-569c5ef3d5cf None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:49.576197 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0300d00b-0651-41f7-a808-4f9dd4f09802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87065ba1c8f444a4bc06d19e2c1befcc'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:49.605744 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50072c3d-56f1-49fa-b2f8-569c5ef3d5cf None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:49.607705 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0300d00b-0651-41f7-a808-4f9dd4f09802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87065ba1c8f444a4bc06d19e2c1befcc'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:49.610539 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0300d00b-0651-41f7-a808-4f9dd4f09802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87065ba1c8f444a4bc06d19e2c1befcc'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:49.618102 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0300d00b-0651-41f7-a808-4f9dd4f09802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87065ba1c8f444a4bc06d19e2c1befcc'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:49.632926 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac9b26-bad3-4e7c-8371-3ae3e79f733e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:49.634859 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac9b26-bad3-4e7c-8371-3ae3e79f733e admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:49.637975 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac9b26-bad3-4e7c-8371-3ae3e79f733e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:49.638800 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac9b26-bad3-4e7c-8371-3ae3e79f733e admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:49.642330 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac9b26-bad3-4e7c-8371-3ae3e79f733e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:49.656666 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac9b26-bad3-4e7c-8371-3ae3e79f733e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:49.705086 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 845/1719] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:49.707623 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac9b26-bad3-4e7c-8371-3ae3e79f733e admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:49.719505 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-afac9b26-bad3-4e7c-8371-3ae3e79f733e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:49.723129 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 875/1720] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:47:48 2022] DELETE /identity/v3/users/87065ba1c8f444a4bc06d19e2c1befcc => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:49.726725 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300d00b-0651-41f7-a808-4f9dd4f09802 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:49.735746 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-0300d00b-0651-41f7-a808-4f9dd4f09802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:49.759091 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac9b26-bad3-4e7c-8371-3ae3e79f733e admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:49.910076 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049c635-248e-4c33-bbf4-bcb052a94ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:49.911194 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049c635-248e-4c33-bbf4-bcb052a94ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:49.911666 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049c635-248e-4c33-bbf4-bcb052a94ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:49.912093 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049c635-248e-4c33-bbf4-bcb052a94ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:49.913885 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049c635-248e-4c33-bbf4-bcb052a94ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:49.916062 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049c635-248e-4c33-bbf4-bcb052a94ac1 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:49.949402 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 846/1721] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:47:49 2022] POST /identity/v3/users => generated 295 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:49.952940 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049c635-248e-4c33-bbf4-bcb052a94ac1 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:49.978569 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-2049c635-248e-4c33-bbf4-bcb052a94ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:50.019171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049c635-248e-4c33-bbf4-bcb052a94ac1 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:50.027242 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5159a71-a424-4fc2-a7bb-9cdc6d68ca07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:50.029429 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5159a71-a424-4fc2-a7bb-9cdc6d68ca07 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:50.030215 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5159a71-a424-4fc2-a7bb-9cdc6d68ca07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:50.031926 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5159a71-a424-4fc2-a7bb-9cdc6d68ca07 admin admin] PATH_INFO: `/v3/projects/ab7f6eb201714e5ba3f79d2d0ddb8e66/users/7ea1c52bb4294b93ace8702bc8142410/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:50.036226 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300d00b-0651-41f7-a808-4f9dd4f09802 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:50.057021 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f32f2e-58a3-4dea-963a-da12ebecdeb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:50.057719 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f32f2e-58a3-4dea-963a-da12ebecdeb9 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:50.067813 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f32f2e-58a3-4dea-963a-da12ebecdeb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:50.068289 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f32f2e-58a3-4dea-963a-da12ebecdeb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:50.076850 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5159a71-a424-4fc2-a7bb-9cdc6d68ca07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7f6eb201714e5ba3f79d2d0ddb8e66, user_id=7ea1c52bb4294b93ace8702bc8142410, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:50.077074 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-e5f32f2e-58a3-4dea-963a-da12ebecdeb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:50.082345 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5159a71-a424-4fc2-a7bb-9cdc6d68ca07 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:50.127183 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 847/1722] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:49 2022] PUT /identity/v3/projects/ab7f6eb201714e5ba3f79d2d0ddb8e66/users/7ea1c52bb4294b93ace8702bc8142410/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:50.131575 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de79001-2cb3-491b-b6f8-36a68faccbe6 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:50.131898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de79001-2cb3-491b-b6f8-36a68faccbe6 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:50.132177 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de79001-2cb3-491b-b6f8-36a68faccbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:50.136776 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f32f2e-58a3-4dea-963a-da12ebecdeb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:50.141308 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f32f2e-58a3-4dea-963a-da12ebecdeb9 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:50.162660 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 876/1723] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:50.163672 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f32f2e-58a3-4dea-963a-da12ebecdeb9 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:50.165203 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-e5f32f2e-58a3-4dea-963a-da12ebecdeb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:50.231970 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-1de79001-2cb3-491b-b6f8-36a68faccbe6 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:50.233212 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-1de79001-2cb3-491b-b6f8-36a68faccbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:50.375023 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f32f2e-58a3-4dea-963a-da12ebecdeb9 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:50.567527 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 848/1724] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:50.568632 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de79001-2cb3-491b-b6f8-36a68faccbe6 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:50.612234 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de79001-2cb3-491b-b6f8-36a68faccbe6 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:50.617278 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc1c2d-d8f7-4b11-a31f-d681c8e696bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:50.622090 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc1c2d-d8f7-4b11-a31f-d681c8e696bc service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:50.622386 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc1c2d-d8f7-4b11-a31f-d681c8e696bc service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:50.625961 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc1c2d-d8f7-4b11-a31f-d681c8e696bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:50.627043 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbe394-c94a-4a39-ad2b-65baff65507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:50.628186 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbe394-c94a-4a39-ad2b-65baff65507a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:50.631995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-16dc1c2d-d8f7-4b11-a31f-d681c8e696bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:50.633839 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbe394-c94a-4a39-ad2b-65baff65507a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:50.634044 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbe394-c94a-4a39-ad2b-65baff65507a admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:50.637867 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbe394-c94a-4a39-ad2b-65baff65507a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:50.642706 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbe394-c94a-4a39-ad2b-65baff65507a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:50.698846 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 849/1725] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:50.700249 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06419388-b7d6-4b84-8030-a2deb9e5291e None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:50.700554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06419388-b7d6-4b84-8030-a2deb9e5291e None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:50.700853 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06419388-b7d6-4b84-8030-a2deb9e5291e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:50.787160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc1c2d-d8f7-4b11-a31f-d681c8e696bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:50.791168 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc1c2d-d8f7-4b11-a31f-d681c8e696bc service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:50.801168 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-06419388-b7d6-4b84-8030-a2deb9e5291e None None] MFA Rules not processed for user `7ea1c52bb4294b93ace8702bc8142410`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:50.805362 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-06419388-b7d6-4b84-8030-a2deb9e5291e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:50.818649 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 877/1726] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:50.822714 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc1c2d-d8f7-4b11-a31f-d681c8e696bc service nova] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:50.849663 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc1c2d-d8f7-4b11-a31f-d681c8e696bc service nova] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:50.882094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f50d8-22cb-4828-9aaf-755e902c4770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:50.883016 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f50d8-22cb-4828-9aaf-755e902c4770 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:50.883291 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f50d8-22cb-4828-9aaf-755e902c4770 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:50.883578 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f50d8-22cb-4828-9aaf-755e902c4770 admin admin] PATH_INFO: `/v3/projects/8c5d23abfd3045209a447932ff5e9a0f/users/8e0fdbfba4de47cfb8663d78de5cdeea/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:50.919305 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f50d8-22cb-4828-9aaf-755e902c4770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5d23abfd3045209a447932ff5e9a0f, user_id=8e0fdbfba4de47cfb8663d78de5cdeea, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:50.926423 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f50d8-22cb-4828-9aaf-755e902c4770 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:50.955283 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 878/1727] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:50 2022] PUT /identity/v3/projects/8c5d23abfd3045209a447932ff5e9a0f/users/8e0fdbfba4de47cfb8663d78de5cdeea/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:50.958449 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f50d8-22cb-4828-9aaf-755e902c4770 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:50.966714 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b44f50d8-22cb-4828-9aaf-755e902c4770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:51.082731 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f50d8-22cb-4828-9aaf-755e902c4770 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:51.087556 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ad739-cda8-4845-8826-0b89c6a02a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:51.089250 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ad739-cda8-4845-8826-0b89c6a02a18 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:51.090298 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ad739-cda8-4845-8826-0b89c6a02a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:51.090874 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ad739-cda8-4845-8826-0b89c6a02a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:51.110964 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 850/1728] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:51.113017 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06419388-b7d6-4b84-8030-a2deb9e5291e None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:51.128881 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06419388-b7d6-4b84-8030-a2deb9e5291e None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:51.223364 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6e0f2-d7af-4bd2-acf4-89446fd96e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:51.225133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6e0f2-d7af-4bd2-acf4-89446fd96e65 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:51.226926 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6e0f2-d7af-4bd2-acf4-89446fd96e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:51.227468 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6e0f2-d7af-4bd2-acf4-89446fd96e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:51.229809 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6e0f2-d7af-4bd2-acf4-89446fd96e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:51.232317 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6e0f2-d7af-4bd2-acf4-89446fd96e65 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:51.247765 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 851/1729] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:51.249013 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6e0f2-d7af-4bd2-acf4-89446fd96e65 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:51.265983 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6e0f2-d7af-4bd2-acf4-89446fd96e65 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:51.273460 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735493bb-9912-4638-b519-40f1d72ddc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:51.274345 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735493bb-9912-4638-b519-40f1d72ddc9c admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:51.274740 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735493bb-9912-4638-b519-40f1d72ddc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:51.275107 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735493bb-9912-4638-b519-40f1d72ddc9c admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:51.276788 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735493bb-9912-4638-b519-40f1d72ddc9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:51.279742 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735493bb-9912-4638-b519-40f1d72ddc9c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:51.319111 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ad739-cda8-4845-8826-0b89c6a02a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:51.321815 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 852/1730] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:47:51 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:51.326348 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ad739-cda8-4845-8826-0b89c6a02a18 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:51.329323 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735493bb-9912-4638-b519-40f1d72ddc9c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:51.371109 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 879/1731] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:51.371894 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ad739-cda8-4845-8826-0b89c6a02a18 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:51.407115 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ad739-cda8-4845-8826-0b89c6a02a18 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:51.536501 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735493bb-9912-4638-b519-40f1d72ddc9c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:51.553567 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7037f-7994-4aaa-ab81-3f2790b5b5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:51.554544 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7037f-7994-4aaa-ab81-3f2790b5b5be admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:51.554831 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7037f-7994-4aaa-ab81-3f2790b5b5be admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:51.555100 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7037f-7994-4aaa-ab81-3f2790b5b5be admin admin] PATH_INFO: `/v3/projects/8c5d23abfd3045209a447932ff5e9a0f/users/8e0fdbfba4de47cfb8663d78de5cdeea/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:51.557371 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7037f-7994-4aaa-ab81-3f2790b5b5be admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5d23abfd3045209a447932ff5e9a0f, user_id=8e0fdbfba4de47cfb8663d78de5cdeea, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:51.564979 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7037f-7994-4aaa-ab81-3f2790b5b5be admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:51.610394 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 853/1732] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:51 2022] PUT /identity/v3/projects/8c5d23abfd3045209a447932ff5e9a0f/users/8e0fdbfba4de47cfb8663d78de5cdeea/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:51.612590 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275219d-418e-49d1-9d82-577d0462e7e3 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:51.612892 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275219d-418e-49d1-9d82-577d0462e7e3 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:51.613163 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275219d-418e-49d1-9d82-577d0462e7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:51.635831 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40b1c9-d05a-4bab-aebf-69d0293a6465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:51.637012 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40b1c9-d05a-4bab-aebf-69d0293a6465 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:51.637502 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40b1c9-d05a-4bab-aebf-69d0293a6465 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:51.644434 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40b1c9-d05a-4bab-aebf-69d0293a6465 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:51.645304 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40b1c9-d05a-4bab-aebf-69d0293a6465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:51.647724 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40b1c9-d05a-4bab-aebf-69d0293a6465 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:51.709608 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 880/1733] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:47:51 2022] POST /identity/v3/users => generated 299 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:51.714724 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40b1c9-d05a-4bab-aebf-69d0293a6465 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:51.725448 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-9275219d-418e-49d1-9d82-577d0462e7e3 None None] MFA Rules not processed for user `8e0fdbfba4de47cfb8663d78de5cdeea`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:51.726696 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9275219d-418e-49d1-9d82-577d0462e7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:51.763701 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40b1c9-d05a-4bab-aebf-69d0293a6465 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:51.944776 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36080b2f-5ca3-43e1-8bd8-1f02045f6e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:51.945773 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36080b2f-5ca3-43e1-8bd8-1f02045f6e5f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:51.946273 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36080b2f-5ca3-43e1-8bd8-1f02045f6e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:51.946735 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36080b2f-5ca3-43e1-8bd8-1f02045f6e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:51.947765 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36080b2f-5ca3-43e1-8bd8-1f02045f6e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:51.954742 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36080b2f-5ca3-43e1-8bd8-1f02045f6e5f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:51.965039 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 854/1734] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:51.966743 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9ae55-c2fd-4390-82ca-dcb2a7350ccd None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:51.969345 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9ae55-c2fd-4390-82ca-dcb2a7350ccd None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:51.969848 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9ae55-c2fd-4390-82ca-dcb2a7350ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:51.999780 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 881/1735] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:52.000612 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36080b2f-5ca3-43e1-8bd8-1f02045f6e5f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:52.004887 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-36080b2f-5ca3-43e1-8bd8-1f02045f6e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:52.012320 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-7cb9ae55-c2fd-4390-82ca-dcb2a7350ccd None None] MFA Rules not processed for user `fa3a96ff9ab74aeb88465b14de3038eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:52.018607 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-7cb9ae55-c2fd-4390-82ca-dcb2a7350ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:52.140575 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 855/1736] 10.222.0.15 () {58 vars in 1015 bytes} [Mon Jan 10 12:47:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:52.141522 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9ae55-c2fd-4390-82ca-dcb2a7350ccd None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:52.160259 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36080b2f-5ca3-43e1-8bd8-1f02045f6e5f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:52.166563 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9ae55-c2fd-4390-82ca-dcb2a7350ccd None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:52.178887 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772d68f-65d7-45da-8b7d-79a5b8f85783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:52.179981 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772d68f-65d7-45da-8b7d-79a5b8f85783 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:52.180355 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772d68f-65d7-45da-8b7d-79a5b8f85783 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:52.180713 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772d68f-65d7-45da-8b7d-79a5b8f85783 admin admin] PATH_INFO: `/v3/projects/c0acdab4045c4a00a336247098e73719/users/d54db1f4f53043ddb39b6529a3f80e17/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:52.184036 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c19f5b-a80a-4a08-8021-a1aa6a90c217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:52.184312 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c19f5b-a80a-4a08-8021-a1aa6a90c217 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:52.184597 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c19f5b-a80a-4a08-8021-a1aa6a90c217 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:52.184869 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c19f5b-a80a-4a08-8021-a1aa6a90c217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:52.193408 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-41c19f5b-a80a-4a08-8021-a1aa6a90c217 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:52.231131 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772d68f-65d7-45da-8b7d-79a5b8f85783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0acdab4045c4a00a336247098e73719, user_id=d54db1f4f53043ddb39b6529a3f80e17, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:52.234191 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772d68f-65d7-45da-8b7d-79a5b8f85783 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:52.260769 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 856/1737] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:52 2022] PUT /identity/v3/projects/c0acdab4045c4a00a336247098e73719/users/d54db1f4f53043ddb39b6529a3f80e17/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:52.260769 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772d68f-65d7-45da-8b7d-79a5b8f85783 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:52.382421 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772d68f-65d7-45da-8b7d-79a5b8f85783 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:52.390408 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3327d2c-f418-406b-a1eb-19a82f077385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:52.391062 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3327d2c-f418-406b-a1eb-19a82f077385 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:52.391347 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3327d2c-f418-406b-a1eb-19a82f077385 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:52.391754 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3327d2c-f418-406b-a1eb-19a82f077385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:52.400764 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3327d2c-f418-406b-a1eb-19a82f077385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:52.402338 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3327d2c-f418-406b-a1eb-19a82f077385 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:52.426999 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 857/1738] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:52.428056 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3327d2c-f418-406b-a1eb-19a82f077385 service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:52.438771 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c19f5b-a80a-4a08-8021-a1aa6a90c217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:52.446748 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c19f5b-a80a-4a08-8021-a1aa6a90c217 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:52.485398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 882/1739] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:52.486049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c19f5b-a80a-4a08-8021-a1aa6a90c217 service cinder] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:52.538738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c19f5b-a80a-4a08-8021-a1aa6a90c217 service cinder] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:52.553981 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af56f6b-6413-4e42-ace5-6bd5077f812b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:52.554673 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af56f6b-6413-4e42-ace5-6bd5077f812b service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:52.556973 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af56f6b-6413-4e42-ace5-6bd5077f812b service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:52.560070 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af56f6b-6413-4e42-ace5-6bd5077f812b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:52.583749 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af56f6b-6413-4e42-ace5-6bd5077f812b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:52.588499 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af56f6b-6413-4e42-ace5-6bd5077f812b service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:52.633859 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 883/1740] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:52.634837 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af56f6b-6413-4e42-ace5-6bd5077f812b service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:52.642005 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-1af56f6b-6413-4e42-ace5-6bd5077f812b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:52.681951 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3327d2c-f418-406b-a1eb-19a82f077385 service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:52.692678 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af56f6b-6413-4e42-ace5-6bd5077f812b service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:52.694022 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddc449-c5c0-4f69-89e8-b0dfba7418b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:52.695686 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddc449-c5c0-4f69-89e8-b0dfba7418b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:52.696335 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddc449-c5c0-4f69-89e8-b0dfba7418b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:52.696615 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddc449-c5c0-4f69-89e8-b0dfba7418b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:52.698739 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeddc449-c5c0-4f69-89e8-b0dfba7418b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:52.711401 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f64d576-90f1-4dd1-8d9e-069e25d72a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:52.712099 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeddc449-c5c0-4f69-89e8-b0dfba7418b8 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:52.712998 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64d576-90f1-4dd1-8d9e-069e25d72a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:52.714424 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64d576-90f1-4dd1-8d9e-069e25d72a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:52.714714 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f64d576-90f1-4dd1-8d9e-069e25d72a39 admin admin] PATH_INFO: `/v3/projects/b731c137a19649a193f5a7da2315b01a` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:52.719109 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f64d576-90f1-4dd1-8d9e-069e25d72a39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b731c137a19649a193f5a7da2315b01a)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:52.721549 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: WARNING py.warnings [None req-1f64d576-90f1-4dd1-8d9e-069e25d72a39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 10 12:47:52.721549 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: warnings.warn(msg) Jan 10 12:47:52.721549 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: Jan 10 12:47:52.725532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f64d576-90f1-4dd1-8d9e-069e25d72a39 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:52.755347 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 858/1741] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:52.758555 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddc449-c5c0-4f69-89e8-b0dfba7418b8 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:52.835141 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddc449-c5c0-4f69-89e8-b0dfba7418b8 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:52.843384 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefbec3-1e63-4793-9024-6769dc22aec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:52.844335 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefbec3-1e63-4793-9024-6769dc22aec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:52.844613 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefbec3-1e63-4793-9024-6769dc22aec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:52.844915 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefbec3-1e63-4793-9024-6769dc22aec0 admin admin] PATH_INFO: `/v3/projects/c0acdab4045c4a00a336247098e73719/users/d54db1f4f53043ddb39b6529a3f80e17/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:52.856577 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefbec3-1e63-4793-9024-6769dc22aec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0acdab4045c4a00a336247098e73719, user_id=d54db1f4f53043ddb39b6529a3f80e17, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:52.862679 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefbec3-1e63-4793-9024-6769dc22aec0 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:52.920654 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 859/1742] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:52 2022] PUT /identity/v3/projects/c0acdab4045c4a00a336247098e73719/users/d54db1f4f53043ddb39b6529a3f80e17/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:52.933671 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94426b14-b225-4da6-9d39-f43fa56fd9fa None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:52.934251 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94426b14-b225-4da6-9d39-f43fa56fd9fa None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:52.935228 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94426b14-b225-4da6-9d39-f43fa56fd9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:52.984661 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-1f64d576-90f1-4dd1-8d9e-069e25d72a39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b731c137a19649a193f5a7da2315b01a', 'request_id': 'req-1f64d576-90f1-4dd1-8d9e-069e25d72a39'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:53.050094 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-94426b14-b225-4da6-9d39-f43fa56fd9fa None None] MFA Rules not processed for user `d54db1f4f53043ddb39b6529a3f80e17`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:53.053030 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-94426b14-b225-4da6-9d39-f43fa56fd9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:53.056726 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-1f64d576-90f1-4dd1-8d9e-069e25d72a39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b731c137a19649a193f5a7da2315b01a', 'request_id': 'req-1f64d576-90f1-4dd1-8d9e-069e25d72a39'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:53.089730 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-1f64d576-90f1-4dd1-8d9e-069e25d72a39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b731c137a19649a193f5a7da2315b01a', 'request_id': 'req-1f64d576-90f1-4dd1-8d9e-069e25d72a39'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:53.153903 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-1f64d576-90f1-4dd1-8d9e-069e25d72a39 admin admin] The token cache is being invalidate because project b731c137a19649a193f5a7da2315b01a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:47:53.158566 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-1f64d576-90f1-4dd1-8d9e-069e25d72a39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:53.163298 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-1f64d576-90f1-4dd1-8d9e-069e25d72a39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:53.172569 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 884/1743] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:47:52 2022] DELETE /identity/v3/projects/b731c137a19649a193f5a7da2315b01a => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:53.185747 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b01e4-1f34-4486-bac9-bb343564afc6 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:53.187274 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b01e4-1f34-4486-bac9-bb343564afc6 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:53.188563 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b01e4-1f34-4486-bac9-bb343564afc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:53.284764 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-e64b01e4-1f34-4486-bac9-bb343564afc6 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:53.303813 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-e64b01e4-1f34-4486-bac9-bb343564afc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:53.306690 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 860/1744] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:53.338068 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94426b14-b225-4da6-9d39-f43fa56fd9fa None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:53.340477 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-94426b14-b225-4da6-9d39-f43fa56fd9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:53.508398 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94426b14-b225-4da6-9d39-f43fa56fd9fa None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:53.535337 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec594c0-8945-439e-a072-a635cb7b2590 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:53.537223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec594c0-8945-439e-a072-a635cb7b2590 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:53.537781 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec594c0-8945-439e-a072-a635cb7b2590 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:53.538054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec594c0-8945-439e-a072-a635cb7b2590 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:53.578197 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec594c0-8945-439e-a072-a635cb7b2590 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:53.578588 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 885/1745] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:53.579690 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec594c0-8945-439e-a072-a635cb7b2590 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:53.580682 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b01e4-1f34-4486-bac9-bb343564afc6 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:53.582331 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-e64b01e4-1f34-4486-bac9-bb343564afc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:53.601159 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b01e4-1f34-4486-bac9-bb343564afc6 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:53.607852 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ce6ad-54b0-416c-8018-1df10f6f5cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:53.608906 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 861/1746] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:47:53.610008 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ce6ad-54b0-416c-8018-1df10f6f5cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:53.610596 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ce6ad-54b0-416c-8018-1df10f6f5cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:53.613700 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca653c-b10a-4434-adb6-1bc21321f9f4 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:53.613987 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca653c-b10a-4434-adb6-1bc21321f9f4 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:53.614262 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca653c-b10a-4434-adb6-1bc21321f9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:53.631688 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ce6ad-54b0-416c-8018-1df10f6f5cb5 admin admin] PATH_INFO: `/v3/projects/d85ef3da3ad3436eb027c224e9ecbc9e` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:53.635182 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ce6ad-54b0-416c-8018-1df10f6f5cb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85ef3da3ad3436eb027c224e9ecbc9e)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:53.642265 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ce6ad-54b0-416c-8018-1df10f6f5cb5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:53.723242 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-b4ca653c-b10a-4434-adb6-1bc21321f9f4 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:53.727711 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-b4ca653c-b10a-4434-adb6-1bc21321f9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:53.765094 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 862/1747] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:53.767076 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca653c-b10a-4434-adb6-1bc21321f9f4 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:53.769806 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-b4ca653c-b10a-4434-adb6-1bc21321f9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:53.787019 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca653c-b10a-4434-adb6-1bc21321f9f4 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:53.820557 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-b21ce6ad-54b0-416c-8018-1df10f6f5cb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85ef3da3ad3436eb027c224e9ecbc9e', 'request_id': 'req-b21ce6ad-54b0-416c-8018-1df10f6f5cb5'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:53.827273 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-b21ce6ad-54b0-416c-8018-1df10f6f5cb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85ef3da3ad3436eb027c224e9ecbc9e', 'request_id': 'req-b21ce6ad-54b0-416c-8018-1df10f6f5cb5'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:53.856381 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-b21ce6ad-54b0-416c-8018-1df10f6f5cb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85ef3da3ad3436eb027c224e9ecbc9e', 'request_id': 'req-b21ce6ad-54b0-416c-8018-1df10f6f5cb5'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:53.886180 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-b21ce6ad-54b0-416c-8018-1df10f6f5cb5 admin admin] The token cache is being invalidate because project d85ef3da3ad3436eb027c224e9ecbc9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:47:53.886439 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-b21ce6ad-54b0-416c-8018-1df10f6f5cb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:53.887106 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-b21ce6ad-54b0-416c-8018-1df10f6f5cb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:53.891784 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 886/1748] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:47:53 2022] DELETE /identity/v3/projects/d85ef3da3ad3436eb027c224e9ecbc9e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:53.891784 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ce6ad-54b0-416c-8018-1df10f6f5cb5 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:53.892510 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b21ce6ad-54b0-416c-8018-1df10f6f5cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:53.991485 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c93be1-086f-4378-b138-b00c3e677531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:53.993059 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c93be1-086f-4378-b138-b00c3e677531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:53.993554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c93be1-086f-4378-b138-b00c3e677531 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:53.994281 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c93be1-086f-4378-b138-b00c3e677531 admin admin] PATH_INFO: `/v3/users/7ea1c52bb4294b93ace8702bc8142410` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:53.999172 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c93be1-086f-4378-b138-b00c3e677531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea1c52bb4294b93ace8702bc8142410)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:54.003615 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c93be1-086f-4378-b138-b00c3e677531 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:54.038923 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ce6ad-54b0-416c-8018-1df10f6f5cb5 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:54.054823 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4dc3f-0096-4e48-b23f-a5a7904c9b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:54.055540 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4dc3f-0096-4e48-b23f-a5a7904c9b69 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:54.055818 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4dc3f-0096-4e48-b23f-a5a7904c9b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:54.056087 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4dc3f-0096-4e48-b23f-a5a7904c9b69 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:54.056839 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4dc3f-0096-4e48-b23f-a5a7904c9b69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:47:54.057136 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4dc3f-0096-4e48-b23f-a5a7904c9b69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:54.058764 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea4dc3f-0096-4e48-b23f-a5a7904c9b69 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:54.090560 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 887/1749] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:47:54.092422 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4dc3f-0096-4e48-b23f-a5a7904c9b69 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:54.099480 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-2ea4dc3f-0096-4e48-b23f-a5a7904c9b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:54.126024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4dc3f-0096-4e48-b23f-a5a7904c9b69 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:54.134024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6707f-1237-4dd9-8470-bf309dd6bc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:54.135420 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6707f-1237-4dd9-8470-bf309dd6bc2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:54.135990 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6707f-1237-4dd9-8470-bf309dd6bc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:54.136267 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6707f-1237-4dd9-8470-bf309dd6bc2c admin admin] PATH_INFO: `/v3/users/2753de43fcae4ffc9b9ca158ea1f1ee9` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:54.138329 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6707f-1237-4dd9-8470-bf309dd6bc2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2753de43fcae4ffc9b9ca158ea1f1ee9)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:54.141439 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6707f-1237-4dd9-8470-bf309dd6bc2c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:54.186686 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-e5c93be1-086f-4378-b138-b00c3e677531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea1c52bb4294b93ace8702bc8142410'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:54.187812 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-e5c93be1-086f-4378-b138-b00c3e677531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea1c52bb4294b93ace8702bc8142410'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:54.188454 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-e5c93be1-086f-4378-b138-b00c3e677531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea1c52bb4294b93ace8702bc8142410'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:54.222767 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-e5c93be1-086f-4378-b138-b00c3e677531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea1c52bb4294b93ace8702bc8142410'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:54.238408 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ffe6707f-1237-4dd9-8470-bf309dd6bc2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2753de43fcae4ffc9b9ca158ea1f1ee9'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:54.249184 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-e5c93be1-086f-4378-b138-b00c3e677531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea1c52bb4294b93ace8702bc8142410'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:54.261350 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ffe6707f-1237-4dd9-8470-bf309dd6bc2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2753de43fcae4ffc9b9ca158ea1f1ee9'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:54.274684 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ffe6707f-1237-4dd9-8470-bf309dd6bc2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2753de43fcae4ffc9b9ca158ea1f1ee9'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:54.275547 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ffe6707f-1237-4dd9-8470-bf309dd6bc2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2753de43fcae4ffc9b9ca158ea1f1ee9'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:54.276396 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ffe6707f-1237-4dd9-8470-bf309dd6bc2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2753de43fcae4ffc9b9ca158ea1f1ee9'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:54.283474 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 863/1750] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:47:53 2022] DELETE /identity/v3/users/7ea1c52bb4294b93ace8702bc8142410 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:54.286192 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b93cc-69a6-445b-be1b-53d4134c0c75 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:54.287978 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b93cc-69a6-445b-be1b-53d4134c0c75 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:54.288335 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b93cc-69a6-445b-be1b-53d4134c0c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:54.310176 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 888/1751] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:47:54 2022] DELETE /identity/v3/users/2753de43fcae4ffc9b9ca158ea1f1ee9 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:54.332149 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6707f-1237-4dd9-8470-bf309dd6bc2c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:54.332937 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-2b2b93cc-69a6-445b-be1b-53d4134c0c75 None None] MFA Rules not processed for user `c7c2b5d01a124f3e94bc557b641f77a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:54.337211 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ffe6707f-1237-4dd9-8470-bf309dd6bc2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:54.337600 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-2b2b93cc-69a6-445b-be1b-53d4134c0c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:54.486781 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 864/1752] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:54.486781 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9ab1d-afb9-45c2-94f9-a393ff57f0f7 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:54.486781 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9ab1d-afb9-45c2-94f9-a393ff57f0f7 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:54.487963 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9ab1d-afb9-45c2-94f9-a393ff57f0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:54.526902 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-7ff9ab1d-afb9-45c2-94f9-a393ff57f0f7 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:54.528175 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-7ff9ab1d-afb9-45c2-94f9-a393ff57f0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:54.586718 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6707f-1237-4dd9-8470-bf309dd6bc2c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:54.636510 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc239cd-8f84-4f0f-8296-bf04f551d839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:54.637393 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc239cd-8f84-4f0f-8296-bf04f551d839 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:54.637674 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc239cd-8f84-4f0f-8296-bf04f551d839 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:54.637939 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc239cd-8f84-4f0f-8296-bf04f551d839 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:54.638858 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc239cd-8f84-4f0f-8296-bf04f551d839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:54.649609 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc239cd-8f84-4f0f-8296-bf04f551d839 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:54.712423 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 889/1753] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:47:54 2022] POST /identity/v3/projects => generated 371 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:54.715793 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc239cd-8f84-4f0f-8296-bf04f551d839 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:54.787407 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 865/1754] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:54.932264 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9ab1d-afb9-45c2-94f9-a393ff57f0f7 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:54.933962 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-7ff9ab1d-afb9-45c2-94f9-a393ff57f0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:54.946888 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc239cd-8f84-4f0f-8296-bf04f551d839 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:54.965763 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd31d5-ff7f-4be1-a044-e1dfeaa40d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:54.966493 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd31d5-ff7f-4be1-a044-e1dfeaa40d61 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:54.966756 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd31d5-ff7f-4be1-a044-e1dfeaa40d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:54.967083 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd31d5-ff7f-4be1-a044-e1dfeaa40d61 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:54.967843 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd31d5-ff7f-4be1-a044-e1dfeaa40d61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:54.969971 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd31d5-ff7f-4be1-a044-e1dfeaa40d61 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:55.055163 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9ab1d-afb9-45c2-94f9-a393ff57f0f7 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:55.065952 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 890/1755] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:47:54 2022] POST /identity/v3/users => generated 286 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:55.068406 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd31d5-ff7f-4be1-a044-e1dfeaa40d61 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:55.120623 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd31d5-ff7f-4be1-a044-e1dfeaa40d61 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:55.135991 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1471c-084b-4a25-84fa-3eb10d58dc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:55.137731 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1471c-084b-4a25-84fa-3eb10d58dc16 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:55.138961 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1471c-084b-4a25-84fa-3eb10d58dc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:55.139820 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1471c-084b-4a25-84fa-3eb10d58dc16 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:55.141763 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1471c-084b-4a25-84fa-3eb10d58dc16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:55.146623 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1471c-084b-4a25-84fa-3eb10d58dc16 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:55.173958 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a261810-3c31-4628-a125-7afd0a989795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:55.175423 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a261810-3c31-4628-a125-7afd0a989795 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:55.179899 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a261810-3c31-4628-a125-7afd0a989795 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:55.180842 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a261810-3c31-4628-a125-7afd0a989795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:55.194773 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 891/1756] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:55.199442 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1471c-084b-4a25-84fa-3eb10d58dc16 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:55.223016 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a261810-3c31-4628-a125-7afd0a989795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:55.223668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1471c-084b-4a25-84fa-3eb10d58dc16 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:55.227123 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a261810-3c31-4628-a125-7afd0a989795 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:55.236849 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95db41-7cbb-463a-b1c7-726eccf9d1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:55.238555 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95db41-7cbb-463a-b1c7-726eccf9d1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:55.238837 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95db41-7cbb-463a-b1c7-726eccf9d1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:55.239106 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95db41-7cbb-463a-b1c7-726eccf9d1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:55.240883 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95db41-7cbb-463a-b1c7-726eccf9d1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:55.243855 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95db41-7cbb-463a-b1c7-726eccf9d1a1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:55.257774 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 866/1757] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:47:55.287141 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 892/1758] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:55.292009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a261810-3c31-4628-a125-7afd0a989795 service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:55.314684 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a261810-3c31-4628-a125-7afd0a989795 service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:55.331093 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fc82c-ee6f-45e0-b1a8-598e6887f706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:55.333889 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fc82c-ee6f-45e0-b1a8-598e6887f706 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:55.334180 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fc82c-ee6f-45e0-b1a8-598e6887f706 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:55.334492 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fc82c-ee6f-45e0-b1a8-598e6887f706 admin admin] PATH_INFO: `/v3/projects/02c0e6d2855245dc9f6744d9a85afa3b/users/0553226ca2ba4d85af8ef1984f5e3ee4/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:55.393943 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4fc82c-ee6f-45e0-b1a8-598e6887f706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c0e6d2855245dc9f6744d9a85afa3b, user_id=0553226ca2ba4d85af8ef1984f5e3ee4, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:55.397832 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4fc82c-ee6f-45e0-b1a8-598e6887f706 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:55.431311 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 867/1759] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:55 2022] PUT /identity/v3/projects/02c0e6d2855245dc9f6744d9a85afa3b/users/0553226ca2ba4d85af8ef1984f5e3ee4/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:47:55.443379 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0d4ad-d7b9-4be9-9261-6e3049e245ee None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:55.443992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0d4ad-d7b9-4be9-9261-6e3049e245ee None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:55.444465 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0d4ad-d7b9-4be9-9261-6e3049e245ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:55.531881 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fc82c-ee6f-45e0-b1a8-598e6887f706 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:55.537109 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-ac4fc82c-ee6f-45e0-b1a8-598e6887f706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:55.552655 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-46a0d4ad-d7b9-4be9-9261-6e3049e245ee None None] MFA Rules not processed for user `0553226ca2ba4d85af8ef1984f5e3ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:55.554119 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-46a0d4ad-d7b9-4be9-9261-6e3049e245ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:55.691696 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 893/1760] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:55.695155 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0d4ad-d7b9-4be9-9261-6e3049e245ee None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:55.735184 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fc82c-ee6f-45e0-b1a8-598e6887f706 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:55.739980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c9181-274f-4095-bbbd-414ad014e50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:55.740963 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9181-274f-4095-bbbd-414ad014e50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:55.741241 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9181-274f-4095-bbbd-414ad014e50d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:55.741506 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c9181-274f-4095-bbbd-414ad014e50d admin admin] PATH_INFO: `/v3/projects/380288d7425a41e98d3acdca88a72e97` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:55.742815 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c9181-274f-4095-bbbd-414ad014e50d admin admin] RBAC: Authorizing `identity:delete_project(project_id=380288d7425a41e98d3acdca88a72e97)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:55.744906 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c9181-274f-4095-bbbd-414ad014e50d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:55.808504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0d4ad-d7b9-4be9-9261-6e3049e245ee None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:55.835152 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-159c9181-274f-4095-bbbd-414ad014e50d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380288d7425a41e98d3acdca88a72e97', 'request_id': 'req-159c9181-274f-4095-bbbd-414ad014e50d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:55.855344 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-159c9181-274f-4095-bbbd-414ad014e50d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380288d7425a41e98d3acdca88a72e97', 'request_id': 'req-159c9181-274f-4095-bbbd-414ad014e50d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:55.866068 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-159c9181-274f-4095-bbbd-414ad014e50d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380288d7425a41e98d3acdca88a72e97', 'request_id': 'req-159c9181-274f-4095-bbbd-414ad014e50d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:55.891069 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-159c9181-274f-4095-bbbd-414ad014e50d admin admin] The token cache is being invalidate because project 380288d7425a41e98d3acdca88a72e97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:47:55.891498 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-159c9181-274f-4095-bbbd-414ad014e50d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:55.896055 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-159c9181-274f-4095-bbbd-414ad014e50d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:55.903766 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 868/1761] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:47:55 2022] DELETE /identity/v3/projects/380288d7425a41e98d3acdca88a72e97 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:47:55.905397 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1b010-40fa-4e5a-8154-0200ae54c820 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:55.906037 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1b010-40fa-4e5a-8154-0200ae54c820 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:55.906409 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1b010-40fa-4e5a-8154-0200ae54c820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:55.931984 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-4bf1b010-40fa-4e5a-8154-0200ae54c820 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:55.935648 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-4bf1b010-40fa-4e5a-8154-0200ae54c820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:55.947998 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249f9b3-25de-4b43-bc6d-dc9201b554b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:55.949417 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249f9b3-25de-4b43-bc6d-dc9201b554b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:55.949883 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249f9b3-25de-4b43-bc6d-dc9201b554b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:55.950341 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249f9b3-25de-4b43-bc6d-dc9201b554b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:55.951236 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249f9b3-25de-4b43-bc6d-dc9201b554b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:55.953783 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249f9b3-25de-4b43-bc6d-dc9201b554b8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:56.003081 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 894/1762] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:47:55 2022] POST /identity/v3/projects => generated 373 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:47:56.006234 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249f9b3-25de-4b43-bc6d-dc9201b554b8 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:56.009885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c249f9b3-25de-4b43-bc6d-dc9201b554b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:56.031462 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 869/1763] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:56.033934 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8536b-48b9-4bf8-a054-98ee68ecec73 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:56.034387 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8536b-48b9-4bf8-a054-98ee68ecec73 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:56.034816 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8536b-48b9-4bf8-a054-98ee68ecec73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:56.081519 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-89a8536b-48b9-4bf8-a054-98ee68ecec73 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:56.083882 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-89a8536b-48b9-4bf8-a054-98ee68ecec73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:56.152785 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249f9b3-25de-4b43-bc6d-dc9201b554b8 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:56.166007 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d8d95-b804-4091-a63c-726fca6b2695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:56.167147 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d8d95-b804-4091-a63c-726fca6b2695 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:56.168053 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d8d95-b804-4091-a63c-726fca6b2695 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:56.168620 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d8d95-b804-4091-a63c-726fca6b2695 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:56.169502 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d8d95-b804-4091-a63c-726fca6b2695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:56.171809 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d8d95-b804-4091-a63c-726fca6b2695 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:56.201939 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 870/1764] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:56.203137 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8536b-48b9-4bf8-a054-98ee68ecec73 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:56.211494 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 895/1765] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:47:56 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:56.215738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d8d95-b804-4091-a63c-726fca6b2695 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:56.237750 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d8d95-b804-4091-a63c-726fca6b2695 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:56.241955 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8536b-48b9-4bf8-a054-98ee68ecec73 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:56.248208 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb0397-96a3-4aab-abf0-0a1d1ca5ef9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:56.249080 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb0397-96a3-4aab-abf0-0a1d1ca5ef9b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:56.249636 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb0397-96a3-4aab-abf0-0a1d1ca5ef9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:56.250024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb0397-96a3-4aab-abf0-0a1d1ca5ef9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:56.251052 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb0397-96a3-4aab-abf0-0a1d1ca5ef9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:56.253369 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb0397-96a3-4aab-abf0-0a1d1ca5ef9b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:56.263430 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718220a-614b-4fe3-b50e-680b839feb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:56.264316 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718220a-614b-4fe3-b50e-680b839feb7a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:56.264669 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718220a-614b-4fe3-b50e-680b839feb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:56.265038 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718220a-614b-4fe3-b50e-680b839feb7a admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:56.265890 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718220a-614b-4fe3-b50e-680b839feb7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:47:56.266295 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718220a-614b-4fe3-b50e-680b839feb7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:56.268065 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718220a-614b-4fe3-b50e-680b839feb7a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:56.268924 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 896/1766] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:56.277323 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb0397-96a3-4aab-abf0-0a1d1ca5ef9b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:56.286965 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 871/1767] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:47:56.288795 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718220a-614b-4fe3-b50e-680b839feb7a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:56.295496 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb0397-96a3-4aab-abf0-0a1d1ca5ef9b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:56.301560 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a2429-ddf2-4144-9b96-6d2470dc1df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:56.302697 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a2429-ddf2-4144-9b96-6d2470dc1df2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:56.302975 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718220a-614b-4fe3-b50e-680b839feb7a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:56.303271 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a2429-ddf2-4144-9b96-6d2470dc1df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:56.303712 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a2429-ddf2-4144-9b96-6d2470dc1df2 admin admin] PATH_INFO: `/v3/projects/d087f767094c440c83dfe44cd3b53fe4/users/b4cd94b658d24538a2e1e690da644441/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:56.309927 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88422627-e0ff-42d5-8efc-b1461e82c66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:56.311451 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88422627-e0ff-42d5-8efc-b1461e82c66e admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:56.311758 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88422627-e0ff-42d5-8efc-b1461e82c66e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:56.312128 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88422627-e0ff-42d5-8efc-b1461e82c66e admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:56.313111 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88422627-e0ff-42d5-8efc-b1461e82c66e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:56.315360 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88422627-e0ff-42d5-8efc-b1461e82c66e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:56.355858 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a2429-ddf2-4144-9b96-6d2470dc1df2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d087f767094c440c83dfe44cd3b53fe4, user_id=b4cd94b658d24538a2e1e690da644441, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:56.366213 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a2429-ddf2-4144-9b96-6d2470dc1df2 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:56.391662 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 872/1768] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:47:56 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:56.393613 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88422627-e0ff-42d5-8efc-b1461e82c66e admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:56.409837 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 897/1769] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:56 2022] PUT /identity/v3/projects/d087f767094c440c83dfe44cd3b53fe4/users/b4cd94b658d24538a2e1e690da644441/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:56.415471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a2429-ddf2-4144-9b96-6d2470dc1df2 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:56.528537 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88422627-e0ff-42d5-8efc-b1461e82c66e admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:56.626727 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a2429-ddf2-4144-9b96-6d2470dc1df2 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:56.647552 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839dcad-e250-4449-9add-7ebfedbbac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:56.648253 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839dcad-e250-4449-9add-7ebfedbbac6e admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:56.648535 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839dcad-e250-4449-9add-7ebfedbbac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:56.664732 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3f51f-c511-479e-8a0f-e6684d661c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:56.665566 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3f51f-c511-479e-8a0f-e6684d661c23 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:56.665918 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3f51f-c511-479e-8a0f-e6684d661c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:56.666189 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3f51f-c511-479e-8a0f-e6684d661c23 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:56.666991 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839dcad-e250-4449-9add-7ebfedbbac6e admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:56.668432 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3f51f-c511-479e-8a0f-e6684d661c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:56.672869 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839dcad-e250-4449-9add-7ebfedbbac6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:56.676862 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3f51f-c511-479e-8a0f-e6684d661c23 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:56.683024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839dcad-e250-4449-9add-7ebfedbbac6e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:56.743905 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 898/1770] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:56.745256 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839dcad-e250-4449-9add-7ebfedbbac6e admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:56.755657 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b839dcad-e250-4449-9add-7ebfedbbac6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:56.782409 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 873/1771] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:47:56 2022] POST /identity/v3/users => generated 291 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:47:56.784363 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3f51f-c511-479e-8a0f-e6684d661c23 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:56.822083 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3f51f-c511-479e-8a0f-e6684d661c23 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:56.823312 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839dcad-e250-4449-9add-7ebfedbbac6e admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:56.836519 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37d2cc-795e-4786-aa1c-7b0bde1883e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:56.837446 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37d2cc-795e-4786-aa1c-7b0bde1883e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:56.837724 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37d2cc-795e-4786-aa1c-7b0bde1883e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:56.838144 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37d2cc-795e-4786-aa1c-7b0bde1883e5 admin admin] PATH_INFO: `/v3/projects/d087f767094c440c83dfe44cd3b53fe4/users/b4cd94b658d24538a2e1e690da644441/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:56.844688 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37d2cc-795e-4786-aa1c-7b0bde1883e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d087f767094c440c83dfe44cd3b53fe4, user_id=b4cd94b658d24538a2e1e690da644441, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:56.846418 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d143b9f-2a05-48bf-98c6-55715267e309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:56.847731 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d143b9f-2a05-48bf-98c6-55715267e309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:56.848079 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d143b9f-2a05-48bf-98c6-55715267e309 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:56.848363 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d143b9f-2a05-48bf-98c6-55715267e309 admin admin] PATH_INFO: `/v3/projects/ab7f6eb201714e5ba3f79d2d0ddb8e66` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:56.850013 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37d2cc-795e-4786-aa1c-7b0bde1883e5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:56.860838 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d143b9f-2a05-48bf-98c6-55715267e309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab7f6eb201714e5ba3f79d2d0ddb8e66)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:56.868665 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d143b9f-2a05-48bf-98c6-55715267e309 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:56.886693 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 874/1772] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:56 2022] PUT /identity/v3/projects/d087f767094c440c83dfe44cd3b53fe4/users/b4cd94b658d24538a2e1e690da644441/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:56.887581 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37d2cc-795e-4786-aa1c-7b0bde1883e5 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:57.012191 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-6d143b9f-2a05-48bf-98c6-55715267e309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7f6eb201714e5ba3f79d2d0ddb8e66', 'request_id': 'req-6d143b9f-2a05-48bf-98c6-55715267e309'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:57.026093 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-6d143b9f-2a05-48bf-98c6-55715267e309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7f6eb201714e5ba3f79d2d0ddb8e66', 'request_id': 'req-6d143b9f-2a05-48bf-98c6-55715267e309'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:57.053602 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-6d143b9f-2a05-48bf-98c6-55715267e309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7f6eb201714e5ba3f79d2d0ddb8e66', 'request_id': 'req-6d143b9f-2a05-48bf-98c6-55715267e309'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:57.069202 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37d2cc-795e-4786-aa1c-7b0bde1883e5 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:57.089314 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-6d143b9f-2a05-48bf-98c6-55715267e309 admin admin] The token cache is being invalidate because project ab7f6eb201714e5ba3f79d2d0ddb8e66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:47:57.089718 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-6d143b9f-2a05-48bf-98c6-55715267e309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:57.090510 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-6d143b9f-2a05-48bf-98c6-55715267e309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:57.099397 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 899/1773] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:47:56 2022] DELETE /identity/v3/projects/ab7f6eb201714e5ba3f79d2d0ddb8e66 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:57.102785 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763b2aa-7660-4a28-ae46-dc1b4f21a752 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:57.103459 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763b2aa-7660-4a28-ae46-dc1b4f21a752 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:57.104287 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763b2aa-7660-4a28-ae46-dc1b4f21a752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:57.145597 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-0763b2aa-7660-4a28-ae46-dc1b4f21a752 None None] MFA Rules not processed for user `b4cd94b658d24538a2e1e690da644441`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:57.147400 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-0763b2aa-7660-4a28-ae46-dc1b4f21a752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:57.198943 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf4775-a49c-4fec-9415-c2eab82423c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:57.199469 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf4775-a49c-4fec-9415-c2eab82423c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:57.201734 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf4775-a49c-4fec-9415-c2eab82423c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:57.202016 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf4775-a49c-4fec-9415-c2eab82423c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:57.202777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf4775-a49c-4fec-9415-c2eab82423c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:57.207447 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf4775-a49c-4fec-9415-c2eab82423c7 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:57.233791 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 875/1774] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:57.235315 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf2038-8243-4a40-a2fe-8354720f4779 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:57.237568 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf2038-8243-4a40-a2fe-8354720f4779 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:57.237871 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf2038-8243-4a40-a2fe-8354720f4779 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:57.245919 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 876/1775] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jan 10 12:47:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:47:57.246841 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf2038-8243-4a40-a2fe-8354720f4779 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:57.255278 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-11bf2038-8243-4a40-a2fe-8354720f4779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:57.289731 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf2038-8243-4a40-a2fe-8354720f4779 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:57.301749 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd186fab-7f37-4f21-b86e-48f477c2eebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:57.302813 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd186fab-7f37-4f21-b86e-48f477c2eebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:57.302999 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd186fab-7f37-4f21-b86e-48f477c2eebe admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:57.303252 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd186fab-7f37-4f21-b86e-48f477c2eebe admin admin] PATH_INFO: `/v3/users/d54db1f4f53043ddb39b6529a3f80e17` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:57.308365 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd186fab-7f37-4f21-b86e-48f477c2eebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d54db1f4f53043ddb39b6529a3f80e17)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:57.323667 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd186fab-7f37-4f21-b86e-48f477c2eebe admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:57.337766 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 900/1776] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:57.337766 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763b2aa-7660-4a28-ae46-dc1b4f21a752 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:57.337766 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-0763b2aa-7660-4a28-ae46-dc1b4f21a752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:57.372955 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763b2aa-7660-4a28-ae46-dc1b4f21a752 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:57.379138 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa75ae-7495-4108-be84-3ef054924f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:57.379873 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa75ae-7495-4108-be84-3ef054924f41 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:57.380149 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa75ae-7495-4108-be84-3ef054924f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:57.380418 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa75ae-7495-4108-be84-3ef054924f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:57.381377 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa75ae-7495-4108-be84-3ef054924f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:57.383233 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa75ae-7495-4108-be84-3ef054924f41 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:57.396268 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 901/1777] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:57.397954 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4239950-4008-40d6-a90b-a1b3914c0ab7 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:57.399035 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4239950-4008-40d6-a90b-a1b3914c0ab7 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:57.399615 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4239950-4008-40d6-a90b-a1b3914c0ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:57.412002 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bd186fab-7f37-4f21-b86e-48f477c2eebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd54db1f4f53043ddb39b6529a3f80e17'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:57.412807 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bd186fab-7f37-4f21-b86e-48f477c2eebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd54db1f4f53043ddb39b6529a3f80e17'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:57.413742 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bd186fab-7f37-4f21-b86e-48f477c2eebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd54db1f4f53043ddb39b6529a3f80e17'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:57.429901 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bd186fab-7f37-4f21-b86e-48f477c2eebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd54db1f4f53043ddb39b6529a3f80e17'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:57.438043 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bd186fab-7f37-4f21-b86e-48f477c2eebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd54db1f4f53043ddb39b6529a3f80e17'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:57.451071 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-b4239950-4008-40d6-a90b-a1b3914c0ab7 None None] MFA Rules not processed for user `d68fa8e4f3a341a5b74ee32c85e59869`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:57.452354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b4239950-4008-40d6-a90b-a1b3914c0ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:57.453571 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 877/1778] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:47:57 2022] DELETE /identity/v3/users/d54db1f4f53043ddb39b6529a3f80e17 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:57.457514 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd186fab-7f37-4f21-b86e-48f477c2eebe admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:57.458955 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-bd186fab-7f37-4f21-b86e-48f477c2eebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:57.544180 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd186fab-7f37-4f21-b86e-48f477c2eebe admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:57.550001 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13701b45-15df-4ab1-bc59-f71caf5820e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:57.550781 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13701b45-15df-4ab1-bc59-f71caf5820e3 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:57.551018 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13701b45-15df-4ab1-bc59-f71caf5820e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:57.551491 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13701b45-15df-4ab1-bc59-f71caf5820e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:57.553368 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-13701b45-15df-4ab1-bc59-f71caf5820e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:57.557526 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 902/1779] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jan 10 12:47:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:57.558674 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4239950-4008-40d6-a90b-a1b3914c0ab7 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:57.560439 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b4239950-4008-40d6-a90b-a1b3914c0ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:57.640278 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4239950-4008-40d6-a90b-a1b3914c0ab7 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:57.645529 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde52629-4bbf-4695-98c5-3228ffbe82ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:57.646435 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde52629-4bbf-4695-98c5-3228ffbe82ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:57.646708 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde52629-4bbf-4695-98c5-3228ffbe82ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:57.646972 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde52629-4bbf-4695-98c5-3228ffbe82ee admin admin] PATH_INFO: `/v3/projects/6f5aead8f1ab452b8826ce5c624a6167/users/3aaefa28358d4e539ed3a70fd4433dd4/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:57.648711 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13701b45-15df-4ab1-bc59-f71caf5820e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:57.650840 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13701b45-15df-4ab1-bc59-f71caf5820e3 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:57.663246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde52629-4bbf-4695-98c5-3228ffbe82ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f5aead8f1ab452b8826ce5c624a6167, user_id=3aaefa28358d4e539ed3a70fd4433dd4, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:57.664939 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 878/1780] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:57.665504 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13701b45-15df-4ab1-bc59-f71caf5820e3 service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:57.666161 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde52629-4bbf-4695-98c5-3228ffbe82ee admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:57.667116 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-13701b45-15df-4ab1-bc59-f71caf5820e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:57.697531 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 903/1781] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:57 2022] PUT /identity/v3/projects/6f5aead8f1ab452b8826ce5c624a6167/users/3aaefa28358d4e539ed3a70fd4433dd4/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:57.699297 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea727f4-6929-4f22-b63a-61a8f6c38458 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:57.699435 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea727f4-6929-4f22-b63a-61a8f6c38458 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:57.699678 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea727f4-6929-4f22-b63a-61a8f6c38458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:57.707566 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13701b45-15df-4ab1-bc59-f71caf5820e3 service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:57.728340 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-5ea727f4-6929-4f22-b63a-61a8f6c38458 None None] MFA Rules not processed for user `3aaefa28358d4e539ed3a70fd4433dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:57.731725 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-5ea727f4-6929-4f22-b63a-61a8f6c38458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:57.814756 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 904/1782] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:57.820166 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea727f4-6929-4f22-b63a-61a8f6c38458 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:57.836757 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253fcd74-57d6-4475-ba78-90f0227072b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:57.837576 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fcd74-57d6-4475-ba78-90f0227072b8 service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:57.837877 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fcd74-57d6-4475-ba78-90f0227072b8 service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:57.838110 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fcd74-57d6-4475-ba78-90f0227072b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:57.850327 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253fcd74-57d6-4475-ba78-90f0227072b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:57.851795 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253fcd74-57d6-4475-ba78-90f0227072b8 service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:57.866166 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 879/1783] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:57.866166 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253fcd74-57d6-4475-ba78-90f0227072b8 service nova] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:57.872423 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-253fcd74-57d6-4475-ba78-90f0227072b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:57.936900 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea727f4-6929-4f22-b63a-61a8f6c38458 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:57.943179 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fc9fc-4c24-4740-aac2-06db99ea7204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:57.944222 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fc9fc-4c24-4740-aac2-06db99ea7204 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:57.944810 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fc9fc-4c24-4740-aac2-06db99ea7204 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:57.945267 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fc9fc-4c24-4740-aac2-06db99ea7204 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:57.946205 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fc9fc-4c24-4740-aac2-06db99ea7204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:57.948570 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fc9fc-4c24-4740-aac2-06db99ea7204 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:57.987577 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253fcd74-57d6-4475-ba78-90f0227072b8 service nova] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:58.007302 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 905/1784] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:47:57 2022] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:47:58.009580 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fc9fc-4c24-4740-aac2-06db99ea7204 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:58.013244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33861c-c2e7-4da2-8467-1835f03b3851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:58.015711 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33861c-c2e7-4da2-8467-1835f03b3851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:58.016965 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33861c-c2e7-4da2-8467-1835f03b3851 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:58.018367 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33861c-c2e7-4da2-8467-1835f03b3851 admin admin] PATH_INFO: `/v3/projects/c0acdab4045c4a00a336247098e73719` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:58.021621 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33861c-c2e7-4da2-8467-1835f03b3851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0acdab4045c4a00a336247098e73719)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:58.026086 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33861c-c2e7-4da2-8467-1835f03b3851 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:58.141009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6f33861c-c2e7-4da2-8467-1835f03b3851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0acdab4045c4a00a336247098e73719', 'request_id': 'req-6f33861c-c2e7-4da2-8467-1835f03b3851'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:58.152620 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6f33861c-c2e7-4da2-8467-1835f03b3851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0acdab4045c4a00a336247098e73719', 'request_id': 'req-6f33861c-c2e7-4da2-8467-1835f03b3851'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:58.165067 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6f33861c-c2e7-4da2-8467-1835f03b3851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0acdab4045c4a00a336247098e73719', 'request_id': 'req-6f33861c-c2e7-4da2-8467-1835f03b3851'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:58.179291 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6f33861c-c2e7-4da2-8467-1835f03b3851 admin admin] The token cache is being invalidate because project c0acdab4045c4a00a336247098e73719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:47:58.179954 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6f33861c-c2e7-4da2-8467-1835f03b3851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:58.180861 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6f33861c-c2e7-4da2-8467-1835f03b3851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:58.183048 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 880/1785] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:47:57 2022] DELETE /identity/v3/projects/c0acdab4045c4a00a336247098e73719 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:58.197524 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fc9fc-4c24-4740-aac2-06db99ea7204 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:58.203361 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff62162-0bee-4ad7-aaf2-b03087c1f338 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:58.203361 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff62162-0bee-4ad7-aaf2-b03087c1f338 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:58.205259 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff62162-0bee-4ad7-aaf2-b03087c1f338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:58.270135 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-fff62162-0bee-4ad7-aaf2-b03087c1f338 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:58.271422 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-fff62162-0bee-4ad7-aaf2-b03087c1f338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:58.332498 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f01ce-5e4a-4c45-9bd0-74e561f6dd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:58.333185 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f01ce-5e4a-4c45-9bd0-74e561f6dd6c admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:58.333440 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f01ce-5e4a-4c45-9bd0-74e561f6dd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:58.333709 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f01ce-5e4a-4c45-9bd0-74e561f6dd6c admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:58.334643 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f01ce-5e4a-4c45-9bd0-74e561f6dd6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:58.336691 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f01ce-5e4a-4c45-9bd0-74e561f6dd6c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:58.388880 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 906/1786] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:47:58 2022] POST /identity/v3/users => generated 297 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:58.388880 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f01ce-5e4a-4c45-9bd0-74e561f6dd6c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:58.395615 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-333f01ce-5e4a-4c45-9bd0-74e561f6dd6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:58.401077 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 881/1787] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:58.402547 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff62162-0bee-4ad7-aaf2-b03087c1f338 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:58.405340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-fff62162-0bee-4ad7-aaf2-b03087c1f338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:58.448956 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f01ce-5e4a-4c45-9bd0-74e561f6dd6c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:58.467623 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3885902-f412-4b51-9f5e-10e770266ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:58.468569 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3885902-f412-4b51-9f5e-10e770266ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:58.468846 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3885902-f412-4b51-9f5e-10e770266ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:58.469114 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3885902-f412-4b51-9f5e-10e770266ef7 admin admin] PATH_INFO: `/v3/users/0553226ca2ba4d85af8ef1984f5e3ee4` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:58.473219 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3885902-f412-4b51-9f5e-10e770266ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0553226ca2ba4d85af8ef1984f5e3ee4)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:58.481874 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3885902-f412-4b51-9f5e-10e770266ef7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:58.485873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff62162-0bee-4ad7-aaf2-b03087c1f338 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:58.490582 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef6ab8-0b44-4bdc-bb17-effae874c221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:58.491261 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef6ab8-0b44-4bdc-bb17-effae874c221 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:58.491558 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef6ab8-0b44-4bdc-bb17-effae874c221 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:58.491831 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef6ab8-0b44-4bdc-bb17-effae874c221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:58.493745 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-97ef6ab8-0b44-4bdc-bb17-effae874c221 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:58.580229 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-d3885902-f412-4b51-9f5e-10e770266ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0553226ca2ba4d85af8ef1984f5e3ee4'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:58.598090 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-d3885902-f412-4b51-9f5e-10e770266ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0553226ca2ba4d85af8ef1984f5e3ee4'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:58.629622 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef6ab8-0b44-4bdc-bb17-effae874c221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:58.631127 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef6ab8-0b44-4bdc-bb17-effae874c221 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:58.632252 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-d3885902-f412-4b51-9f5e-10e770266ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0553226ca2ba4d85af8ef1984f5e3ee4'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:58.632986 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-d3885902-f412-4b51-9f5e-10e770266ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0553226ca2ba4d85af8ef1984f5e3ee4'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:58.633664 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-d3885902-f412-4b51-9f5e-10e770266ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0553226ca2ba4d85af8ef1984f5e3ee4'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:47:58.668661 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 882/1788] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:58.671881 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef6ab8-0b44-4bdc-bb17-effae874c221 service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:58.672868 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 907/1789] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:47:58 2022] DELETE /identity/v3/users/0553226ca2ba4d85af8ef1984f5e3ee4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:58.675829 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb9565-5ec4-415e-9aa3-746162665e8d None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:58.676126 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb9565-5ec4-415e-9aa3-746162665e8d None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:58.676583 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb9565-5ec4-415e-9aa3-746162665e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:58.680173 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-97ef6ab8-0b44-4bdc-bb17-effae874c221 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:58.698601 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-7dcb9565-5ec4-415e-9aa3-746162665e8d None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:58.699856 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-7dcb9565-5ec4-415e-9aa3-746162665e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:58.736514 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef6ab8-0b44-4bdc-bb17-effae874c221 service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:58.791349 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 908/1790] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:58.792790 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f2ad9-24ab-44f7-ad28-411be817924f None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:58.793093 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f2ad9-24ab-44f7-ad28-411be817924f None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:58.793354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f2ad9-24ab-44f7-ad28-411be817924f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:58.819432 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-855f2ad9-24ab-44f7-ad28-411be817924f None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:58.822807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-855f2ad9-24ab-44f7-ad28-411be817924f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:58.833440 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 909/1791] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:47:58.834305 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f2ad9-24ab-44f7-ad28-411be817924f None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:58.845109 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8b50d-377c-499e-84ef-48ddab1ecb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:58.845898 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f2ad9-24ab-44f7-ad28-411be817924f None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:58.846075 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8b50d-377c-499e-84ef-48ddab1ecb39 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:58.847192 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8b50d-377c-499e-84ef-48ddab1ecb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:58.847487 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8b50d-377c-499e-84ef-48ddab1ecb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:58.848548 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8b50d-377c-499e-84ef-48ddab1ecb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:58.850724 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8b50d-377c-499e-84ef-48ddab1ecb39 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:58.855247 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece48e70-6a03-4b75-bc83-7dbdd33956a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:58.855902 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece48e70-6a03-4b75-bc83-7dbdd33956a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:58.856180 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece48e70-6a03-4b75-bc83-7dbdd33956a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:58.856518 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece48e70-6a03-4b75-bc83-7dbdd33956a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:58.857264 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece48e70-6a03-4b75-bc83-7dbdd33956a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:47:58.857586 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece48e70-6a03-4b75-bc83-7dbdd33956a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:58.860080 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece48e70-6a03-4b75-bc83-7dbdd33956a9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:58.868548 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 883/1792] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:58.869643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8b50d-377c-499e-84ef-48ddab1ecb39 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:58.872127 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-32e8b50d-377c-499e-84ef-48ddab1ecb39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:58.885987 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 910/1793] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:47:58.886852 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece48e70-6a03-4b75-bc83-7dbdd33956a9 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:58.894626 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ece48e70-6a03-4b75-bc83-7dbdd33956a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:58.915649 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece48e70-6a03-4b75-bc83-7dbdd33956a9 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:58.924059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23cc81-2306-49e6-bfe2-a7800498c69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:58.924059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23cc81-2306-49e6-bfe2-a7800498c69e admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:58.924059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23cc81-2306-49e6-bfe2-a7800498c69e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:58.924059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23cc81-2306-49e6-bfe2-a7800498c69e admin admin] PATH_INFO: `/v3/projects/7cb207cab2844c34a1f7d6a890cf82c3/users/9349b723a6164ba5846ea47e109255e5/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:58.945330 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23cc81-2306-49e6-bfe2-a7800498c69e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb207cab2844c34a1f7d6a890cf82c3, user_id=9349b723a6164ba5846ea47e109255e5, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:58.948153 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23cc81-2306-49e6-bfe2-a7800498c69e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:58.968583 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 911/1794] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:58 2022] PUT /identity/v3/projects/7cb207cab2844c34a1f7d6a890cf82c3/users/9349b723a6164ba5846ea47e109255e5/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:58.969628 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23cc81-2306-49e6-bfe2-a7800498c69e admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:59.020049 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8b50d-377c-499e-84ef-48ddab1ecb39 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:59.067696 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23cc81-2306-49e6-bfe2-a7800498c69e admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:59.075094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b88e6-91eb-408f-bdba-e722d8e635ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:59.075838 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b88e6-91eb-408f-bdba-e722d8e635ac admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:59.076104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b88e6-91eb-408f-bdba-e722d8e635ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:59.076379 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b88e6-91eb-408f-bdba-e722d8e635ac admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:59.077099 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b88e6-91eb-408f-bdba-e722d8e635ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:59.079100 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b88e6-91eb-408f-bdba-e722d8e635ac admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:59.099610 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bc210-0eea-4a55-9c0d-5fb8beecfa9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:59.100598 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bc210-0eea-4a55-9c0d-5fb8beecfa9a service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:59.100934 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bc210-0eea-4a55-9c0d-5fb8beecfa9a service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:59.101264 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bc210-0eea-4a55-9c0d-5fb8beecfa9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:59.113210 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7bc210-0eea-4a55-9c0d-5fb8beecfa9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:59.114316 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 912/1795] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:47:58 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:59.115046 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7bc210-0eea-4a55-9c0d-5fb8beecfa9a service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:59.115769 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b88e6-91eb-408f-bdba-e722d8e635ac admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:59.136777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 884/1796] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:47:59.137817 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bc210-0eea-4a55-9c0d-5fb8beecfa9a service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:59.150654 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bc210-0eea-4a55-9c0d-5fb8beecfa9a service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:59.289866 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b88e6-91eb-408f-bdba-e722d8e635ac admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:59.301482 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff64048-9aaf-4041-81b4-1541d1b9c04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:59.302312 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff64048-9aaf-4041-81b4-1541d1b9c04c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:59.302674 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff64048-9aaf-4041-81b4-1541d1b9c04c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:59.303000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff64048-9aaf-4041-81b4-1541d1b9c04c admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:59.304871 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff64048-9aaf-4041-81b4-1541d1b9c04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:59.309509 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a4b21-b6f6-4d5c-b793-df78fc18c758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:59.309986 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff64048-9aaf-4041-81b4-1541d1b9c04c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:59.312903 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a4b21-b6f6-4d5c-b793-df78fc18c758 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:59.313183 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a4b21-b6f6-4d5c-b793-df78fc18c758 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:59.313461 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a4b21-b6f6-4d5c-b793-df78fc18c758 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:59.318572 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a4b21-b6f6-4d5c-b793-df78fc18c758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:59.330705 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a4b21-b6f6-4d5c-b793-df78fc18c758 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:59.342753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 913/1797] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:59.345049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff64048-9aaf-4041-81b4-1541d1b9c04c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:59.369777 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff64048-9aaf-4041-81b4-1541d1b9c04c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:59.382950 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b92bfe-e6a6-4be4-b51a-4d2fa1497d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:59.385213 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b92bfe-e6a6-4be4-b51a-4d2fa1497d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:59.385496 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b92bfe-e6a6-4be4-b51a-4d2fa1497d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:59.386373 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b92bfe-e6a6-4be4-b51a-4d2fa1497d57 admin admin] PATH_INFO: `/v3/projects/7cb207cab2844c34a1f7d6a890cf82c3/users/9349b723a6164ba5846ea47e109255e5/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:59.392450 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b92bfe-e6a6-4be4-b51a-4d2fa1497d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb207cab2844c34a1f7d6a890cf82c3, user_id=9349b723a6164ba5846ea47e109255e5, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:59.398900 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b92bfe-e6a6-4be4-b51a-4d2fa1497d57 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:59.414049 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 885/1798] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:47:59 2022] POST /identity/v3/users => generated 291 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:47:59.418338 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a4b21-b6f6-4d5c-b793-df78fc18c758 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:59.448222 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 914/1799] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:59 2022] PUT /identity/v3/projects/7cb207cab2844c34a1f7d6a890cf82c3/users/9349b723a6164ba5846ea47e109255e5/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:59.458804 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d0952-3844-47dd-afdb-68754904c9d7 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:59.459107 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d0952-3844-47dd-afdb-68754904c9d7 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:59.459385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d0952-3844-47dd-afdb-68754904c9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:59.464999 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a4b21-b6f6-4d5c-b793-df78fc18c758 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:59.539995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-b51d0952-3844-47dd-afdb-68754904c9d7 None None] MFA Rules not processed for user `9349b723a6164ba5846ea47e109255e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:47:59.546402 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b51d0952-3844-47dd-afdb-68754904c9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:59.576718 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23767919-d499-4775-bfcb-42c15e86038a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:59.577706 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23767919-d499-4775-bfcb-42c15e86038a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:59.578071 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23767919-d499-4775-bfcb-42c15e86038a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:59.578604 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23767919-d499-4775-bfcb-42c15e86038a admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:59.580389 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23767919-d499-4775-bfcb-42c15e86038a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:59.585839 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23767919-d499-4775-bfcb-42c15e86038a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:59.613398 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 886/1800] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:59.616292 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23767919-d499-4775-bfcb-42c15e86038a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:59.653039 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23767919-d499-4775-bfcb-42c15e86038a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:59.691172 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff5473-1e0d-4a9e-bd8e-7de635e485cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:59.692191 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff5473-1e0d-4a9e-bd8e-7de635e485cf admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:59.692191 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff5473-1e0d-4a9e-bd8e-7de635e485cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:59.696847 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff5473-1e0d-4a9e-bd8e-7de635e485cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:59.701037 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff5473-1e0d-4a9e-bd8e-7de635e485cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:59.710153 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eff5473-1e0d-4a9e-bd8e-7de635e485cf admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:59.762947 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 887/1801] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:47:59.768094 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff5473-1e0d-4a9e-bd8e-7de635e485cf admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:59.817764 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff5473-1e0d-4a9e-bd8e-7de635e485cf admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:47:59.832504 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03b333-d9c5-4b9c-93fa-69fea64669dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:47:59.838519 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 915/1802] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:47:59.839055 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03b333-d9c5-4b9c-93fa-69fea64669dc admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:59.839055 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03b333-d9c5-4b9c-93fa-69fea64669dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:59.839055 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03b333-d9c5-4b9c-93fa-69fea64669dc admin admin] PATH_INFO: `/v3/projects/3a62eb85e9964b08a0350444b1f28933/users/d2987a76e5c2482e8720cb5222298f4d/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:47:59.845298 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d0952-3844-47dd-afdb-68754904c9d7 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:47:59.851442 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b51d0952-3844-47dd-afdb-68754904c9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:47:59.887146 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03b333-d9c5-4b9c-93fa-69fea64669dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a62eb85e9964b08a0350444b1f28933, user_id=d2987a76e5c2482e8720cb5222298f4d, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:47:59.890249 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03b333-d9c5-4b9c-93fa-69fea64669dc admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:47:59.918455 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 888/1803] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:47:59 2022] PUT /identity/v3/projects/3a62eb85e9964b08a0350444b1f28933/users/d2987a76e5c2482e8720cb5222298f4d/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:47:59.930723 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f47c2-a88e-4bad-af93-0f228c497a83 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:47:59.931144 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f47c2-a88e-4bad-af93-0f228c497a83 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:47:59.931631 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f47c2-a88e-4bad-af93-0f228c497a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:00.000952 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-306f47c2-a88e-4bad-af93-0f228c497a83 None None] MFA Rules not processed for user `d2987a76e5c2482e8720cb5222298f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:00.003087 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-306f47c2-a88e-4bad-af93-0f228c497a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:00.006657 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d0952-3844-47dd-afdb-68754904c9d7 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:00.101128 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 889/1804] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:47:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:00.104461 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f47c2-a88e-4bad-af93-0f228c497a83 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:00.132045 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78307f-2ed4-4695-ba78-8ddc6e15cd3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:00.132655 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78307f-2ed4-4695-ba78-8ddc6e15cd3f service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:00.132932 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78307f-2ed4-4695-ba78-8ddc6e15cd3f service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:00.133251 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78307f-2ed4-4695-ba78-8ddc6e15cd3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:00.187339 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f47c2-a88e-4bad-af93-0f228c497a83 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:00.201546 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d25478-0daf-4125-8de8-d665cfb7582f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:00.204146 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d25478-0daf-4125-8de8-d665cfb7582f admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:00.205268 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d25478-0daf-4125-8de8-d665cfb7582f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:00.206767 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d25478-0daf-4125-8de8-d665cfb7582f admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:00.208039 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d25478-0daf-4125-8de8-d665cfb7582f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:00.210907 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d25478-0daf-4125-8de8-d665cfb7582f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:00.264737 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78307f-2ed4-4695-ba78-8ddc6e15cd3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:00.265750 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 890/1805] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:00 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:00.269625 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de78307f-2ed4-4695-ba78-8ddc6e15cd3f service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:00.269876 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d25478-0daf-4125-8de8-d665cfb7582f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:00.292307 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 916/1806] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:47:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:00.363817 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d25478-0daf-4125-8de8-d665cfb7582f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:00.369406 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a948db-f81e-4729-aec6-8acb31a6df78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:00.369971 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a948db-f81e-4729-aec6-8acb31a6df78 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:00.370249 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a948db-f81e-4729-aec6-8acb31a6df78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:00.370515 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a948db-f81e-4729-aec6-8acb31a6df78 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:00.371223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a948db-f81e-4729-aec6-8acb31a6df78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:00.373166 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a948db-f81e-4729-aec6-8acb31a6df78 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:00.399007 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 891/1807] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:00 2022] POST /identity/v3/users => generated 298 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:00.402904 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78307f-2ed4-4695-ba78-8ddc6e15cd3f service cinder] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:00.413365 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78307f-2ed4-4695-ba78-8ddc6e15cd3f service cinder] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:00.418326 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abe1fd-ddb3-4bd3-9d72-ed4c8b02b49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:00.419090 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abe1fd-ddb3-4bd3-9d72-ed4c8b02b49f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:00.419402 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abe1fd-ddb3-4bd3-9d72-ed4c8b02b49f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:00.419718 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abe1fd-ddb3-4bd3-9d72-ed4c8b02b49f admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:00.420459 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5abe1fd-ddb3-4bd3-9d72-ed4c8b02b49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:00.422075 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5abe1fd-ddb3-4bd3-9d72-ed4c8b02b49f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:00.436503 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 917/1808] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:00.437631 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a948db-f81e-4729-aec6-8acb31a6df78 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:00.447689 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a948db-f81e-4729-aec6-8acb31a6df78 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:00.452472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380a813-f7e2-48cd-87ce-876d70b42475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:00.453370 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380a813-f7e2-48cd-87ce-876d70b42475 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:00.454006 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380a813-f7e2-48cd-87ce-876d70b42475 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:00.454006 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380a813-f7e2-48cd-87ce-876d70b42475 admin admin] PATH_INFO: `/v3/projects/e128299a94484b92a9f229a710d54f48/users/1d6b330b90c54ed296b24480186a6742/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:00.470019 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380a813-f7e2-48cd-87ce-876d70b42475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e128299a94484b92a9f229a710d54f48, user_id=1d6b330b90c54ed296b24480186a6742, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:00.473212 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380a813-f7e2-48cd-87ce-876d70b42475 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:00.493257 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 892/1809] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:00 2022] PUT /identity/v3/projects/e128299a94484b92a9f229a710d54f48/users/1d6b330b90c54ed296b24480186a6742/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:00.498255 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abe1fd-ddb3-4bd3-9d72-ed4c8b02b49f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:00.509360 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abe1fd-ddb3-4bd3-9d72-ed4c8b02b49f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:00.577984 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb65fc7-2c6e-49cf-b08d-64c8cadb5c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:00.578692 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb65fc7-2c6e-49cf-b08d-64c8cadb5c75 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:00.578957 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb65fc7-2c6e-49cf-b08d-64c8cadb5c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:00.579269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb65fc7-2c6e-49cf-b08d-64c8cadb5c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:00.580106 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb65fc7-2c6e-49cf-b08d-64c8cadb5c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:00.581971 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb65fc7-2c6e-49cf-b08d-64c8cadb5c75 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:00.593959 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 918/1810] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:00.598578 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380a813-f7e2-48cd-87ce-876d70b42475 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:00.606807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb65fc7-2c6e-49cf-b08d-64c8cadb5c75 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:00.609416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-8bb65fc7-2c6e-49cf-b08d-64c8cadb5c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:00.609979 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380a813-f7e2-48cd-87ce-876d70b42475 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:00.615132 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcf4cf-dbc6-48d7-ad33-31dddc7f18dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:00.616786 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcf4cf-dbc6-48d7-ad33-31dddc7f18dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:00.619835 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcf4cf-dbc6-48d7-ad33-31dddc7f18dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:00.620153 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcf4cf-dbc6-48d7-ad33-31dddc7f18dd admin admin] PATH_INFO: `/v3/projects/e128299a94484b92a9f229a710d54f48/users/1d6b330b90c54ed296b24480186a6742/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:00.623952 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcf4cf-dbc6-48d7-ad33-31dddc7f18dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e128299a94484b92a9f229a710d54f48, user_id=1d6b330b90c54ed296b24480186a6742, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:00.625956 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb65fc7-2c6e-49cf-b08d-64c8cadb5c75 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:00.626620 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcf4cf-dbc6-48d7-ad33-31dddc7f18dd admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:00.632921 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497d326-984e-4fe9-bfcf-c953b96f57ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:00.633791 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497d326-984e-4fe9-bfcf-c953b96f57ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:00.634187 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497d326-984e-4fe9-bfcf-c953b96f57ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:00.634825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497d326-984e-4fe9-bfcf-c953b96f57ca admin admin] PATH_INFO: `/v3/projects/02c0e6d2855245dc9f6744d9a85afa3b` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:00.639079 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 893/1811] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:00 2022] PUT /identity/v3/projects/e128299a94484b92a9f229a710d54f48/users/1d6b330b90c54ed296b24480186a6742/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:00.640546 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497d326-984e-4fe9-bfcf-c953b96f57ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=02c0e6d2855245dc9f6744d9a85afa3b)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:00.642456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497d326-984e-4fe9-bfcf-c953b96f57ca admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:00.650121 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895891f-b8af-4467-975c-cf4f1176f954 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:00.650795 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895891f-b8af-4467-975c-cf4f1176f954 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:00.651074 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895891f-b8af-4467-975c-cf4f1176f954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:00.686835 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-3895891f-b8af-4467-975c-cf4f1176f954 None None] MFA Rules not processed for user `1d6b330b90c54ed296b24480186a6742`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:00.688661 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-3895891f-b8af-4467-975c-cf4f1176f954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:00.755807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-2497d326-984e-4fe9-bfcf-c953b96f57ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02c0e6d2855245dc9f6744d9a85afa3b', 'request_id': 'req-2497d326-984e-4fe9-bfcf-c953b96f57ca'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:00.762834 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-2497d326-984e-4fe9-bfcf-c953b96f57ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02c0e6d2855245dc9f6744d9a85afa3b', 'request_id': 'req-2497d326-984e-4fe9-bfcf-c953b96f57ca'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:00.784358 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-2497d326-984e-4fe9-bfcf-c953b96f57ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02c0e6d2855245dc9f6744d9a85afa3b', 'request_id': 'req-2497d326-984e-4fe9-bfcf-c953b96f57ca'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:00.809871 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-2497d326-984e-4fe9-bfcf-c953b96f57ca admin admin] The token cache is being invalidate because project 02c0e6d2855245dc9f6744d9a85afa3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:00.810172 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-2497d326-984e-4fe9-bfcf-c953b96f57ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:00.811218 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-2497d326-984e-4fe9-bfcf-c953b96f57ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:00.816093 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 919/1812] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:00 2022] DELETE /identity/v3/projects/02c0e6d2855245dc9f6744d9a85afa3b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:00.816093 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497d326-984e-4fe9-bfcf-c953b96f57ca admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:00.819200 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-2497d326-984e-4fe9-bfcf-c953b96f57ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:00.850512 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 894/1813] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:00.857936 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895891f-b8af-4467-975c-cf4f1176f954 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:00.859715 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-3895891f-b8af-4467-975c-cf4f1176f954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:00.935692 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497d326-984e-4fe9-bfcf-c953b96f57ca admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:00.940978 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895891f-b8af-4467-975c-cf4f1176f954 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:00.945064 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df9c3a-b14a-49cb-8e9b-9737233f0853 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9349b723a6164ba5846ea47e109255e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cb207cab2844c34a1f7d6a890cf82c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:00.946472 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df9c3a-b14a-49cb-8e9b-9737233f0853 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:00.946472 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df9c3a-b14a-49cb-8e9b-9737233f0853 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:00.946472 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df9c3a-b14a-49cb-8e9b-9737233f0853 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:00.947048 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df9c3a-b14a-49cb-8e9b-9737233f0853 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:48:00.947354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df9c3a-b14a-49cb-8e9b-9737233f0853 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:00.949017 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df9c3a-b14a-49cb-8e9b-9737233f0853 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:00.965490 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 920/1814] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:48:00.965663 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df9c3a-b14a-49cb-8e9b-9737233f0853 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:00.967467 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-49df9c3a-b14a-49cb-8e9b-9737233f0853 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:01.043048 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8aecd-86ac-4587-aa2f-4d0bcb41a8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:01.043355 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df9c3a-b14a-49cb-8e9b-9737233f0853 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:01.044532 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8aecd-86ac-4587-aa2f-4d0bcb41a8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:01.045549 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8aecd-86ac-4587-aa2f-4d0bcb41a8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:01.046808 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8aecd-86ac-4587-aa2f-4d0bcb41a8eb admin admin] PATH_INFO: `/v3/users/b4cd94b658d24538a2e1e690da644441` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:01.048271 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7f74f-b5e3-463a-9c3e-01039ca36e36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:01.048982 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7f74f-b5e3-463a-9c3e-01039ca36e36 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:01.049474 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8aecd-86ac-4587-aa2f-4d0bcb41a8eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4cd94b658d24538a2e1e690da644441)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:01.049587 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7f74f-b5e3-463a-9c3e-01039ca36e36 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:01.050025 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7f74f-b5e3-463a-9c3e-01039ca36e36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:01.051710 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8aecd-86ac-4587-aa2f-4d0bcb41a8eb admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:01.117441 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-0dd8aecd-86ac-4587-aa2f-4d0bcb41a8eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4cd94b658d24538a2e1e690da644441'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:01.118441 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-0dd8aecd-86ac-4587-aa2f-4d0bcb41a8eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4cd94b658d24538a2e1e690da644441'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:01.119554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-0dd8aecd-86ac-4587-aa2f-4d0bcb41a8eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4cd94b658d24538a2e1e690da644441'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:01.128438 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7f74f-b5e3-463a-9c3e-01039ca36e36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:01.129758 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7f74f-b5e3-463a-9c3e-01039ca36e36 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:01.133865 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-0dd8aecd-86ac-4587-aa2f-4d0bcb41a8eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4cd94b658d24538a2e1e690da644441'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:01.142509 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 921/1815] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:01.143930 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7f74f-b5e3-463a-9c3e-01039ca36e36 service cinder] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:01.153596 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-0dd8aecd-86ac-4587-aa2f-4d0bcb41a8eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4cd94b658d24538a2e1e690da644441'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:01.154451 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7f74f-b5e3-463a-9c3e-01039ca36e36 service cinder] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:01.160237 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6151b-0f0e-49a2-9cda-c84e93846903 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9349b723a6164ba5846ea47e109255e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cb207cab2844c34a1f7d6a890cf82c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:01.161270 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6151b-0f0e-49a2-9cda-c84e93846903 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:01.161553 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6151b-0f0e-49a2-9cda-c84e93846903 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:01.161828 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6151b-0f0e-49a2-9cda-c84e93846903 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:01.162621 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6151b-0f0e-49a2-9cda-c84e93846903 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:01.164618 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6151b-0f0e-49a2-9cda-c84e93846903 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:01.184595 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 895/1816] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:00 2022] DELETE /identity/v3/users/b4cd94b658d24538a2e1e690da644441 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:01.207704 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 922/1817] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:01 2022] POST /identity/v3/projects => generated 355 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:01.211908 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8aecd-86ac-4587-aa2f-4d0bcb41a8eb admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:01.213513 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-0dd8aecd-86ac-4587-aa2f-4d0bcb41a8eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:01.254912 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6151b-0f0e-49a2-9cda-c84e93846903 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:01.258348 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-89a6151b-0f0e-49a2-9cda-c84e93846903 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:01.307439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8aecd-86ac-4587-aa2f-4d0bcb41a8eb admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:01.342881 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6151b-0f0e-49a2-9cda-c84e93846903 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:01.348618 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6143a-baec-44be-9068-0055dfe1b891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:01.349518 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6143a-baec-44be-9068-0055dfe1b891 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:01.349886 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6143a-baec-44be-9068-0055dfe1b891 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:01.350164 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6143a-baec-44be-9068-0055dfe1b891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:01.353670 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-7be6143a-baec-44be-9068-0055dfe1b891 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:01.395010 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086ed46-ce45-4ff0-9859-fe0db86a5c89 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9349b723a6164ba5846ea47e109255e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cb207cab2844c34a1f7d6a890cf82c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:01.395862 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086ed46-ce45-4ff0-9859-fe0db86a5c89 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:01.396223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086ed46-ce45-4ff0-9859-fe0db86a5c89 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:01.396568 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086ed46-ce45-4ff0-9859-fe0db86a5c89 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:01.397401 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086ed46-ce45-4ff0-9859-fe0db86a5c89 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:48:01.397779 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086ed46-ce45-4ff0-9859-fe0db86a5c89 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:01.400467 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086ed46-ce45-4ff0-9859-fe0db86a5c89 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:01.454051 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 896/1818] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:48:01.475575 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6143a-baec-44be-9068-0055dfe1b891 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:01.477137 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6143a-baec-44be-9068-0055dfe1b891 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:01.487268 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 923/1819] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:48:01.519777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086ed46-ce45-4ff0-9859-fe0db86a5c89 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:01.546148 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086ed46-ce45-4ff0-9859-fe0db86a5c89 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:01.552895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc903f-c7da-41dc-9dfe-b9e272b76493 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9349b723a6164ba5846ea47e109255e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7cb207cab2844c34a1f7d6a890cf82c3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:01.553897 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc903f-c7da-41dc-9dfe-b9e272b76493 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:01.554118 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc903f-c7da-41dc-9dfe-b9e272b76493 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:01.554432 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc903f-c7da-41dc-9dfe-b9e272b76493 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] PATH_INFO: `/v3/projects/74868bcdfdce4d19a34b8d26d497a49b` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:01.556162 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc903f-c7da-41dc-9dfe-b9e272b76493 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] RBAC: Authorizing `identity:delete_project(project_id=74868bcdfdce4d19a34b8d26d497a49b)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:01.564758 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc903f-c7da-41dc-9dfe-b9e272b76493 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:01.679589 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-77fc903f-c7da-41dc-9dfe-b9e272b76493 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74868bcdfdce4d19a34b8d26d497a49b', 'request_id': 'req-77fc903f-c7da-41dc-9dfe-b9e272b76493'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:01.690374 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-77fc903f-c7da-41dc-9dfe-b9e272b76493 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74868bcdfdce4d19a34b8d26d497a49b', 'request_id': 'req-77fc903f-c7da-41dc-9dfe-b9e272b76493'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:01.698260 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-77fc903f-c7da-41dc-9dfe-b9e272b76493 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74868bcdfdce4d19a34b8d26d497a49b', 'request_id': 'req-77fc903f-c7da-41dc-9dfe-b9e272b76493'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:01.712822 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-77fc903f-c7da-41dc-9dfe-b9e272b76493 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] The token cache is being invalidate because project 74868bcdfdce4d19a34b8d26d497a49b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:01.713141 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-77fc903f-c7da-41dc-9dfe-b9e272b76493 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:01.713814 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-77fc903f-c7da-41dc-9dfe-b9e272b76493 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:01.719128 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 897/1820] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:01 2022] DELETE /identity/v3/projects/74868bcdfdce4d19a34b8d26d497a49b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:01.792915 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6143a-baec-44be-9068-0055dfe1b891 service cinder] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:01.794860 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-7be6143a-baec-44be-9068-0055dfe1b891 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:01.978750 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6143a-baec-44be-9068-0055dfe1b891 service cinder] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:01.991059 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc903f-c7da-41dc-9dfe-b9e272b76493 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:01.994416 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-77fc903f-c7da-41dc-9dfe-b9e272b76493 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:02.126839 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe0f8d-988c-4915-b78c-c1e4f1440ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:02.128053 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe0f8d-988c-4915-b78c-c1e4f1440ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:02.128340 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe0f8d-988c-4915-b78c-c1e4f1440ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:02.128612 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe0f8d-988c-4915-b78c-c1e4f1440ba6 admin admin] PATH_INFO: `/v3/projects/d087f767094c440c83dfe44cd3b53fe4` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:02.130909 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe0f8d-988c-4915-b78c-c1e4f1440ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d087f767094c440c83dfe44cd3b53fe4)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:02.133349 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe0f8d-988c-4915-b78c-c1e4f1440ba6 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:02.147245 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc903f-c7da-41dc-9dfe-b9e272b76493 tempest-VolumeQuotaClassesTest-1481008241 tempest-VolumeQuotaClassesTest-1481008241-project-admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:02.160496 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b221a6-bf4b-401d-8bda-4280f2fcb16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:02.163263 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b221a6-bf4b-401d-8bda-4280f2fcb16b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:02.163703 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b221a6-bf4b-401d-8bda-4280f2fcb16b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:02.166572 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b221a6-bf4b-401d-8bda-4280f2fcb16b admin admin] PATH_INFO: `/v3/users/d2987a76e5c2482e8720cb5222298f4d` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:02.168251 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b221a6-bf4b-401d-8bda-4280f2fcb16b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2987a76e5c2482e8720cb5222298f4d)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:02.171503 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b221a6-bf4b-401d-8bda-4280f2fcb16b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:02.266577 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-4dbe0f8d-988c-4915-b78c-c1e4f1440ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd087f767094c440c83dfe44cd3b53fe4', 'request_id': 'req-4dbe0f8d-988c-4915-b78c-c1e4f1440ba6'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:02.273531 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-4dbe0f8d-988c-4915-b78c-c1e4f1440ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd087f767094c440c83dfe44cd3b53fe4', 'request_id': 'req-4dbe0f8d-988c-4915-b78c-c1e4f1440ba6'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:02.278803 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b2b221a6-bf4b-401d-8bda-4280f2fcb16b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2987a76e5c2482e8720cb5222298f4d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:02.279765 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b2b221a6-bf4b-401d-8bda-4280f2fcb16b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2987a76e5c2482e8720cb5222298f4d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:02.280273 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b2b221a6-bf4b-401d-8bda-4280f2fcb16b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2987a76e5c2482e8720cb5222298f4d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:02.283554 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-4dbe0f8d-988c-4915-b78c-c1e4f1440ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd087f767094c440c83dfe44cd3b53fe4', 'request_id': 'req-4dbe0f8d-988c-4915-b78c-c1e4f1440ba6'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:02.294620 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-4dbe0f8d-988c-4915-b78c-c1e4f1440ba6 admin admin] The token cache is being invalidate because project d087f767094c440c83dfe44cd3b53fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:02.294994 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-4dbe0f8d-988c-4915-b78c-c1e4f1440ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:02.295738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-4dbe0f8d-988c-4915-b78c-c1e4f1440ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:02.297567 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 924/1821] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:01 2022] DELETE /identity/v3/projects/d087f767094c440c83dfe44cd3b53fe4 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:02.298344 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe0f8d-988c-4915-b78c-c1e4f1440ba6 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:02.299764 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-4dbe0f8d-988c-4915-b78c-c1e4f1440ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:02.300344 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b2b221a6-bf4b-401d-8bda-4280f2fcb16b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2987a76e5c2482e8720cb5222298f4d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:02.307831 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b2b221a6-bf4b-401d-8bda-4280f2fcb16b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2987a76e5c2482e8720cb5222298f4d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:02.329042 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 898/1822] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:01 2022] DELETE /identity/v3/users/d2987a76e5c2482e8720cb5222298f4d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:02.330426 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fd8d5-1bb2-4405-844c-099a7bc081c4 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:02.330765 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fd8d5-1bb2-4405-844c-099a7bc081c4 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:02.331577 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fd8d5-1bb2-4405-844c-099a7bc081c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:02.351924 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-177fd8d5-1bb2-4405-844c-099a7bc081c4 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:02.356963 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-177fd8d5-1bb2-4405-844c-099a7bc081c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:02.401620 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe0f8d-988c-4915-b78c-c1e4f1440ba6 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:02.464528 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 899/1823] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:02.466012 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed134e0c-469d-483a-a8ec-b017b8f99f7d None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:02.466436 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed134e0c-469d-483a-a8ec-b017b8f99f7d None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:02.467005 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed134e0c-469d-483a-a8ec-b017b8f99f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:02.504183 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-ed134e0c-469d-483a-a8ec-b017b8f99f7d None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:02.506262 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-ed134e0c-469d-483a-a8ec-b017b8f99f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:02.507373 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b681bb-9f2c-42e6-a720-a8649dda8ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:02.508224 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b681bb-9f2c-42e6-a720-a8649dda8ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:02.508504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b681bb-9f2c-42e6-a720-a8649dda8ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:02.508811 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b681bb-9f2c-42e6-a720-a8649dda8ecc admin admin] PATH_INFO: `/v3/users/3aaefa28358d4e539ed3a70fd4433dd4` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:02.510247 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b681bb-9f2c-42e6-a720-a8649dda8ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aaefa28358d4e539ed3a70fd4433dd4)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:02.513472 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b681bb-9f2c-42e6-a720-a8649dda8ecc admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:02.519793 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 900/1824] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:02.519793 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c41e7-3bb9-4df2-a72d-2eefb7bdfe59 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:02.520247 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c41e7-3bb9-4df2-a72d-2eefb7bdfe59 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:02.520713 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c41e7-3bb9-4df2-a72d-2eefb7bdfe59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:02.552162 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-ba4c41e7-3bb9-4df2-a72d-2eefb7bdfe59 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:02.553547 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-ba4c41e7-3bb9-4df2-a72d-2eefb7bdfe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:02.570462 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 901/1825] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:02.573196 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c41e7-3bb9-4df2-a72d-2eefb7bdfe59 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:02.575801 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-ba4c41e7-3bb9-4df2-a72d-2eefb7bdfe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:02.605941 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c3b681bb-9f2c-42e6-a720-a8649dda8ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aaefa28358d4e539ed3a70fd4433dd4'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:02.631992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c3b681bb-9f2c-42e6-a720-a8649dda8ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aaefa28358d4e539ed3a70fd4433dd4'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:02.651825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c3b681bb-9f2c-42e6-a720-a8649dda8ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aaefa28358d4e539ed3a70fd4433dd4'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:02.652548 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c3b681bb-9f2c-42e6-a720-a8649dda8ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aaefa28358d4e539ed3a70fd4433dd4'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:02.653328 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c3b681bb-9f2c-42e6-a720-a8649dda8ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aaefa28358d4e539ed3a70fd4433dd4'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:02.694055 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 925/1826] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:02 2022] DELETE /identity/v3/users/3aaefa28358d4e539ed3a70fd4433dd4 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:02.698686 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b681bb-9f2c-42e6-a720-a8649dda8ecc admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:02.700868 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c3b681bb-9f2c-42e6-a720-a8649dda8ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:02.703034 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c41e7-3bb9-4df2-a72d-2eefb7bdfe59 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:02.778867 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62b4e9-b4d3-4a44-8898-7699e827300f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:02.779893 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62b4e9-b4d3-4a44-8898-7699e827300f service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:02.780174 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62b4e9-b4d3-4a44-8898-7699e827300f service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:02.780448 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62b4e9-b4d3-4a44-8898-7699e827300f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:02.784798 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-7c62b4e9-b4d3-4a44-8898-7699e827300f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:02.813001 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62b4e9-b4d3-4a44-8898-7699e827300f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:02.814472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62b4e9-b4d3-4a44-8898-7699e827300f service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:02.818711 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b681bb-9f2c-42e6-a720-a8649dda8ecc admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:02.825224 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8db0a-91a1-46c6-974a-7ec8eb6f78a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:02.825908 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8db0a-91a1-46c6-974a-7ec8eb6f78a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:02.826237 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8db0a-91a1-46c6-974a-7ec8eb6f78a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:02.826560 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f8db0a-91a1-46c6-974a-7ec8eb6f78a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:02.827317 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8db0a-91a1-46c6-974a-7ec8eb6f78a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:48:02.827659 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8db0a-91a1-46c6-974a-7ec8eb6f78a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:02.829374 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f8db0a-91a1-46c6-974a-7ec8eb6f78a5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:02.834151 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 902/1827] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:02.837549 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696952d-63f0-44ab-a9ed-975cd9a065d4 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:02.837842 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696952d-63f0-44ab-a9ed-975cd9a065d4 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:02.838119 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696952d-63f0-44ab-a9ed-975cd9a065d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:02.867247 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 926/1828] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:48:02.870338 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-7696952d-63f0-44ab-a9ed-975cd9a065d4 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:02.870338 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-7696952d-63f0-44ab-a9ed-975cd9a065d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:02.872265 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8db0a-91a1-46c6-974a-7ec8eb6f78a5 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:02.883967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 903/1829] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:02.884155 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f8db0a-91a1-46c6-974a-7ec8eb6f78a5 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:02.892389 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696952d-63f0-44ab-a9ed-975cd9a065d4 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:02.895328 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-7696952d-63f0-44ab-a9ed-975cd9a065d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:02.897685 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fe252-0939-4e39-911a-711c6cddbd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:02.898701 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fe252-0939-4e39-911a-711c6cddbd75 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:02.899004 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fe252-0939-4e39-911a-711c6cddbd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:02.899239 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fe252-0939-4e39-911a-711c6cddbd75 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:02.902081 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fe252-0939-4e39-911a-711c6cddbd75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:02.907195 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fe252-0939-4e39-911a-711c6cddbd75 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:02.914672 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696952d-63f0-44ab-a9ed-975cd9a065d4 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:02.920142 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dbf76-b1bf-4a82-8b2c-c20e4a9da0e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:02.920840 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dbf76-b1bf-4a82-8b2c-c20e4a9da0e6 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:02.921121 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dbf76-b1bf-4a82-8b2c-c20e4a9da0e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:02.921389 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dbf76-b1bf-4a82-8b2c-c20e4a9da0e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:02.932758 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392dbf76-b1bf-4a82-8b2c-c20e4a9da0e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:02.934281 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392dbf76-b1bf-4a82-8b2c-c20e4a9da0e6 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:02.947557 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 927/1830] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:02 2022] POST /identity/v3/projects => generated 355 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:48:02.948120 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 904/1831] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:02.948674 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fe252-0939-4e39-911a-711c6cddbd75 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:03.059559 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fe252-0939-4e39-911a-711c6cddbd75 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:03.068095 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b57d5-7273-4b33-b857-0f51c467b9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:03.068977 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b57d5-7273-4b33-b857-0f51c467b9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:03.069286 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b57d5-7273-4b33-b857-0f51c467b9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:03.069588 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b57d5-7273-4b33-b857-0f51c467b9f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:03.070481 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b57d5-7273-4b33-b857-0f51c467b9f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:03.073002 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b57d5-7273-4b33-b857-0f51c467b9f2 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:03.097348 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 928/1832] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:02 2022] POST /identity/v3/users => generated 278 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:03.101596 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dbf76-b1bf-4a82-8b2c-c20e4a9da0e6 service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:03.111555 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dbf76-b1bf-4a82-8b2c-c20e4a9da0e6 service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:03.118290 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e2c5d-7974-497c-ba37-c589ac4c85ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:03.119667 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e2c5d-7974-497c-ba37-c589ac4c85ca admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:03.119992 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e2c5d-7974-497c-ba37-c589ac4c85ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:03.120338 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e2c5d-7974-497c-ba37-c589ac4c85ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:03.121165 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e2c5d-7974-497c-ba37-c589ac4c85ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:03.127343 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e2c5d-7974-497c-ba37-c589ac4c85ca admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:03.148889 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 905/1833] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:48:03.153969 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b57d5-7273-4b33-b857-0f51c467b9f2 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:03.166947 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b57d5-7273-4b33-b857-0f51c467b9f2 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:03.177163 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30feacad-e0fb-4467-955c-9a9ee9c17236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:03.178247 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30feacad-e0fb-4467-955c-9a9ee9c17236 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:03.178666 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30feacad-e0fb-4467-955c-9a9ee9c17236 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:03.179033 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30feacad-e0fb-4467-955c-9a9ee9c17236 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:03.180019 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30feacad-e0fb-4467-955c-9a9ee9c17236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:03.181834 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30feacad-e0fb-4467-955c-9a9ee9c17236 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:03.198982 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 929/1834] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:03.200199 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e2c5d-7974-497c-ba37-c589ac4c85ca admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:03.226763 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e2c5d-7974-497c-ba37-c589ac4c85ca admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:03.239241 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b57822-5029-4189-a005-cbafc4e158cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:03.240288 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b57822-5029-4189-a005-cbafc4e158cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:03.241384 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b57822-5029-4189-a005-cbafc4e158cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:03.243258 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b57822-5029-4189-a005-cbafc4e158cd admin admin] PATH_INFO: `/v3/projects/ea9b04b9134b419581e41b6f1a950269/users/9a5ecff2da4c437db55a1987981c7a03/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:03.267203 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b57822-5029-4189-a005-cbafc4e158cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9b04b9134b419581e41b6f1a950269, user_id=9a5ecff2da4c437db55a1987981c7a03, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:03.271115 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b57822-5029-4189-a005-cbafc4e158cd admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:03.292336 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 906/1835] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:03 2022] PUT /identity/v3/projects/ea9b04b9134b419581e41b6f1a950269/users/9a5ecff2da4c437db55a1987981c7a03/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:03.302691 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe19533-fbb4-4332-acf0-c0584cc9800c None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:03.303044 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe19533-fbb4-4332-acf0-c0584cc9800c None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:03.303251 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe19533-fbb4-4332-acf0-c0584cc9800c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:03.352223 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-efe19533-fbb4-4332-acf0-c0584cc9800c None None] MFA Rules not processed for user `9a5ecff2da4c437db55a1987981c7a03`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:03.354962 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-efe19533-fbb4-4332-acf0-c0584cc9800c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:03.443307 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 930/1836] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:03 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:03.444858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b57822-5029-4189-a005-cbafc4e158cd admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:03.523806 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe19533-fbb4-4332-acf0-c0584cc9800c None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:03.525316 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-efe19533-fbb4-4332-acf0-c0584cc9800c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:03.537049 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b57822-5029-4189-a005-cbafc4e158cd admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:03.544427 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe19533-fbb4-4332-acf0-c0584cc9800c None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:03.553112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76397c27-3a17-455e-b5f2-16d6a9432526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:03.553794 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76397c27-3a17-455e-b5f2-16d6a9432526 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:03.554071 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76397c27-3a17-455e-b5f2-16d6a9432526 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:03.554341 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76397c27-3a17-455e-b5f2-16d6a9432526 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:03.555061 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76397c27-3a17-455e-b5f2-16d6a9432526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:03.557030 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76397c27-3a17-455e-b5f2-16d6a9432526 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:03.569565 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef166f-1612-4310-ada8-e3e8e5e4587c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:03.570917 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef166f-1612-4310-ada8-e3e8e5e4587c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:03.571206 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef166f-1612-4310-ada8-e3e8e5e4587c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:03.571478 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef166f-1612-4310-ada8-e3e8e5e4587c admin admin] PATH_INFO: `/v3/projects/3a62eb85e9964b08a0350444b1f28933` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:03.574931 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef166f-1612-4310-ada8-e3e8e5e4587c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a62eb85e9964b08a0350444b1f28933)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:03.577982 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef166f-1612-4310-ada8-e3e8e5e4587c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:03.620745 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 907/1837] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:03 2022] POST /identity/v3/projects => generated 355 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:03.632276 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76397c27-3a17-455e-b5f2-16d6a9432526 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:03.677710 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-56ef166f-1612-4310-ada8-e3e8e5e4587c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a62eb85e9964b08a0350444b1f28933', 'request_id': 'req-56ef166f-1612-4310-ada8-e3e8e5e4587c'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:03.695072 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-56ef166f-1612-4310-ada8-e3e8e5e4587c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a62eb85e9964b08a0350444b1f28933', 'request_id': 'req-56ef166f-1612-4310-ada8-e3e8e5e4587c'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:03.712225 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-56ef166f-1612-4310-ada8-e3e8e5e4587c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a62eb85e9964b08a0350444b1f28933', 'request_id': 'req-56ef166f-1612-4310-ada8-e3e8e5e4587c'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:03.730790 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-56ef166f-1612-4310-ada8-e3e8e5e4587c admin admin] The token cache is being invalidate because project 3a62eb85e9964b08a0350444b1f28933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:03.731105 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-56ef166f-1612-4310-ada8-e3e8e5e4587c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:03.731912 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-56ef166f-1612-4310-ada8-e3e8e5e4587c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:03.734781 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 931/1838] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:03 2022] DELETE /identity/v3/projects/3a62eb85e9964b08a0350444b1f28933 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:03.736489 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef166f-1612-4310-ada8-e3e8e5e4587c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:03.742996 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-56ef166f-1612-4310-ada8-e3e8e5e4587c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:03.799352 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76397c27-3a17-455e-b5f2-16d6a9432526 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:03.857155 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef166f-1612-4310-ada8-e3e8e5e4587c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:03.871945 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e0629-cfbb-4cb9-8e43-0332ad37bdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:03.873710 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e0629-cfbb-4cb9-8e43-0332ad37bdec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:03.873996 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e0629-cfbb-4cb9-8e43-0332ad37bdec admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:03.874271 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e0629-cfbb-4cb9-8e43-0332ad37bdec admin admin] PATH_INFO: `/v3/projects/6f5aead8f1ab452b8826ce5c624a6167` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:03.875899 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a40417-3399-4f89-8c0c-c4a1e22ffa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:03.876592 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e0629-cfbb-4cb9-8e43-0332ad37bdec admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f5aead8f1ab452b8826ce5c624a6167)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:03.876717 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a40417-3399-4f89-8c0c-c4a1e22ffa72 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:03.876930 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a40417-3399-4f89-8c0c-c4a1e22ffa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:03.877440 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a40417-3399-4f89-8c0c-c4a1e22ffa72 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:03.878607 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a40417-3399-4f89-8c0c-c4a1e22ffa72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:03.881028 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a40417-3399-4f89-8c0c-c4a1e22ffa72 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:03.889488 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e0629-cfbb-4cb9-8e43-0332ad37bdec admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:03.912213 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 908/1839] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:03 2022] POST /identity/v3/users => generated 284 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:03.912213 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a40417-3399-4f89-8c0c-c4a1e22ffa72 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:03.917748 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e2a40417-3399-4f89-8c0c-c4a1e22ffa72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:03.965501 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-318e0629-cfbb-4cb9-8e43-0332ad37bdec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f5aead8f1ab452b8826ce5c624a6167', 'request_id': 'req-318e0629-cfbb-4cb9-8e43-0332ad37bdec'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:03.977154 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-318e0629-cfbb-4cb9-8e43-0332ad37bdec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f5aead8f1ab452b8826ce5c624a6167', 'request_id': 'req-318e0629-cfbb-4cb9-8e43-0332ad37bdec'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:03.979172 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a40417-3399-4f89-8c0c-c4a1e22ffa72 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:03.990814 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-318e0629-cfbb-4cb9-8e43-0332ad37bdec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f5aead8f1ab452b8826ce5c624a6167', 'request_id': 'req-318e0629-cfbb-4cb9-8e43-0332ad37bdec'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:04.020547 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-318e0629-cfbb-4cb9-8e43-0332ad37bdec admin admin] The token cache is being invalidate because project 6f5aead8f1ab452b8826ce5c624a6167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:04.021000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-318e0629-cfbb-4cb9-8e43-0332ad37bdec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:04.022959 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-318e0629-cfbb-4cb9-8e43-0332ad37bdec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:04.029350 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 932/1840] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:03 2022] DELETE /identity/v3/projects/6f5aead8f1ab452b8826ce5c624a6167 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:04.032651 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e0629-cfbb-4cb9-8e43-0332ad37bdec admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:04.036321 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-318e0629-cfbb-4cb9-8e43-0332ad37bdec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:04.131394 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509f414-05f6-4078-900b-01158c780395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:04.132544 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509f414-05f6-4078-900b-01158c780395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:04.133038 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509f414-05f6-4078-900b-01158c780395 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:04.133406 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509f414-05f6-4078-900b-01158c780395 admin admin] PATH_INFO: `/v3/users/1d6b330b90c54ed296b24480186a6742` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:04.134961 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509f414-05f6-4078-900b-01158c780395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d6b330b90c54ed296b24480186a6742)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:04.137324 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e509f414-05f6-4078-900b-01158c780395 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:04.213749 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-e509f414-05f6-4078-900b-01158c780395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d6b330b90c54ed296b24480186a6742'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:04.214531 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-e509f414-05f6-4078-900b-01158c780395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d6b330b90c54ed296b24480186a6742'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:04.215256 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-e509f414-05f6-4078-900b-01158c780395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d6b330b90c54ed296b24480186a6742'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:04.224708 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e0629-cfbb-4cb9-8e43-0332ad37bdec admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:04.232035 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-e509f414-05f6-4078-900b-01158c780395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d6b330b90c54ed296b24480186a6742'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:04.237292 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e9e17-7539-46c9-b036-e7b9c88d38b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:04.239798 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e9e17-7539-46c9-b036-e7b9c88d38b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:04.240471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e9e17-7539-46c9-b036-e7b9c88d38b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:04.242322 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e9e17-7539-46c9-b036-e7b9c88d38b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:04.242553 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-e509f414-05f6-4078-900b-01158c780395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d6b330b90c54ed296b24480186a6742'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:04.243278 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e9e17-7539-46c9-b036-e7b9c88d38b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:04.246483 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e9e17-7539-46c9-b036-e7b9c88d38b7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:04.261194 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 909/1841] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:03 2022] DELETE /identity/v3/users/1d6b330b90c54ed296b24480186a6742 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:04.261849 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509f414-05f6-4078-900b-01158c780395 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:04.264883 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e509f414-05f6-4078-900b-01158c780395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:04.277303 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 933/1842] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:04.279918 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e9e17-7539-46c9-b036-e7b9c88d38b7 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:04.282588 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-749e9e17-7539-46c9-b036-e7b9c88d38b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:04.307648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e9e17-7539-46c9-b036-e7b9c88d38b7 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:04.403441 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509f414-05f6-4078-900b-01158c780395 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:04.407003 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2a805-9b67-426f-a00f-2b8b6d6decdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:04.408356 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2a805-9b67-426f-a00f-2b8b6d6decdd admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:04.408783 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2a805-9b67-426f-a00f-2b8b6d6decdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:04.409171 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2a805-9b67-426f-a00f-2b8b6d6decdd admin admin] PATH_INFO: `/v3/projects/5576c064aaf94f58a3f560c13c37cfa7/users/aeaa13c57c7c4edbb9fa97d405a47c63/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:04.411907 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61850cd-9b93-471d-81f4-f9ec8f959e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:04.412858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61850cd-9b93-471d-81f4-f9ec8f959e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:04.413167 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61850cd-9b93-471d-81f4-f9ec8f959e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:04.413437 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61850cd-9b93-471d-81f4-f9ec8f959e23 admin admin] PATH_INFO: `/v3/users/9349b723a6164ba5846ea47e109255e5` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:04.414761 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61850cd-9b93-471d-81f4-f9ec8f959e23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9349b723a6164ba5846ea47e109255e5)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:04.427009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61850cd-9b93-471d-81f4-f9ec8f959e23 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:04.434744 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2a805-9b67-426f-a00f-2b8b6d6decdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5576c064aaf94f58a3f560c13c37cfa7, user_id=aeaa13c57c7c4edbb9fa97d405a47c63, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:04.438029 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2a805-9b67-426f-a00f-2b8b6d6decdd admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:04.458194 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 934/1843] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:04 2022] PUT /identity/v3/projects/5576c064aaf94f58a3f560c13c37cfa7/users/aeaa13c57c7c4edbb9fa97d405a47c63/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:04.462019 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2a805-9b67-426f-a00f-2b8b6d6decdd admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:04.540063 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a61850cd-9b93-471d-81f4-f9ec8f959e23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9349b723a6164ba5846ea47e109255e5'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:04.541565 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a61850cd-9b93-471d-81f4-f9ec8f959e23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9349b723a6164ba5846ea47e109255e5'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:04.542872 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a61850cd-9b93-471d-81f4-f9ec8f959e23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9349b723a6164ba5846ea47e109255e5'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:04.558895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a61850cd-9b93-471d-81f4-f9ec8f959e23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9349b723a6164ba5846ea47e109255e5'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:04.567963 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2a805-9b67-426f-a00f-2b8b6d6decdd admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:04.568278 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a61850cd-9b93-471d-81f4-f9ec8f959e23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9349b723a6164ba5846ea47e109255e5'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:04.576087 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b86d5b-0e98-4169-b549-8aa87a3a2ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:04.577170 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b86d5b-0e98-4169-b549-8aa87a3a2ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:04.577913 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b86d5b-0e98-4169-b549-8aa87a3a2ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:04.578416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b86d5b-0e98-4169-b549-8aa87a3a2ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:04.579458 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b86d5b-0e98-4169-b549-8aa87a3a2ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:04.582021 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b86d5b-0e98-4169-b549-8aa87a3a2ad6 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:04.593460 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 910/1844] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:04 2022] DELETE /identity/v3/users/9349b723a6164ba5846ea47e109255e5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:04.597679 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 935/1845] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:48:04.602312 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61850cd-9b93-471d-81f4-f9ec8f959e23 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:04.603981 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-a61850cd-9b93-471d-81f4-f9ec8f959e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:04.680520 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61850cd-9b93-471d-81f4-f9ec8f959e23 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:04.685559 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0fdd4-32aa-4d05-8994-c0ee93ecf082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:04.686929 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0fdd4-32aa-4d05-8994-c0ee93ecf082 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:04.687270 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0fdd4-32aa-4d05-8994-c0ee93ecf082 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:04.687651 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0fdd4-32aa-4d05-8994-c0ee93ecf082 admin admin] PATH_INFO: `/v3/projects/5576c064aaf94f58a3f560c13c37cfa7/users/aeaa13c57c7c4edbb9fa97d405a47c63/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:04.689852 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0fdd4-32aa-4d05-8994-c0ee93ecf082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5576c064aaf94f58a3f560c13c37cfa7, user_id=aeaa13c57c7c4edbb9fa97d405a47c63, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:04.692674 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0fdd4-32aa-4d05-8994-c0ee93ecf082 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:04.715459 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 911/1846] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:04 2022] PUT /identity/v3/projects/5576c064aaf94f58a3f560c13c37cfa7/users/aeaa13c57c7c4edbb9fa97d405a47c63/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:04.718165 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93839d-f128-46a6-9ba9-804bc11dc567 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:04.718615 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93839d-f128-46a6-9ba9-804bc11dc567 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:04.719042 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93839d-f128-46a6-9ba9-804bc11dc567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:04.751706 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-0a93839d-f128-46a6-9ba9-804bc11dc567 None None] MFA Rules not processed for user `aeaa13c57c7c4edbb9fa97d405a47c63`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:04.753486 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-0a93839d-f128-46a6-9ba9-804bc11dc567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:04.832906 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 936/1847] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:04 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:04.843882 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0fdd4-32aa-4d05-8994-c0ee93ecf082 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:04.846048 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5ca0fdd4-32aa-4d05-8994-c0ee93ecf082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:04.921255 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0fdd4-32aa-4d05-8994-c0ee93ecf082 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:04.926049 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf95298-0076-42a7-9751-bdfc634ce988 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:04.926716 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf95298-0076-42a7-9751-bdfc634ce988 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:04.927000 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf95298-0076-42a7-9751-bdfc634ce988 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:04.927263 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf95298-0076-42a7-9751-bdfc634ce988 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:04.938997 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf95298-0076-42a7-9751-bdfc634ce988 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:04.940743 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf95298-0076-42a7-9751-bdfc634ce988 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:04.952127 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 912/1848] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:04 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:05.046956 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93839d-f128-46a6-9ba9-804bc11dc567 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:05.056751 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93839d-f128-46a6-9ba9-804bc11dc567 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:05.061351 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a41f2-2f4e-4064-8395-1104c19c99f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:05.062119 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a41f2-2f4e-4064-8395-1104c19c99f2 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:05.062803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a41f2-2f4e-4064-8395-1104c19c99f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:05.062803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a41f2-2f4e-4064-8395-1104c19c99f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:05.065405 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d32a41f2-2f4e-4064-8395-1104c19c99f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:05.134770 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a41f2-2f4e-4064-8395-1104c19c99f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:05.136284 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a41f2-2f4e-4064-8395-1104c19c99f2 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:05.151985 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 937/1849] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:05 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:05.249936 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf95298-0076-42a7-9751-bdfc634ce988 service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:05.253653 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-3cf95298-0076-42a7-9751-bdfc634ce988 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:05.374284 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf95298-0076-42a7-9751-bdfc634ce988 service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:05.384997 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72650b0f-34be-4439-985f-1a9e74fe77fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:05.385762 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72650b0f-34be-4439-985f-1a9e74fe77fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:05.386281 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72650b0f-34be-4439-985f-1a9e74fe77fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:05.386395 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72650b0f-34be-4439-985f-1a9e74fe77fe admin admin] PATH_INFO: `/v3/projects/e128299a94484b92a9f229a710d54f48` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:05.388381 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72650b0f-34be-4439-985f-1a9e74fe77fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e128299a94484b92a9f229a710d54f48)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:05.390767 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72650b0f-34be-4439-985f-1a9e74fe77fe admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:05.450288 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-72650b0f-34be-4439-985f-1a9e74fe77fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e128299a94484b92a9f229a710d54f48', 'request_id': 'req-72650b0f-34be-4439-985f-1a9e74fe77fe'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:05.460927 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-72650b0f-34be-4439-985f-1a9e74fe77fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e128299a94484b92a9f229a710d54f48', 'request_id': 'req-72650b0f-34be-4439-985f-1a9e74fe77fe'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:05.467155 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a41f2-2f4e-4064-8395-1104c19c99f2 service cinder] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:05.468925 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d32a41f2-2f4e-4064-8395-1104c19c99f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:05.472995 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-72650b0f-34be-4439-985f-1a9e74fe77fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e128299a94484b92a9f229a710d54f48', 'request_id': 'req-72650b0f-34be-4439-985f-1a9e74fe77fe'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:05.484814 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-72650b0f-34be-4439-985f-1a9e74fe77fe admin admin] The token cache is being invalidate because project e128299a94484b92a9f229a710d54f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:05.485098 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-72650b0f-34be-4439-985f-1a9e74fe77fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:05.486965 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-72650b0f-34be-4439-985f-1a9e74fe77fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:05.491644 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 913/1850] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:05 2022] DELETE /identity/v3/projects/e128299a94484b92a9f229a710d54f48 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:05.497829 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc01f3-e4df-4208-ac97-337def37103d None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:05.498118 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc01f3-e4df-4208-ac97-337def37103d None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:05.498398 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc01f3-e4df-4208-ac97-337def37103d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:05.522615 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a41f2-2f4e-4064-8395-1104c19c99f2 service cinder] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:05.539345 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-18fc01f3-e4df-4208-ac97-337def37103d None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:05.544265 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-18fc01f3-e4df-4208-ac97-337def37103d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:05.622381 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09841af-fc0a-46cf-b426-3d2f440f0e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:05.623485 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09841af-fc0a-46cf-b426-3d2f440f0e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:05.623799 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09841af-fc0a-46cf-b426-3d2f440f0e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:05.624072 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09841af-fc0a-46cf-b426-3d2f440f0e76 admin admin] PATH_INFO: `/v3/projects/7cb207cab2844c34a1f7d6a890cf82c3` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:05.627500 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09841af-fc0a-46cf-b426-3d2f440f0e76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cb207cab2844c34a1f7d6a890cf82c3)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:05.629678 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09841af-fc0a-46cf-b426-3d2f440f0e76 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:05.687136 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 914/1851] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:05.696388 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137b876-8e3c-4117-9fb0-d264c387594a None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:05.696878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137b876-8e3c-4117-9fb0-d264c387594a None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:05.697307 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137b876-8e3c-4117-9fb0-d264c387594a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:05.708664 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c09841af-fc0a-46cf-b426-3d2f440f0e76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cb207cab2844c34a1f7d6a890cf82c3', 'request_id': 'req-c09841af-fc0a-46cf-b426-3d2f440f0e76'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:05.715457 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c09841af-fc0a-46cf-b426-3d2f440f0e76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cb207cab2844c34a1f7d6a890cf82c3', 'request_id': 'req-c09841af-fc0a-46cf-b426-3d2f440f0e76'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:05.728730 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c09841af-fc0a-46cf-b426-3d2f440f0e76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cb207cab2844c34a1f7d6a890cf82c3', 'request_id': 'req-c09841af-fc0a-46cf-b426-3d2f440f0e76'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:05.733244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-a137b876-8e3c-4117-9fb0-d264c387594a None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:05.735195 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-a137b876-8e3c-4117-9fb0-d264c387594a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:05.758177 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c09841af-fc0a-46cf-b426-3d2f440f0e76 admin admin] The token cache is being invalidate because project 7cb207cab2844c34a1f7d6a890cf82c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:05.758553 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c09841af-fc0a-46cf-b426-3d2f440f0e76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:05.759212 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c09841af-fc0a-46cf-b426-3d2f440f0e76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:05.761076 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 938/1852] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:05 2022] DELETE /identity/v3/projects/7cb207cab2844c34a1f7d6a890cf82c3 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:05.766661 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3b55-b97c-497e-aafc-a3a0cfb2d1ef None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:05.767035 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3b55-b97c-497e-aafc-a3a0cfb2d1ef None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:05.767347 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3b55-b97c-497e-aafc-a3a0cfb2d1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:05.795348 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-039a3b55-b97c-497e-aafc-a3a0cfb2d1ef None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:05.796589 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-039a3b55-b97c-497e-aafc-a3a0cfb2d1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:05.837852 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 915/1853] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:05.839033 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137b876-8e3c-4117-9fb0-d264c387594a None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:05.848593 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137b876-8e3c-4117-9fb0-d264c387594a None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:05.853255 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa768a-5fe8-486e-94e3-8247d17b7152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:05.853912 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa768a-5fe8-486e-94e3-8247d17b7152 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:05.854185 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa768a-5fe8-486e-94e3-8247d17b7152 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:05.854463 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa768a-5fe8-486e-94e3-8247d17b7152 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:05.855177 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa768a-5fe8-486e-94e3-8247d17b7152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:48:05.855472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa768a-5fe8-486e-94e3-8247d17b7152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:05.857120 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa768a-5fe8-486e-94e3-8247d17b7152 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:05.857950 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 939/1854] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:05.865971 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08e84b-755a-43cb-ba90-0cd44d02ed37 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:05.866179 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08e84b-755a-43cb-ba90-0cd44d02ed37 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:05.866613 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08e84b-755a-43cb-ba90-0cd44d02ed37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:05.878176 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 916/1855] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:48:05.882702 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa768a-5fe8-486e-94e3-8247d17b7152 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:05.887079 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-ef08e84b-755a-43cb-ba90-0cd44d02ed37 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:05.888412 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ef08e84b-755a-43cb-ba90-0cd44d02ed37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:05.893402 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa768a-5fe8-486e-94e3-8247d17b7152 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:05.897435 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 940/1856] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:05.901492 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164f9f8-db26-4445-968a-e1d60ad55ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:05.901701 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08e84b-755a-43cb-ba90-0cd44d02ed37 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:05.902318 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164f9f8-db26-4445-968a-e1d60ad55ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:05.902664 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164f9f8-db26-4445-968a-e1d60ad55ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:05.903003 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164f9f8-db26-4445-968a-e1d60ad55ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:05.903824 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164f9f8-db26-4445-968a-e1d60ad55ae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:05.905816 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164f9f8-db26-4445-968a-e1d60ad55ae4 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:05.912622 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08e84b-755a-43cb-ba90-0cd44d02ed37 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:05.919310 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d1c48-2db8-4245-8710-429e0ec9f902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:05.920307 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d1c48-2db8-4245-8710-429e0ec9f902 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:05.920922 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d1c48-2db8-4245-8710-429e0ec9f902 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:05.921340 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d1c48-2db8-4245-8710-429e0ec9f902 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:05.923180 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d1c48-2db8-4245-8710-429e0ec9f902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:48:05.923656 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d1c48-2db8-4245-8710-429e0ec9f902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:05.925848 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d1c48-2db8-4245-8710-429e0ec9f902 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:05.939478 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 917/1857] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:05 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:05.943989 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164f9f8-db26-4445-968a-e1d60ad55ae4 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:05.948199 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 941/1858] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:48:05.949406 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d1c48-2db8-4245-8710-429e0ec9f902 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:05.959835 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d1c48-2db8-4245-8710-429e0ec9f902 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:06.025914 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164f9f8-db26-4445-968a-e1d60ad55ae4 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:06.026958 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7db098-675b-42ce-9718-3dde7a4d4a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:06.027756 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7db098-675b-42ce-9718-3dde7a4d4a2b admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:06.028042 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7db098-675b-42ce-9718-3dde7a4d4a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:06.029006 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7db098-675b-42ce-9718-3dde7a4d4a2b admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:06.029736 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7db098-675b-42ce-9718-3dde7a4d4a2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:06.032175 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7db098-675b-42ce-9718-3dde7a4d4a2b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:06.033317 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcfc7f-f145-492f-a5d3-ca12c669741a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:06.034658 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcfc7f-f145-492f-a5d3-ca12c669741a admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:06.035152 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcfc7f-f145-492f-a5d3-ca12c669741a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:06.035403 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcfc7f-f145-492f-a5d3-ca12c669741a admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:06.036006 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcfc7f-f145-492f-a5d3-ca12c669741a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:06.038384 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcfc7f-f145-492f-a5d3-ca12c669741a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:06.072704 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 918/1859] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:05 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:48:06.072972 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 942/1860] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:05 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:06.073068 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcfc7f-f145-492f-a5d3-ca12c669741a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:06.073821 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7db098-675b-42ce-9718-3dde7a4d4a2b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:06.087558 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcfc7f-f145-492f-a5d3-ca12c669741a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:06.148685 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7db098-675b-42ce-9718-3dde7a4d4a2b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:06.153329 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c209ab2-4a82-4c7d-813b-b081040a72d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:06.154010 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c209ab2-4a82-4c7d-813b-b081040a72d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:06.154291 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c209ab2-4a82-4c7d-813b-b081040a72d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:06.154565 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c209ab2-4a82-4c7d-813b-b081040a72d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:06.155308 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c209ab2-4a82-4c7d-813b-b081040a72d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:06.157021 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c209ab2-4a82-4c7d-813b-b081040a72d3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:06.164302 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf302f9-9dc7-41ce-ab0b-eb9a53073c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:06.164987 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf302f9-9dc7-41ce-ab0b-eb9a53073c5d admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:06.165265 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf302f9-9dc7-41ce-ab0b-eb9a53073c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:06.165533 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf302f9-9dc7-41ce-ab0b-eb9a53073c5d admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:06.166274 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf302f9-9dc7-41ce-ab0b-eb9a53073c5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:06.167206 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 943/1861] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:48:06.168239 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf302f9-9dc7-41ce-ab0b-eb9a53073c5d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:06.171173 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c209ab2-4a82-4c7d-813b-b081040a72d3 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:06.181723 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c209ab2-4a82-4c7d-813b-b081040a72d3 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:06.187042 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa5d67-c108-4717-8718-6a395df5c52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:06.187732 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa5d67-c108-4717-8718-6a395df5c52d admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:06.188011 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa5d67-c108-4717-8718-6a395df5c52d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:06.188281 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa5d67-c108-4717-8718-6a395df5c52d admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:06.189020 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa5d67-c108-4717-8718-6a395df5c52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:06.189626 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 919/1862] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:06 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:06.191022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa5d67-c108-4717-8718-6a395df5c52d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:06.193952 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf302f9-9dc7-41ce-ab0b-eb9a53073c5d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:06.204436 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 944/1863] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:48:06.204603 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf302f9-9dc7-41ce-ab0b-eb9a53073c5d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:06.206190 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa5d67-c108-4717-8718-6a395df5c52d admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:06.208988 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056e79e-2d8e-4295-a583-06211ffb3c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:06.209654 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056e79e-2d8e-4295-a583-06211ffb3c0c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:06.209934 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056e79e-2d8e-4295-a583-06211ffb3c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:06.210199 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056e79e-2d8e-4295-a583-06211ffb3c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:06.210950 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056e79e-2d8e-4295-a583-06211ffb3c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:06.212580 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056e79e-2d8e-4295-a583-06211ffb3c0c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:06.215679 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa5d67-c108-4717-8718-6a395df5c52d admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:06.220856 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c0fbb-5995-4ded-b6ae-398ee81bc049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:06.221854 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c0fbb-5995-4ded-b6ae-398ee81bc049 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:06.222133 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c0fbb-5995-4ded-b6ae-398ee81bc049 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:06.223331 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c0fbb-5995-4ded-b6ae-398ee81bc049 admin admin] PATH_INFO: `/v3/projects/bde1fd5253314ab9b84d29e7bd0d1134/users/8f6694ebc2304931b452d2dc241dc65c/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:06.223475 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 920/1864] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:06.227134 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056e79e-2d8e-4295-a583-06211ffb3c0c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:06.237097 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056e79e-2d8e-4295-a583-06211ffb3c0c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:06.238032 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c0fbb-5995-4ded-b6ae-398ee81bc049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde1fd5253314ab9b84d29e7bd0d1134, user_id=8f6694ebc2304931b452d2dc241dc65c, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:06.240755 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c0fbb-5995-4ded-b6ae-398ee81bc049 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:06.241777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117cba6-3b87-421f-9b30-e7ec6094c808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:06.242550 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117cba6-3b87-421f-9b30-e7ec6094c808 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:06.242833 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117cba6-3b87-421f-9b30-e7ec6094c808 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:06.243109 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117cba6-3b87-421f-9b30-e7ec6094c808 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:06.243870 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117cba6-3b87-421f-9b30-e7ec6094c808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:06.245719 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117cba6-3b87-421f-9b30-e7ec6094c808 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:06.254468 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 945/1865] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:06 2022] PUT /identity/v3/projects/bde1fd5253314ab9b84d29e7bd0d1134/users/8f6694ebc2304931b452d2dc241dc65c/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:06.258223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 921/1866] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:48:06.263265 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c0fbb-5995-4ded-b6ae-398ee81bc049 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:06.265234 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da25ccd-8d05-44ef-9b04-d735d6f5f990 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:06.265541 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da25ccd-8d05-44ef-9b04-d735d6f5f990 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:06.265922 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da25ccd-8d05-44ef-9b04-d735d6f5f990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:06.291045 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-1da25ccd-8d05-44ef-9b04-d735d6f5f990 None None] MFA Rules not processed for user `8f6694ebc2304931b452d2dc241dc65c`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:06.292268 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-1da25ccd-8d05-44ef-9b04-d735d6f5f990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:06.323690 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c0fbb-5995-4ded-b6ae-398ee81bc049 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:06.328688 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d7aee-7037-48c8-b65c-e2ce75df11b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:06.329586 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d7aee-7037-48c8-b65c-e2ce75df11b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:06.329865 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d7aee-7037-48c8-b65c-e2ce75df11b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:06.330173 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d7aee-7037-48c8-b65c-e2ce75df11b6 admin admin] PATH_INFO: `/v3/projects/55cf2241773145dca4016f5f0fa4c0d4/users/c4e14a00e91e495888b9d1ae01ed8d44/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:06.344825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d7aee-7037-48c8-b65c-e2ce75df11b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55cf2241773145dca4016f5f0fa4c0d4, user_id=c4e14a00e91e495888b9d1ae01ed8d44, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:06.347612 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d7aee-7037-48c8-b65c-e2ce75df11b6 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:06.356396 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 922/1867] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:06.360784 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da25ccd-8d05-44ef-9b04-d735d6f5f990 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:06.361648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 946/1868] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:06 2022] PUT /identity/v3/projects/55cf2241773145dca4016f5f0fa4c0d4/users/c4e14a00e91e495888b9d1ae01ed8d44/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:06.366290 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006cea1-9f99-4b27-b0af-6cedddf6178a None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:06.366575 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006cea1-9f99-4b27-b0af-6cedddf6178a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:06.366845 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006cea1-9f99-4b27-b0af-6cedddf6178a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:06.371206 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da25ccd-8d05-44ef-9b04-d735d6f5f990 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:06.384055 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-6006cea1-9f99-4b27-b0af-6cedddf6178a None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:06.385269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-6006cea1-9f99-4b27-b0af-6cedddf6178a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:06.429342 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786e29a-d65b-4f52-8c88-61e60acffb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:06.430176 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786e29a-d65b-4f52-8c88-61e60acffb70 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:06.430633 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786e29a-d65b-4f52-8c88-61e60acffb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:06.430917 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786e29a-d65b-4f52-8c88-61e60acffb70 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:06.431849 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786e29a-d65b-4f52-8c88-61e60acffb70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:06.433967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786e29a-d65b-4f52-8c88-61e60acffb70 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:06.448056 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 947/1869] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:06.461358 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006cea1-9f99-4b27-b0af-6cedddf6178a None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:06.464745 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 923/1870] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:06 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:48:06.465348 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-6006cea1-9f99-4b27-b0af-6cedddf6178a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:06.469382 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786e29a-d65b-4f52-8c88-61e60acffb70 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:06.531964 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006cea1-9f99-4b27-b0af-6cedddf6178a None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:06.540258 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786e29a-d65b-4f52-8c88-61e60acffb70 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:06.546656 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396e112-304a-4fdd-b2ba-e6d036625e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:06.547418 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396e112-304a-4fdd-b2ba-e6d036625e91 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:06.547769 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396e112-304a-4fdd-b2ba-e6d036625e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:06.548069 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396e112-304a-4fdd-b2ba-e6d036625e91 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:06.548806 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396e112-304a-4fdd-b2ba-e6d036625e91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:06.550970 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396e112-304a-4fdd-b2ba-e6d036625e91 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:06.574249 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 924/1871] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:06 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:06.578591 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396e112-304a-4fdd-b2ba-e6d036625e91 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:06.599006 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cb7e1-fc6e-45f6-a5a6-10cfc598824f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:06.599312 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396e112-304a-4fdd-b2ba-e6d036625e91 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:06.599411 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cb7e1-fc6e-45f6-a5a6-10cfc598824f service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:06.599411 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cb7e1-fc6e-45f6-a5a6-10cfc598824f service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:06.599411 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cb7e1-fc6e-45f6-a5a6-10cfc598824f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:06.603249 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742e5bc-2057-4342-b6bf-e2458cc50173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:06.603988 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742e5bc-2057-4342-b6bf-e2458cc50173 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:06.604289 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742e5bc-2057-4342-b6bf-e2458cc50173 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:06.604554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742e5bc-2057-4342-b6bf-e2458cc50173 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:06.605304 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742e5bc-2057-4342-b6bf-e2458cc50173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:06.607063 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742e5bc-2057-4342-b6bf-e2458cc50173 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:06.610312 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620cb7e1-fc6e-45f6-a5a6-10cfc598824f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:06.612678 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620cb7e1-fc6e-45f6-a5a6-10cfc598824f service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:06.618139 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 925/1872] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:48:06.624800 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 948/1873] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:06.625142 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742e5bc-2057-4342-b6bf-e2458cc50173 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:06.639148 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742e5bc-2057-4342-b6bf-e2458cc50173 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:06.648687 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60fb0d-6914-4cb8-8e20-14ad46cdfdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:06.649531 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60fb0d-6914-4cb8-8e20-14ad46cdfdce admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:06.649808 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60fb0d-6914-4cb8-8e20-14ad46cdfdce admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:06.650333 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60fb0d-6914-4cb8-8e20-14ad46cdfdce admin admin] PATH_INFO: `/v3/projects/23b2e8d8c3b44e9a993455a2f76eaed0/users/efde0d94cfd14e8b8a93adab9fb17ca5/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:06.669849 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60fb0d-6914-4cb8-8e20-14ad46cdfdce admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b2e8d8c3b44e9a993455a2f76eaed0, user_id=efde0d94cfd14e8b8a93adab9fb17ca5, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:06.672662 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60fb0d-6914-4cb8-8e20-14ad46cdfdce admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:06.691763 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 926/1874] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:06 2022] PUT /identity/v3/projects/23b2e8d8c3b44e9a993455a2f76eaed0/users/efde0d94cfd14e8b8a93adab9fb17ca5/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:06.696577 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cb7e1-fc6e-45f6-a5a6-10cfc598824f service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:06.710572 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cb7e1-fc6e-45f6-a5a6-10cfc598824f service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:06.798409 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939a8c9-a6ae-4db1-9e30-fbb136f7f67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:06.799253 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939a8c9-a6ae-4db1-9e30-fbb136f7f67f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:06.800536 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939a8c9-a6ae-4db1-9e30-fbb136f7f67f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:06.800536 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939a8c9-a6ae-4db1-9e30-fbb136f7f67f admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:06.800908 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939a8c9-a6ae-4db1-9e30-fbb136f7f67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:06.802546 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939a8c9-a6ae-4db1-9e30-fbb136f7f67f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:06.819328 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 949/1875] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:48:06.820860 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60fb0d-6914-4cb8-8e20-14ad46cdfdce admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:06.831532 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60fb0d-6914-4cb8-8e20-14ad46cdfdce admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:06.840249 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad6dce-3b76-4061-abfa-7c0db8f341cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:06.841280 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad6dce-3b76-4061-abfa-7c0db8f341cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:06.841549 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad6dce-3b76-4061-abfa-7c0db8f341cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:06.842224 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad6dce-3b76-4061-abfa-7c0db8f341cb admin admin] PATH_INFO: `/v3/projects/23b2e8d8c3b44e9a993455a2f76eaed0/users/efde0d94cfd14e8b8a93adab9fb17ca5/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:06.844019 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad6dce-3b76-4061-abfa-7c0db8f341cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b2e8d8c3b44e9a993455a2f76eaed0, user_id=efde0d94cfd14e8b8a93adab9fb17ca5, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:06.847413 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad6dce-3b76-4061-abfa-7c0db8f341cb admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:06.861355 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 927/1876] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:06 2022] PUT /identity/v3/projects/23b2e8d8c3b44e9a993455a2f76eaed0/users/efde0d94cfd14e8b8a93adab9fb17ca5/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:06.871862 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b13907-af80-442a-bfae-d4f73b1e5354 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:06.872150 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b13907-af80-442a-bfae-d4f73b1e5354 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:06.872425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b13907-af80-442a-bfae-d4f73b1e5354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:06.905024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-91b13907-af80-442a-bfae-d4f73b1e5354 None None] MFA Rules not processed for user `efde0d94cfd14e8b8a93adab9fb17ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:06.906608 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-91b13907-af80-442a-bfae-d4f73b1e5354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:06.985677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 950/1877] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:06 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:06.996546 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad6dce-3b76-4061-abfa-7c0db8f341cb admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:06.998444 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-fbad6dce-3b76-4061-abfa-7c0db8f341cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:07.066213 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad6dce-3b76-4061-abfa-7c0db8f341cb admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:07.071103 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f493122-313a-47d7-8b99-ef4b58bd31fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:07.071811 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f493122-313a-47d7-8b99-ef4b58bd31fc service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:07.072115 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f493122-313a-47d7-8b99-ef4b58bd31fc service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:07.072356 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f493122-313a-47d7-8b99-ef4b58bd31fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:07.150996 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f493122-313a-47d7-8b99-ef4b58bd31fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:07.152857 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f493122-313a-47d7-8b99-ef4b58bd31fc service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:07.163862 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 928/1878] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:08.614335 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fa536-3e20-4b5f-beb9-4d228d61c974 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:08.614881 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fa536-3e20-4b5f-beb9-4d228d61c974 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:08.614988 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5fa536-3e20-4b5f-beb9-4d228d61c974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:08.645900 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-7e5fa536-3e20-4b5f-beb9-4d228d61c974 None None] MFA Rules not processed for user `c4e14a00e91e495888b9d1ae01ed8d44`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:08.647643 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-7e5fa536-3e20-4b5f-beb9-4d228d61c974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:08.747449 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 951/1879] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:08.753170 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f493122-313a-47d7-8b99-ef4b58bd31fc service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:08.834885 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f493122-313a-47d7-8b99-ef4b58bd31fc service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:08.840331 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6abee7-25e7-489a-9521-ea84d90679c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:08.841656 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6abee7-25e7-489a-9521-ea84d90679c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:08.842515 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6abee7-25e7-489a-9521-ea84d90679c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:08.843770 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6abee7-25e7-489a-9521-ea84d90679c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:08.844608 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6abee7-25e7-489a-9521-ea84d90679c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:08.846751 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6abee7-25e7-489a-9521-ea84d90679c2 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:08.886865 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 929/1880] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:08 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:08.905170 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fa536-3e20-4b5f-beb9-4d228d61c974 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:08.917213 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5fa536-3e20-4b5f-beb9-4d228d61c974 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:08.981053 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ffe0d-fbe5-400e-9aca-269e3e42b144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:08.981891 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ffe0d-fbe5-400e-9aca-269e3e42b144 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:08.982175 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ffe0d-fbe5-400e-9aca-269e3e42b144 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:08.982448 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ffe0d-fbe5-400e-9aca-269e3e42b144 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:08.983167 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ffe0d-fbe5-400e-9aca-269e3e42b144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:08.985157 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ffe0d-fbe5-400e-9aca-269e3e42b144 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:09.012608 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 952/1881] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:08 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:09.015614 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6abee7-25e7-489a-9521-ea84d90679c2 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:09.028580 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6abee7-25e7-489a-9521-ea84d90679c2 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:09.033537 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a6b92-26b4-47f2-8db3-676c62cc45f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:09.034242 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a6b92-26b4-47f2-8db3-676c62cc45f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:09.034523 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a6b92-26b4-47f2-8db3-676c62cc45f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:09.034789 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a6b92-26b4-47f2-8db3-676c62cc45f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:09.035592 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a6b92-26b4-47f2-8db3-676c62cc45f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:09.037211 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a6b92-26b4-47f2-8db3-676c62cc45f5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:09.052727 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 930/1882] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:09.053847 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ffe0d-fbe5-400e-9aca-269e3e42b144 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:09.066130 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ffe0d-fbe5-400e-9aca-269e3e42b144 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:09.071969 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912f7e4-7420-4f0c-944b-188e47cf5908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:09.072995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912f7e4-7420-4f0c-944b-188e47cf5908 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:09.073345 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912f7e4-7420-4f0c-944b-188e47cf5908 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:09.074138 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912f7e4-7420-4f0c-944b-188e47cf5908 admin admin] PATH_INFO: `/v3/projects/a246d3cdf9da4131a81b87e8a13bd9c3/users/fa259dce16f9454fa23791685d280657/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:09.090729 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912f7e4-7420-4f0c-944b-188e47cf5908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a246d3cdf9da4131a81b87e8a13bd9c3, user_id=fa259dce16f9454fa23791685d280657, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:09.093657 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912f7e4-7420-4f0c-944b-188e47cf5908 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:09.123094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 953/1883] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:09 2022] PUT /identity/v3/projects/a246d3cdf9da4131a81b87e8a13bd9c3/users/fa259dce16f9454fa23791685d280657/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:09.123311 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a6b92-26b4-47f2-8db3-676c62cc45f5 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:09.141669 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a6b92-26b4-47f2-8db3-676c62cc45f5 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:09.238501 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7dc09-387d-4d33-b0fe-2cc2f70512f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:09.239405 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7dc09-387d-4d33-b0fe-2cc2f70512f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:09.239679 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7dc09-387d-4d33-b0fe-2cc2f70512f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:09.240066 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7dc09-387d-4d33-b0fe-2cc2f70512f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:09.241564 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7dc09-387d-4d33-b0fe-2cc2f70512f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:09.243091 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7dc09-387d-4d33-b0fe-2cc2f70512f3 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:09.258645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 931/1884] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:09.262478 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912f7e4-7420-4f0c-944b-188e47cf5908 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:09.277894 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912f7e4-7420-4f0c-944b-188e47cf5908 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:09.286116 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d426253-7995-4cc6-9d49-ef8138ccd6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:09.287276 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d426253-7995-4cc6-9d49-ef8138ccd6a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:09.287781 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d426253-7995-4cc6-9d49-ef8138ccd6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:09.289789 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d426253-7995-4cc6-9d49-ef8138ccd6a8 admin admin] PATH_INFO: `/v3/projects/a246d3cdf9da4131a81b87e8a13bd9c3/users/fa259dce16f9454fa23791685d280657/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:09.293183 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d426253-7995-4cc6-9d49-ef8138ccd6a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a246d3cdf9da4131a81b87e8a13bd9c3, user_id=fa259dce16f9454fa23791685d280657, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:09.296066 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d426253-7995-4cc6-9d49-ef8138ccd6a8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:09.310021 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 954/1885] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:09 2022] PUT /identity/v3/projects/a246d3cdf9da4131a81b87e8a13bd9c3/users/fa259dce16f9454fa23791685d280657/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:09.948527 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8b4b8-04be-4acd-a4c0-026b7e459732 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:09.950034 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8b4b8-04be-4acd-a4c0-026b7e459732 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:09.950034 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8b4b8-04be-4acd-a4c0-026b7e459732 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:09.951081 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 932/1886] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jan 10 12:48:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:48:09.974976 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db5a21-76e4-4f61-95b8-c9711da78059 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:09.976152 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db5a21-76e4-4f61-95b8-c9711da78059 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:09.976152 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db5a21-76e4-4f61-95b8-c9711da78059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:10.020098 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8b4b8-04be-4acd-a4c0-026b7e459732 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:10.039085 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-f9db5a21-76e4-4f61-95b8-c9711da78059 None None] MFA Rules not processed for user `d68fa8e4f3a341a5b74ee32c85e59869`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:10.050837 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f9db5a21-76e4-4f61-95b8-c9711da78059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:10.226369 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8b4b8-04be-4acd-a4c0-026b7e459732 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:10.249742 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d18ae-79cf-40b3-9cbe-fac10675a7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:10.250710 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d18ae-79cf-40b3-9cbe-fac10675a7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:10.250987 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d18ae-79cf-40b3-9cbe-fac10675a7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:10.251259 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d18ae-79cf-40b3-9cbe-fac10675a7bd admin admin] PATH_INFO: `/v3/users/8f6694ebc2304931b452d2dc241dc65c` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:10.254447 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d18ae-79cf-40b3-9cbe-fac10675a7bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f6694ebc2304931b452d2dc241dc65c)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:10.263121 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d18ae-79cf-40b3-9cbe-fac10675a7bd admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:10.294025 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 955/1887] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jan 10 12:48:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:10.354846 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db5a21-76e4-4f61-95b8-c9711da78059 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:10.355864 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f9db5a21-76e4-4f61-95b8-c9711da78059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:10.377874 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db5a21-76e4-4f61-95b8-c9711da78059 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:10.380364 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-716d18ae-79cf-40b3-9cbe-fac10675a7bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f6694ebc2304931b452d2dc241dc65c'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:10.382819 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-716d18ae-79cf-40b3-9cbe-fac10675a7bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f6694ebc2304931b452d2dc241dc65c'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:10.386235 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-716d18ae-79cf-40b3-9cbe-fac10675a7bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f6694ebc2304931b452d2dc241dc65c'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:10.396596 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982cd79-9e8a-4387-8ef2-68c289eaa9b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:10.397332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982cd79-9e8a-4387-8ef2-68c289eaa9b9 service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:10.398254 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982cd79-9e8a-4387-8ef2-68c289eaa9b9 service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:10.398537 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982cd79-9e8a-4387-8ef2-68c289eaa9b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:10.401609 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f982cd79-9e8a-4387-8ef2-68c289eaa9b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:10.431671 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982cd79-9e8a-4387-8ef2-68c289eaa9b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:10.433441 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982cd79-9e8a-4387-8ef2-68c289eaa9b9 service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:10.444027 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-716d18ae-79cf-40b3-9cbe-fac10675a7bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f6694ebc2304931b452d2dc241dc65c'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:10.465203 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-716d18ae-79cf-40b3-9cbe-fac10675a7bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f6694ebc2304931b452d2dc241dc65c'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:10.466816 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 956/1888] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:10.517922 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db82d8-dcb0-4159-b8b6-53520392a0a3 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:10.518375 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db82d8-dcb0-4159-b8b6-53520392a0a3 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:10.518723 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db82d8-dcb0-4159-b8b6-53520392a0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:10.520760 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 933/1889] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:10 2022] DELETE /identity/v3/users/8f6694ebc2304931b452d2dc241dc65c => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:10.561495 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-54db82d8-dcb0-4159-b8b6-53520392a0a3 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:10.563775 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-54db82d8-dcb0-4159-b8b6-53520392a0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:10.697776 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 957/1890] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:10.730060 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d18ae-79cf-40b3-9cbe-fac10675a7bd admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:10.743882 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-716d18ae-79cf-40b3-9cbe-fac10675a7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:10.814818 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d18ae-79cf-40b3-9cbe-fac10675a7bd admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:10.820428 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa1695-e868-45c0-802f-782cbfdaf4df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:10.820882 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa1695-e868-45c0-802f-782cbfdaf4df service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:10.821264 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa1695-e868-45c0-802f-782cbfdaf4df service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:10.821632 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa1695-e868-45c0-802f-782cbfdaf4df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:10.833945 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa1695-e868-45c0-802f-782cbfdaf4df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:10.836209 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa1695-e868-45c0-802f-782cbfdaf4df service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:10.859583 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 934/1891] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:11.313414 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64652b28-3cc7-4927-a5b8-1526836fd4c9 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:11.314274 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64652b28-3cc7-4927-a5b8-1526836fd4c9 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:11.314787 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64652b28-3cc7-4927-a5b8-1526836fd4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:11.349988 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-64652b28-3cc7-4927-a5b8-1526836fd4c9 None None] MFA Rules not processed for user `fa259dce16f9454fa23791685d280657`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:11.351234 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-64652b28-3cc7-4927-a5b8-1526836fd4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:11.427949 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 958/1892] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:11.438557 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa1695-e868-45c0-802f-782cbfdaf4df service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:11.440586 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-91aa1695-e868-45c0-802f-782cbfdaf4df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:11.497246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64652b28-3cc7-4927-a5b8-1526836fd4c9 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:11.498883 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-64652b28-3cc7-4927-a5b8-1526836fd4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:11.514809 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64652b28-3cc7-4927-a5b8-1526836fd4c9 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:11.520318 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa1695-e868-45c0-802f-782cbfdaf4df service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:11.522260 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db58b8f-2aa1-4df6-9daa-d6e2633ca4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:11.523421 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db58b8f-2aa1-4df6-9daa-d6e2633ca4da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:11.523634 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db58b8f-2aa1-4df6-9daa-d6e2633ca4da admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:11.523927 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db58b8f-2aa1-4df6-9daa-d6e2633ca4da admin admin] PATH_INFO: `/v3/projects/bde1fd5253314ab9b84d29e7bd0d1134` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:11.525214 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db58b8f-2aa1-4df6-9daa-d6e2633ca4da admin admin] RBAC: Authorizing `identity:delete_project(project_id=bde1fd5253314ab9b84d29e7bd0d1134)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:11.525307 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692affb9-0298-418a-9c1d-9c2a28b75c7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:11.526125 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692affb9-0298-418a-9c1d-9c2a28b75c7a service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:11.526570 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692affb9-0298-418a-9c1d-9c2a28b75c7a service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:11.527015 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692affb9-0298-418a-9c1d-9c2a28b75c7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:11.527227 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db58b8f-2aa1-4df6-9daa-d6e2633ca4da admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:11.529472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-692affb9-0298-418a-9c1d-9c2a28b75c7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:11.577485 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-8db58b8f-2aa1-4df6-9daa-d6e2633ca4da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bde1fd5253314ab9b84d29e7bd0d1134', 'request_id': 'req-8db58b8f-2aa1-4df6-9daa-d6e2633ca4da'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:11.587594 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-8db58b8f-2aa1-4df6-9daa-d6e2633ca4da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bde1fd5253314ab9b84d29e7bd0d1134', 'request_id': 'req-8db58b8f-2aa1-4df6-9daa-d6e2633ca4da'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:11.595245 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-8db58b8f-2aa1-4df6-9daa-d6e2633ca4da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bde1fd5253314ab9b84d29e7bd0d1134', 'request_id': 'req-8db58b8f-2aa1-4df6-9daa-d6e2633ca4da'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:11.596803 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692affb9-0298-418a-9c1d-9c2a28b75c7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:11.598551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692affb9-0298-418a-9c1d-9c2a28b75c7a service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:11.605924 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-8db58b8f-2aa1-4df6-9daa-d6e2633ca4da admin admin] The token cache is being invalidate because project bde1fd5253314ab9b84d29e7bd0d1134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:11.606148 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-8db58b8f-2aa1-4df6-9daa-d6e2633ca4da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:11.606774 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-8db58b8f-2aa1-4df6-9daa-d6e2633ca4da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:11.607338 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 935/1893] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:11.610199 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 959/1894] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:11 2022] DELETE /identity/v3/projects/bde1fd5253314ab9b84d29e7bd0d1134 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:11.614273 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692affb9-0298-418a-9c1d-9c2a28b75c7a service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:11.624361 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692affb9-0298-418a-9c1d-9c2a28b75c7a service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:11.679126 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce2c85-12a5-457e-a29b-f8c12b5f916a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:11.680149 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce2c85-12a5-457e-a29b-f8c12b5f916a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:11.680429 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce2c85-12a5-457e-a29b-f8c12b5f916a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:11.680697 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce2c85-12a5-457e-a29b-f8c12b5f916a admin admin] PATH_INFO: `/v3/users/efde0d94cfd14e8b8a93adab9fb17ca5` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:11.681977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce2c85-12a5-457e-a29b-f8c12b5f916a admin admin] RBAC: Authorizing `identity:delete_user(user_id=efde0d94cfd14e8b8a93adab9fb17ca5)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:11.684019 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce2c85-12a5-457e-a29b-f8c12b5f916a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:11.732419 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-83ce2c85-12a5-457e-a29b-f8c12b5f916a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efde0d94cfd14e8b8a93adab9fb17ca5'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:11.733286 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-83ce2c85-12a5-457e-a29b-f8c12b5f916a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efde0d94cfd14e8b8a93adab9fb17ca5'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:11.733968 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-83ce2c85-12a5-457e-a29b-f8c12b5f916a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efde0d94cfd14e8b8a93adab9fb17ca5'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:11.747504 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-83ce2c85-12a5-457e-a29b-f8c12b5f916a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efde0d94cfd14e8b8a93adab9fb17ca5'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:11.755320 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-83ce2c85-12a5-457e-a29b-f8c12b5f916a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efde0d94cfd14e8b8a93adab9fb17ca5'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:11.769097 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 936/1895] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:11 2022] DELETE /identity/v3/users/efde0d94cfd14e8b8a93adab9fb17ca5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:12.112336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db58b8f-2aa1-4df6-9daa-d6e2633ca4da admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:12.114329 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-8db58b8f-2aa1-4df6-9daa-d6e2633ca4da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:12.144498 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db58b8f-2aa1-4df6-9daa-d6e2633ca4da admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:12.226456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc228910-825d-44cb-af23-c64223656fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:12.227346 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc228910-825d-44cb-af23-c64223656fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:12.227654 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc228910-825d-44cb-af23-c64223656fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:12.227924 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc228910-825d-44cb-af23-c64223656fa5 admin admin] PATH_INFO: `/v3/projects/23b2e8d8c3b44e9a993455a2f76eaed0` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:12.229281 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc228910-825d-44cb-af23-c64223656fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23b2e8d8c3b44e9a993455a2f76eaed0)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:12.231338 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc228910-825d-44cb-af23-c64223656fa5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:12.285533 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fc228910-825d-44cb-af23-c64223656fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b2e8d8c3b44e9a993455a2f76eaed0', 'request_id': 'req-fc228910-825d-44cb-af23-c64223656fa5'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:12.291947 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fc228910-825d-44cb-af23-c64223656fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b2e8d8c3b44e9a993455a2f76eaed0', 'request_id': 'req-fc228910-825d-44cb-af23-c64223656fa5'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:12.306638 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fc228910-825d-44cb-af23-c64223656fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b2e8d8c3b44e9a993455a2f76eaed0', 'request_id': 'req-fc228910-825d-44cb-af23-c64223656fa5'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:12.316471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fc228910-825d-44cb-af23-c64223656fa5 admin admin] The token cache is being invalidate because project 23b2e8d8c3b44e9a993455a2f76eaed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:12.317069 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fc228910-825d-44cb-af23-c64223656fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:12.317662 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fc228910-825d-44cb-af23-c64223656fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:12.319593 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 960/1896] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:12 2022] DELETE /identity/v3/projects/23b2e8d8c3b44e9a993455a2f76eaed0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:12.325365 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f112c8-39b7-4a66-92ce-5427213ba2b2 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:12.327930 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f112c8-39b7-4a66-92ce-5427213ba2b2 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:12.328323 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f112c8-39b7-4a66-92ce-5427213ba2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:12.351157 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-53f112c8-39b7-4a66-92ce-5427213ba2b2 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:12.352391 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-53f112c8-39b7-4a66-92ce-5427213ba2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:12.430560 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 937/1897] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:12.440054 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94382a-7728-436c-8bf8-ee10b5659325 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:12.440825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94382a-7728-436c-8bf8-ee10b5659325 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:12.441101 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94382a-7728-436c-8bf8-ee10b5659325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:12.471963 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-5a94382a-7728-436c-8bf8-ee10b5659325 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:12.474052 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-5a94382a-7728-436c-8bf8-ee10b5659325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:12.493091 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 961/1898] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:12.498704 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f112c8-39b7-4a66-92ce-5427213ba2b2 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:12.517244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f112c8-39b7-4a66-92ce-5427213ba2b2 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:12.523003 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ba9a5-4272-4d7b-8d4a-822c3c7935fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:12.524058 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ba9a5-4272-4d7b-8d4a-822c3c7935fa admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:12.524557 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ba9a5-4272-4d7b-8d4a-822c3c7935fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:12.525030 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ba9a5-4272-4d7b-8d4a-822c3c7935fa admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:12.526086 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ba9a5-4272-4d7b-8d4a-822c3c7935fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:48:12.526592 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ba9a5-4272-4d7b-8d4a-822c3c7935fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:12.528478 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ba9a5-4272-4d7b-8d4a-822c3c7935fa admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:12.542281 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 938/1899] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:48:12.551158 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94382a-7728-436c-8bf8-ee10b5659325 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:12.561374 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94382a-7728-436c-8bf8-ee10b5659325 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:12.566317 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d891d-aed0-478d-b84f-f75e187b66d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:12.566994 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d891d-aed0-478d-b84f-f75e187b66d6 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:12.567268 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d891d-aed0-478d-b84f-f75e187b66d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:12.567556 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d891d-aed0-478d-b84f-f75e187b66d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:12.568435 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d891d-aed0-478d-b84f-f75e187b66d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:12.570378 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d891d-aed0-478d-b84f-f75e187b66d6 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:12.598805 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 962/1900] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:12 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:12.602984 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ba9a5-4272-4d7b-8d4a-822c3c7935fa admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:12.617861 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ba9a5-4272-4d7b-8d4a-822c3c7935fa admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:12.683758 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d995c-9365-4315-a92f-d9879b3e5ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:12.684432 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d995c-9365-4315-a92f-d9879b3e5ace admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:12.684842 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d995c-9365-4315-a92f-d9879b3e5ace admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:12.685118 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d995c-9365-4315-a92f-d9879b3e5ace admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:12.686188 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d995c-9365-4315-a92f-d9879b3e5ace admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:12.688137 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d995c-9365-4315-a92f-d9879b3e5ace admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:12.710893 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 939/1901] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:12 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:12.712175 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d891d-aed0-478d-b84f-f75e187b66d6 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:12.722688 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d891d-aed0-478d-b84f-f75e187b66d6 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:12.727215 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52589c83-830f-45ef-a1f0-b16e35a28865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:12.727908 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589c83-830f-45ef-a1f0-b16e35a28865 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:12.728187 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589c83-830f-45ef-a1f0-b16e35a28865 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:12.728456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52589c83-830f-45ef-a1f0-b16e35a28865 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:12.729200 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52589c83-830f-45ef-a1f0-b16e35a28865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:12.730810 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52589c83-830f-45ef-a1f0-b16e35a28865 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:12.748843 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 963/1902] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:12.753018 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d995c-9365-4315-a92f-d9879b3e5ace admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:12.763243 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d995c-9365-4315-a92f-d9879b3e5ace admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:12.768398 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a8f5f-a98c-485b-b4bd-41608c5facd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:12.769049 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a8f5f-a98c-485b-b4bd-41608c5facd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:12.769328 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a8f5f-a98c-485b-b4bd-41608c5facd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:12.769594 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a8f5f-a98c-485b-b4bd-41608c5facd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:12.770333 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a8f5f-a98c-485b-b4bd-41608c5facd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:12.771950 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a8f5f-a98c-485b-b4bd-41608c5facd9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:12.781575 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 940/1903] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:12.786173 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52589c83-830f-45ef-a1f0-b16e35a28865 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:12.796412 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52589c83-830f-45ef-a1f0-b16e35a28865 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:12.801634 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5760dc-88cb-4488-893c-9ee1b61e2bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:12.802532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5760dc-88cb-4488-893c-9ee1b61e2bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:12.802870 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5760dc-88cb-4488-893c-9ee1b61e2bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:12.803287 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5760dc-88cb-4488-893c-9ee1b61e2bb5 admin admin] PATH_INFO: `/v3/projects/a94a9dd330e541f7a4b43d51e5bfffe1/users/f219b67d940642f297aa07d86b33e013/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:12.823793 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5760dc-88cb-4488-893c-9ee1b61e2bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94a9dd330e541f7a4b43d51e5bfffe1, user_id=f219b67d940642f297aa07d86b33e013, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:12.826456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5760dc-88cb-4488-893c-9ee1b61e2bb5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:12.842448 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 964/1904] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:12 2022] PUT /identity/v3/projects/a94a9dd330e541f7a4b43d51e5bfffe1/users/f219b67d940642f297aa07d86b33e013/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:12.855461 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ca7be-786b-4f4e-bf8b-e9719f763a59 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:12.855782 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ca7be-786b-4f4e-bf8b-e9719f763a59 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:12.856083 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ca7be-786b-4f4e-bf8b-e9719f763a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:12.883439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-603ca7be-786b-4f4e-bf8b-e9719f763a59 None None] MFA Rules not processed for user `f219b67d940642f297aa07d86b33e013`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:12.884611 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-603ca7be-786b-4f4e-bf8b-e9719f763a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:12.947078 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 941/1905] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:12.957585 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5760dc-88cb-4488-893c-9ee1b61e2bb5 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:12.959919 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-8a5760dc-88cb-4488-893c-9ee1b61e2bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:13.029389 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5760dc-88cb-4488-893c-9ee1b61e2bb5 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:13.034107 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c078e-7940-43a5-a4e5-2b115d63a581 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:13.034816 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c078e-7940-43a5-a4e5-2b115d63a581 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:13.035101 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c078e-7940-43a5-a4e5-2b115d63a581 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:13.035366 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c078e-7940-43a5-a4e5-2b115d63a581 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:13.043967 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c078e-7940-43a5-a4e5-2b115d63a581 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:13.045410 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c078e-7940-43a5-a4e5-2b115d63a581 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:13.054763 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 965/1906] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:14.038933 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ca7be-786b-4f4e-bf8b-e9719f763a59 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:14.049533 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ca7be-786b-4f4e-bf8b-e9719f763a59 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:14.053672 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831876c-6cf9-454a-aacb-45d3fbbcf04f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:14.054326 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831876c-6cf9-454a-aacb-45d3fbbcf04f service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:14.054601 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831876c-6cf9-454a-aacb-45d3fbbcf04f service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:14.054864 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831876c-6cf9-454a-aacb-45d3fbbcf04f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:14.056783 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-4831876c-6cf9-454a-aacb-45d3fbbcf04f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:14.127375 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831876c-6cf9-454a-aacb-45d3fbbcf04f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:14.129063 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831876c-6cf9-454a-aacb-45d3fbbcf04f service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:14.163942 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 942/1907] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:14 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:27.536901 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c078e-7940-43a5-a4e5-2b115d63a581 service cinder] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:27.539670 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-976c078e-7940-43a5-a4e5-2b115d63a581 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:27.627059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c078e-7940-43a5-a4e5-2b115d63a581 service cinder] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:27.633499 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cc426-a9ab-4aba-b089-202f7a7e8b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:27.634895 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cc426-a9ab-4aba-b089-202f7a7e8b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:27.635229 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cc426-a9ab-4aba-b089-202f7a7e8b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:27.635733 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cc426-a9ab-4aba-b089-202f7a7e8b71 admin admin] PATH_INFO: `/v3/users/fffa339b3f074cdd8b1733ff47637c82` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:27.637588 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cc426-a9ab-4aba-b089-202f7a7e8b71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fffa339b3f074cdd8b1733ff47637c82)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:27.639926 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cc426-a9ab-4aba-b089-202f7a7e8b71 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:27.728725 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-113cc426-a9ab-4aba-b089-202f7a7e8b71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fffa339b3f074cdd8b1733ff47637c82'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:27.735807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-113cc426-a9ab-4aba-b089-202f7a7e8b71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fffa339b3f074cdd8b1733ff47637c82'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:27.743805 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-113cc426-a9ab-4aba-b089-202f7a7e8b71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fffa339b3f074cdd8b1733ff47637c82'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:27.744477 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-113cc426-a9ab-4aba-b089-202f7a7e8b71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fffa339b3f074cdd8b1733ff47637c82'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:27.745085 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-113cc426-a9ab-4aba-b089-202f7a7e8b71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fffa339b3f074cdd8b1733ff47637c82'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:27.762803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 966/1908] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:27 2022] DELETE /identity/v3/users/fffa339b3f074cdd8b1733ff47637c82 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:27.767651 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33369e1-75c0-4600-b5d7-427723b286ef None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:27.768184 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33369e1-75c0-4600-b5d7-427723b286ef None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:27.768276 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33369e1-75c0-4600-b5d7-427723b286ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:27.789805 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-b33369e1-75c0-4600-b5d7-427723b286ef None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:27.791211 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-b33369e1-75c0-4600-b5d7-427723b286ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:27.878446 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 943/1909] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:27.886032 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cc426-a9ab-4aba-b089-202f7a7e8b71 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:27.887444 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-113cc426-a9ab-4aba-b089-202f7a7e8b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:27.917470 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d26de8-9f12-481e-9f7a-c5e6fa95aa60 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:27.918117 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d26de8-9f12-481e-9f7a-c5e6fa95aa60 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:27.918583 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d26de8-9f12-481e-9f7a-c5e6fa95aa60 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:27.921566 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 944/1910] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jan 10 12:48:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 10 12:48:27.929728 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0a748-31d5-4a50-91cd-2a0beff668ea None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:27.930221 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0a748-31d5-4a50-91cd-2a0beff668ea None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:27.930638 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0a748-31d5-4a50-91cd-2a0beff668ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:27.956151 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-ebe0a748-31d5-4a50-91cd-2a0beff668ea None None] MFA Rules not processed for user `d68fa8e4f3a341a5b74ee32c85e59869`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:27.957625 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-ebe0a748-31d5-4a50-91cd-2a0beff668ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:27.973543 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cc426-a9ab-4aba-b089-202f7a7e8b71 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:27.977395 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c8d7a-c6be-4bc7-a829-70ac2585f85a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:27.978043 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c8d7a-c6be-4bc7-a829-70ac2585f85a service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:27.978332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c8d7a-c6be-4bc7-a829-70ac2585f85a service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:27.978641 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c8d7a-c6be-4bc7-a829-70ac2585f85a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:27.990927 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c8d7a-c6be-4bc7-a829-70ac2585f85a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:27.992491 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c8d7a-c6be-4bc7-a829-70ac2585f85a service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:28.005805 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 967/1911] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:28.040719 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 945/1912] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jan 10 12:48:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:28.053775 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c8d7a-c6be-4bc7-a829-70ac2585f85a service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:28.055285 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-2e2c8d7a-c6be-4bc7-a829-70ac2585f85a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:28.086467 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c8d7a-c6be-4bc7-a829-70ac2585f85a service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:28.095625 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609d702-38f7-4851-aaa1-10ddee362a2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:28.096582 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609d702-38f7-4851-aaa1-10ddee362a2b service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:28.096865 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609d702-38f7-4851-aaa1-10ddee362a2b service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:28.098208 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609d702-38f7-4851-aaa1-10ddee362a2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:28.111313 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609d702-38f7-4851-aaa1-10ddee362a2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:28.114079 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609d702-38f7-4851-aaa1-10ddee362a2b service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:28.131754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 968/1913] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:28.293056 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0a748-31d5-4a50-91cd-2a0beff668ea None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:28.294777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-ebe0a748-31d5-4a50-91cd-2a0beff668ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:28.309456 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0a748-31d5-4a50-91cd-2a0beff668ea None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:28.315336 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037ad11-9215-4012-aede-52f523c66aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:28.316538 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037ad11-9215-4012-aede-52f523c66aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:28.317153 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037ad11-9215-4012-aede-52f523c66aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:28.317785 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037ad11-9215-4012-aede-52f523c66aa2 admin admin] PATH_INFO: `/v3/projects/2acf7749ee264fce851228a4a1c1faa3` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:28.319232 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037ad11-9215-4012-aede-52f523c66aa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2acf7749ee264fce851228a4a1c1faa3)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:28.321144 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037ad11-9215-4012-aede-52f523c66aa2 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:28.369524 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6037ad11-9215-4012-aede-52f523c66aa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2acf7749ee264fce851228a4a1c1faa3', 'request_id': 'req-6037ad11-9215-4012-aede-52f523c66aa2'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:28.381605 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6037ad11-9215-4012-aede-52f523c66aa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2acf7749ee264fce851228a4a1c1faa3', 'request_id': 'req-6037ad11-9215-4012-aede-52f523c66aa2'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:28.387728 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6037ad11-9215-4012-aede-52f523c66aa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2acf7749ee264fce851228a4a1c1faa3', 'request_id': 'req-6037ad11-9215-4012-aede-52f523c66aa2'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:28.401463 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6037ad11-9215-4012-aede-52f523c66aa2 admin admin] The token cache is being invalidate because project 2acf7749ee264fce851228a4a1c1faa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:28.401759 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6037ad11-9215-4012-aede-52f523c66aa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:28.402407 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6037ad11-9215-4012-aede-52f523c66aa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:28.404190 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 946/1914] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:28 2022] DELETE /identity/v3/projects/2acf7749ee264fce851228a4a1c1faa3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:28.408335 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609d702-38f7-4851-aaa1-10ddee362a2b service nova] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:28.419258 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609d702-38f7-4851-aaa1-10ddee362a2b service nova] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:28.476355 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20626b3-7915-4a1a-b0c1-c8ad8157f5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:28.477442 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20626b3-7915-4a1a-b0c1-c8ad8157f5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:28.477734 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20626b3-7915-4a1a-b0c1-c8ad8157f5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:28.477989 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20626b3-7915-4a1a-b0c1-c8ad8157f5a6 admin admin] PATH_INFO: `/v3/users/8e0fdbfba4de47cfb8663d78de5cdeea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:28.479428 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20626b3-7915-4a1a-b0c1-c8ad8157f5a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e0fdbfba4de47cfb8663d78de5cdeea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:28.481427 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20626b3-7915-4a1a-b0c1-c8ad8157f5a6 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:28.536693 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-d20626b3-7915-4a1a-b0c1-c8ad8157f5a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e0fdbfba4de47cfb8663d78de5cdeea'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:28.544599 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-d20626b3-7915-4a1a-b0c1-c8ad8157f5a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e0fdbfba4de47cfb8663d78de5cdeea'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:28.561690 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-d20626b3-7915-4a1a-b0c1-c8ad8157f5a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e0fdbfba4de47cfb8663d78de5cdeea'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:28.562687 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-d20626b3-7915-4a1a-b0c1-c8ad8157f5a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e0fdbfba4de47cfb8663d78de5cdeea'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:28.563358 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-d20626b3-7915-4a1a-b0c1-c8ad8157f5a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e0fdbfba4de47cfb8663d78de5cdeea'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:28.583755 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 969/1915] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:28 2022] DELETE /identity/v3/users/8e0fdbfba4de47cfb8663d78de5cdeea => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:28.879215 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037ad11-9215-4012-aede-52f523c66aa2 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:28.880727 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-6037ad11-9215-4012-aede-52f523c66aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:28.898309 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037ad11-9215-4012-aede-52f523c66aa2 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:28.962140 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b4307-f6a8-4102-89b4-ec85bf0aed45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:28.963032 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b4307-f6a8-4102-89b4-ec85bf0aed45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:28.963311 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b4307-f6a8-4102-89b4-ec85bf0aed45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:28.963641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b4307-f6a8-4102-89b4-ec85bf0aed45 admin admin] PATH_INFO: `/v3/projects/8c5d23abfd3045209a447932ff5e9a0f` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:28.965023 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b4307-f6a8-4102-89b4-ec85bf0aed45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c5d23abfd3045209a447932ff5e9a0f)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:28.967870 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b4307-f6a8-4102-89b4-ec85bf0aed45 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:29.022462 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-ac6b4307-f6a8-4102-89b4-ec85bf0aed45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c5d23abfd3045209a447932ff5e9a0f', 'request_id': 'req-ac6b4307-f6a8-4102-89b4-ec85bf0aed45'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:29.030583 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-ac6b4307-f6a8-4102-89b4-ec85bf0aed45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c5d23abfd3045209a447932ff5e9a0f', 'request_id': 'req-ac6b4307-f6a8-4102-89b4-ec85bf0aed45'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:29.036136 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-ac6b4307-f6a8-4102-89b4-ec85bf0aed45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c5d23abfd3045209a447932ff5e9a0f', 'request_id': 'req-ac6b4307-f6a8-4102-89b4-ec85bf0aed45'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:29.047936 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-ac6b4307-f6a8-4102-89b4-ec85bf0aed45 admin admin] The token cache is being invalidate because project 8c5d23abfd3045209a447932ff5e9a0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:29.048486 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-ac6b4307-f6a8-4102-89b4-ec85bf0aed45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:29.049154 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-ac6b4307-f6a8-4102-89b4-ec85bf0aed45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:29.051206 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 947/1916] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:28 2022] DELETE /identity/v3/projects/8c5d23abfd3045209a447932ff5e9a0f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:29.058551 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646c053-55e5-48a1-8dfa-81ccbf3ad0dc None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:29.058914 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646c053-55e5-48a1-8dfa-81ccbf3ad0dc None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:29.059884 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646c053-55e5-48a1-8dfa-81ccbf3ad0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:29.078752 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-9646c053-55e5-48a1-8dfa-81ccbf3ad0dc None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:29.079992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-9646c053-55e5-48a1-8dfa-81ccbf3ad0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:29.159554 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 970/1917] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:29.168470 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d9e04-cbbe-4cbd-a825-c9d7e676445f None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:29.168745 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d9e04-cbbe-4cbd-a825-c9d7e676445f None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:29.169034 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d9e04-cbbe-4cbd-a825-c9d7e676445f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:29.188799 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-6b5d9e04-cbbe-4cbd-a825-c9d7e676445f None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:29.190006 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-6b5d9e04-cbbe-4cbd-a825-c9d7e676445f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:29.198202 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 948/1918] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:29.202663 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646c053-55e5-48a1-8dfa-81ccbf3ad0dc None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:29.212240 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646c053-55e5-48a1-8dfa-81ccbf3ad0dc None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:29.216963 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace686fc-c194-4081-b743-75726f781242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:29.217660 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace686fc-c194-4081-b743-75726f781242 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:29.217934 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace686fc-c194-4081-b743-75726f781242 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:29.218198 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace686fc-c194-4081-b743-75726f781242 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:29.218938 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace686fc-c194-4081-b743-75726f781242 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:48:29.219262 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace686fc-c194-4081-b743-75726f781242 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:29.221037 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace686fc-c194-4081-b743-75726f781242 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:29.233829 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 971/1919] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:48:29.238591 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d9e04-cbbe-4cbd-a825-c9d7e676445f None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:29.249646 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d9e04-cbbe-4cbd-a825-c9d7e676445f None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:29.255179 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15a759-8c94-4371-b020-a725048cc15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:29.255994 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15a759-8c94-4371-b020-a725048cc15f admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:29.256340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15a759-8c94-4371-b020-a725048cc15f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:29.256674 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15a759-8c94-4371-b020-a725048cc15f admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:29.257459 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a15a759-8c94-4371-b020-a725048cc15f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:29.259495 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a15a759-8c94-4371-b020-a725048cc15f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:29.289039 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 949/1920] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:29 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:29.293545 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace686fc-c194-4081-b743-75726f781242 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:29.304145 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace686fc-c194-4081-b743-75726f781242 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:29.362238 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5103bf-c8f3-4ab0-a5d5-fab8adf2ff3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:29.362920 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5103bf-c8f3-4ab0-a5d5-fab8adf2ff3a admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:29.363450 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5103bf-c8f3-4ab0-a5d5-fab8adf2ff3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:29.363730 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5103bf-c8f3-4ab0-a5d5-fab8adf2ff3a admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:29.364431 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5103bf-c8f3-4ab0-a5d5-fab8adf2ff3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:29.366370 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5103bf-c8f3-4ab0-a5d5-fab8adf2ff3a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:29.392471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 972/1921] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:29 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:29.398670 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15a759-8c94-4371-b020-a725048cc15f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:29.413520 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15a759-8c94-4371-b020-a725048cc15f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:29.418884 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58038ca-1ad3-458b-95c7-aeb3945e952f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:29.419579 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58038ca-1ad3-458b-95c7-aeb3945e952f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:29.419858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58038ca-1ad3-458b-95c7-aeb3945e952f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:29.420123 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58038ca-1ad3-458b-95c7-aeb3945e952f admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:29.420862 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58038ca-1ad3-458b-95c7-aeb3945e952f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:29.422462 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58038ca-1ad3-458b-95c7-aeb3945e952f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:29.434037 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 950/1922] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:29.438476 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5103bf-c8f3-4ab0-a5d5-fab8adf2ff3a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:29.449438 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5103bf-c8f3-4ab0-a5d5-fab8adf2ff3a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:29.455540 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b26286-15cf-4a44-8b2f-1085d1a6e9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:29.456211 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b26286-15cf-4a44-8b2f-1085d1a6e9df admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:29.456489 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b26286-15cf-4a44-8b2f-1085d1a6e9df admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:29.456779 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b26286-15cf-4a44-8b2f-1085d1a6e9df admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:29.458091 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b26286-15cf-4a44-8b2f-1085d1a6e9df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:29.459731 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b26286-15cf-4a44-8b2f-1085d1a6e9df admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:29.470530 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 973/1923] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:29.476006 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58038ca-1ad3-458b-95c7-aeb3945e952f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:29.490008 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58038ca-1ad3-458b-95c7-aeb3945e952f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:29.495043 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c14a66-27de-485d-af99-c00f633650a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:29.495964 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c14a66-27de-485d-af99-c00f633650a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:29.496242 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c14a66-27de-485d-af99-c00f633650a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:29.496509 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c14a66-27de-485d-af99-c00f633650a6 admin admin] PATH_INFO: `/v3/projects/d22b4611fcd64275917288ad91ee76da/users/6ae001e0dfc64a5d89b9c18fcf48b6b4/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:29.511833 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c14a66-27de-485d-af99-c00f633650a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22b4611fcd64275917288ad91ee76da, user_id=6ae001e0dfc64a5d89b9c18fcf48b6b4, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:29.514498 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c14a66-27de-485d-af99-c00f633650a6 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:29.528924 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 951/1924] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:29 2022] PUT /identity/v3/projects/d22b4611fcd64275917288ad91ee76da/users/6ae001e0dfc64a5d89b9c18fcf48b6b4/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:29.544853 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028205b-5ed2-4257-a9f8-6fa7aca3a8aa None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:29.545971 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028205b-5ed2-4257-a9f8-6fa7aca3a8aa None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:29.545971 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028205b-5ed2-4257-a9f8-6fa7aca3a8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:29.577240 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-2028205b-5ed2-4257-a9f8-6fa7aca3a8aa None None] MFA Rules not processed for user `6ae001e0dfc64a5d89b9c18fcf48b6b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:29.578468 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-2028205b-5ed2-4257-a9f8-6fa7aca3a8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:29.647336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 974/1925] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:29.652277 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c14a66-27de-485d-af99-c00f633650a6 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:29.717473 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c14a66-27de-485d-af99-c00f633650a6 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:29.722754 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640188a-b8d8-4943-bcf5-506b31b734b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:29.723757 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640188a-b8d8-4943-bcf5-506b31b734b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:29.724039 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640188a-b8d8-4943-bcf5-506b31b734b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:29.724310 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640188a-b8d8-4943-bcf5-506b31b734b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:29.725022 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640188a-b8d8-4943-bcf5-506b31b734b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:29.727249 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640188a-b8d8-4943-bcf5-506b31b734b7 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:29.753917 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 952/1926] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:29 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:48:29.758180 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028205b-5ed2-4257-a9f8-6fa7aca3a8aa None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:29.770466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028205b-5ed2-4257-a9f8-6fa7aca3a8aa None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:29.828502 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bc3ca-48d0-4cf0-bbdb-0cf76e902555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:29.829127 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bc3ca-48d0-4cf0-bbdb-0cf76e902555 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:29.829394 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bc3ca-48d0-4cf0-bbdb-0cf76e902555 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:29.829662 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bc3ca-48d0-4cf0-bbdb-0cf76e902555 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:29.830363 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bc3ca-48d0-4cf0-bbdb-0cf76e902555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:29.832957 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bc3ca-48d0-4cf0-bbdb-0cf76e902555 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:29.858224 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 975/1927] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:29 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:29.862490 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640188a-b8d8-4943-bcf5-506b31b734b7 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:29.872924 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640188a-b8d8-4943-bcf5-506b31b734b7 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:29.877664 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e2fee-3dbc-4901-bedd-42e7090fe805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:29.878332 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e2fee-3dbc-4901-bedd-42e7090fe805 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:29.878678 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e2fee-3dbc-4901-bedd-42e7090fe805 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:29.878977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e2fee-3dbc-4901-bedd-42e7090fe805 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:29.879719 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e2fee-3dbc-4901-bedd-42e7090fe805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:29.881354 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e2fee-3dbc-4901-bedd-42e7090fe805 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:29.891783 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 953/1928] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:29.896728 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bc3ca-48d0-4cf0-bbdb-0cf76e902555 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:29.906702 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bc3ca-48d0-4cf0-bbdb-0cf76e902555 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:29.912918 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46156a-e699-41be-aeb5-12036e5a24ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:29.913807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46156a-e699-41be-aeb5-12036e5a24ed admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:29.914085 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46156a-e699-41be-aeb5-12036e5a24ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:29.914353 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46156a-e699-41be-aeb5-12036e5a24ed admin admin] PATH_INFO: `/v3/projects/dbbd79182d0c4665bf6f11fda5e9b272/users/3dfd2e918bfb4539a7d5139dbfa912e3/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:29.930040 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46156a-e699-41be-aeb5-12036e5a24ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbbd79182d0c4665bf6f11fda5e9b272, user_id=3dfd2e918bfb4539a7d5139dbfa912e3, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:29.932754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46156a-e699-41be-aeb5-12036e5a24ed admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:29.948924 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 976/1929] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:29 2022] PUT /identity/v3/projects/dbbd79182d0c4665bf6f11fda5e9b272/users/3dfd2e918bfb4539a7d5139dbfa912e3/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:29.953298 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e2fee-3dbc-4901-bedd-42e7090fe805 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:29.963198 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e2fee-3dbc-4901-bedd-42e7090fe805 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:30.022772 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb5200-613b-49a5-812b-f9e6d3d7a4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:30.023467 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb5200-613b-49a5-812b-f9e6d3d7a4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:30.023756 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb5200-613b-49a5-812b-f9e6d3d7a4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:30.024028 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb5200-613b-49a5-812b-f9e6d3d7a4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:30.024772 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb5200-613b-49a5-812b-f9e6d3d7a4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:30.026374 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb5200-613b-49a5-812b-f9e6d3d7a4c9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:30.036669 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 954/1930] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:30.041204 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46156a-e699-41be-aeb5-12036e5a24ed admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:30.051917 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46156a-e699-41be-aeb5-12036e5a24ed admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:30.057173 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f244e2b-2e7c-456a-befd-29aa31b5fa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:30.058077 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f244e2b-2e7c-456a-befd-29aa31b5fa93 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:30.058348 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f244e2b-2e7c-456a-befd-29aa31b5fa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:30.058587 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f244e2b-2e7c-456a-befd-29aa31b5fa93 admin admin] PATH_INFO: `/v3/projects/dbbd79182d0c4665bf6f11fda5e9b272/users/3dfd2e918bfb4539a7d5139dbfa912e3/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:30.061098 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f244e2b-2e7c-456a-befd-29aa31b5fa93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbbd79182d0c4665bf6f11fda5e9b272, user_id=3dfd2e918bfb4539a7d5139dbfa912e3, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:30.063922 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f244e2b-2e7c-456a-befd-29aa31b5fa93 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:30.074849 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 977/1931] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:30 2022] PUT /identity/v3/projects/dbbd79182d0c4665bf6f11fda5e9b272/users/3dfd2e918bfb4539a7d5139dbfa912e3/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:30.085175 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b06b89-7f6f-4ca2-8f6a-1d45c37a4898 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:30.085349 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b06b89-7f6f-4ca2-8f6a-1d45c37a4898 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:30.085691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b06b89-7f6f-4ca2-8f6a-1d45c37a4898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:30.114379 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-42b06b89-7f6f-4ca2-8f6a-1d45c37a4898 None None] MFA Rules not processed for user `3dfd2e918bfb4539a7d5139dbfa912e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:30.115563 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-42b06b89-7f6f-4ca2-8f6a-1d45c37a4898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:30.192586 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 955/1932] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:30.204933 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f244e2b-2e7c-456a-befd-29aa31b5fa93 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:30.206732 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-5f244e2b-2e7c-456a-befd-29aa31b5fa93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:30.263323 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f244e2b-2e7c-456a-befd-29aa31b5fa93 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:30.267116 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccaad2-3f5d-4749-b4a2-5be22dd8d3b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:30.267868 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccaad2-3f5d-4749-b4a2-5be22dd8d3b4 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:30.268148 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccaad2-3f5d-4749-b4a2-5be22dd8d3b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:30.268421 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccaad2-3f5d-4749-b4a2-5be22dd8d3b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:30.278514 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccaad2-3f5d-4749-b4a2-5be22dd8d3b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:30.280008 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccaad2-3f5d-4749-b4a2-5be22dd8d3b4 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:30.290130 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 978/1933] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:30.790763 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b06b89-7f6f-4ca2-8f6a-1d45c37a4898 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:30.860792 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b06b89-7f6f-4ca2-8f6a-1d45c37a4898 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:30.867295 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd0bc3-93e7-47e8-9e10-5a6d4ea12fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:30.868351 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd0bc3-93e7-47e8-9e10-5a6d4ea12fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:30.868700 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd0bc3-93e7-47e8-9e10-5a6d4ea12fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:30.869034 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd0bc3-93e7-47e8-9e10-5a6d4ea12fc3 admin admin] PATH_INFO: `/v3/users/6ae001e0dfc64a5d89b9c18fcf48b6b4` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:30.870409 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd0bc3-93e7-47e8-9e10-5a6d4ea12fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae001e0dfc64a5d89b9c18fcf48b6b4)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:30.872838 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd0bc3-93e7-47e8-9e10-5a6d4ea12fc3 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:30.925437 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-35cd0bc3-93e7-47e8-9e10-5a6d4ea12fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae001e0dfc64a5d89b9c18fcf48b6b4'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:30.926554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-35cd0bc3-93e7-47e8-9e10-5a6d4ea12fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae001e0dfc64a5d89b9c18fcf48b6b4'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:30.927314 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-35cd0bc3-93e7-47e8-9e10-5a6d4ea12fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae001e0dfc64a5d89b9c18fcf48b6b4'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:30.939764 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-35cd0bc3-93e7-47e8-9e10-5a6d4ea12fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae001e0dfc64a5d89b9c18fcf48b6b4'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:30.950314 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-35cd0bc3-93e7-47e8-9e10-5a6d4ea12fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae001e0dfc64a5d89b9c18fcf48b6b4'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:30.965526 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 956/1934] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:30 2022] DELETE /identity/v3/users/6ae001e0dfc64a5d89b9c18fcf48b6b4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:30.970376 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0e9c6-6e1a-4af5-aa8b-851dc2a48170 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:30.970376 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0e9c6-6e1a-4af5-aa8b-851dc2a48170 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:30.970924 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0e9c6-6e1a-4af5-aa8b-851dc2a48170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:30.992069 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-2ea0e9c6-6e1a-4af5-aa8b-851dc2a48170 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:30.993900 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-2ea0e9c6-6e1a-4af5-aa8b-851dc2a48170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:31.066127 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 979/1935] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:31.076743 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd0bc3-93e7-47e8-9e10-5a6d4ea12fc3 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:31.078365 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-35cd0bc3-93e7-47e8-9e10-5a6d4ea12fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:31.144426 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd0bc3-93e7-47e8-9e10-5a6d4ea12fc3 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:31.148752 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad01a3-bb52-48e8-883b-0119a30c1c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:31.149462 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad01a3-bb52-48e8-883b-0119a30c1c2a service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:31.149734 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad01a3-bb52-48e8-883b-0119a30c1c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:31.150015 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad01a3-bb52-48e8-883b-0119a30c1c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:31.160655 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad01a3-bb52-48e8-883b-0119a30c1c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:31.162143 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad01a3-bb52-48e8-883b-0119a30c1c2a service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:31.172536 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 957/1936] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:31.670364 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0e9c6-6e1a-4af5-aa8b-851dc2a48170 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:31.672038 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-2ea0e9c6-6e1a-4af5-aa8b-851dc2a48170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:31.686103 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0e9c6-6e1a-4af5-aa8b-851dc2a48170 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:31.692611 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef0cac-6415-47cf-8066-79aec38bbe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:31.693815 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef0cac-6415-47cf-8066-79aec38bbe6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:31.694260 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef0cac-6415-47cf-8066-79aec38bbe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:31.694704 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef0cac-6415-47cf-8066-79aec38bbe6b admin admin] PATH_INFO: `/v3/projects/d22b4611fcd64275917288ad91ee76da` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:31.696229 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef0cac-6415-47cf-8066-79aec38bbe6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d22b4611fcd64275917288ad91ee76da)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:31.698461 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef0cac-6415-47cf-8066-79aec38bbe6b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:31.751178 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c1ef0cac-6415-47cf-8066-79aec38bbe6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd22b4611fcd64275917288ad91ee76da', 'request_id': 'req-c1ef0cac-6415-47cf-8066-79aec38bbe6b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:31.757991 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c1ef0cac-6415-47cf-8066-79aec38bbe6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd22b4611fcd64275917288ad91ee76da', 'request_id': 'req-c1ef0cac-6415-47cf-8066-79aec38bbe6b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:31.770736 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c1ef0cac-6415-47cf-8066-79aec38bbe6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd22b4611fcd64275917288ad91ee76da', 'request_id': 'req-c1ef0cac-6415-47cf-8066-79aec38bbe6b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:31.783116 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c1ef0cac-6415-47cf-8066-79aec38bbe6b admin admin] The token cache is being invalidate because project d22b4611fcd64275917288ad91ee76da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:31.783459 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c1ef0cac-6415-47cf-8066-79aec38bbe6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:31.784276 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c1ef0cac-6415-47cf-8066-79aec38bbe6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:31.787701 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 980/1937] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:31 2022] DELETE /identity/v3/projects/d22b4611fcd64275917288ad91ee76da => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:31.791159 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad01a3-bb52-48e8-883b-0119a30c1c2a service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:31.800319 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad01a3-bb52-48e8-883b-0119a30c1c2a service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:31.865164 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81597b19-32f2-42ce-80de-1c892732a9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:31.866173 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81597b19-32f2-42ce-80de-1c892732a9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:31.866453 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81597b19-32f2-42ce-80de-1c892732a9df admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:31.866853 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81597b19-32f2-42ce-80de-1c892732a9df admin admin] PATH_INFO: `/v3/users/3dfd2e918bfb4539a7d5139dbfa912e3` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:31.868229 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81597b19-32f2-42ce-80de-1c892732a9df admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dfd2e918bfb4539a7d5139dbfa912e3)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:31.870207 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81597b19-32f2-42ce-80de-1c892732a9df admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:31.927837 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-81597b19-32f2-42ce-80de-1c892732a9df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dfd2e918bfb4539a7d5139dbfa912e3'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:31.928497 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-81597b19-32f2-42ce-80de-1c892732a9df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dfd2e918bfb4539a7d5139dbfa912e3'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:31.929322 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-81597b19-32f2-42ce-80de-1c892732a9df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dfd2e918bfb4539a7d5139dbfa912e3'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:31.944775 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-81597b19-32f2-42ce-80de-1c892732a9df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dfd2e918bfb4539a7d5139dbfa912e3'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:31.952080 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-81597b19-32f2-42ce-80de-1c892732a9df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dfd2e918bfb4539a7d5139dbfa912e3'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:31.970267 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 958/1938] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:31 2022] DELETE /identity/v3/users/3dfd2e918bfb4539a7d5139dbfa912e3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:32.183982 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef0cac-6415-47cf-8066-79aec38bbe6b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:32.187037 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c1ef0cac-6415-47cf-8066-79aec38bbe6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:32.214317 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef0cac-6415-47cf-8066-79aec38bbe6b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:32.277574 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81597b19-32f2-42ce-80de-1c892732a9df admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:32.280957 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-81597b19-32f2-42ce-80de-1c892732a9df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:32.304335 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219056a7-43f6-4ae0-884c-8361800df189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:32.305507 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219056a7-43f6-4ae0-884c-8361800df189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:32.306347 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219056a7-43f6-4ae0-884c-8361800df189 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:32.306844 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219056a7-43f6-4ae0-884c-8361800df189 admin admin] PATH_INFO: `/v3/users/9a5ecff2da4c437db55a1987981c7a03` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:32.308350 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219056a7-43f6-4ae0-884c-8361800df189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a5ecff2da4c437db55a1987981c7a03)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:32.311695 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219056a7-43f6-4ae0-884c-8361800df189 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:32.368835 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-219056a7-43f6-4ae0-884c-8361800df189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a5ecff2da4c437db55a1987981c7a03'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:32.374769 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81597b19-32f2-42ce-80de-1c892732a9df admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:32.375579 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-219056a7-43f6-4ae0-884c-8361800df189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a5ecff2da4c437db55a1987981c7a03'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:32.379772 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078f8a9-ba7e-494e-9cea-82d5b01cbf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:32.380737 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078f8a9-ba7e-494e-9cea-82d5b01cbf8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:32.381046 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078f8a9-ba7e-494e-9cea-82d5b01cbf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:32.381339 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078f8a9-ba7e-494e-9cea-82d5b01cbf8e admin admin] PATH_INFO: `/v3/projects/dbbd79182d0c4665bf6f11fda5e9b272` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:32.382677 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078f8a9-ba7e-494e-9cea-82d5b01cbf8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbbd79182d0c4665bf6f11fda5e9b272)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:32.383985 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-219056a7-43f6-4ae0-884c-8361800df189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a5ecff2da4c437db55a1987981c7a03'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:32.384584 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-219056a7-43f6-4ae0-884c-8361800df189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a5ecff2da4c437db55a1987981c7a03'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:32.384686 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b078f8a9-ba7e-494e-9cea-82d5b01cbf8e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:32.385188 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-219056a7-43f6-4ae0-884c-8361800df189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a5ecff2da4c437db55a1987981c7a03'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:32.402057 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 981/1939] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:32 2022] DELETE /identity/v3/users/9a5ecff2da4c437db55a1987981c7a03 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:32.406528 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff15d7-fbbd-44c1-bdc5-246911a7d286 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:32.406810 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff15d7-fbbd-44c1-bdc5-246911a7d286 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:32.407086 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff15d7-fbbd-44c1-bdc5-246911a7d286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:32.424160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-dbff15d7-fbbd-44c1-bdc5-246911a7d286 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:32.425365 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-dbff15d7-fbbd-44c1-bdc5-246911a7d286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:32.430280 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b078f8a9-ba7e-494e-9cea-82d5b01cbf8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbbd79182d0c4665bf6f11fda5e9b272', 'request_id': 'req-b078f8a9-ba7e-494e-9cea-82d5b01cbf8e'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:32.437521 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b078f8a9-ba7e-494e-9cea-82d5b01cbf8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbbd79182d0c4665bf6f11fda5e9b272', 'request_id': 'req-b078f8a9-ba7e-494e-9cea-82d5b01cbf8e'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:32.443053 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b078f8a9-ba7e-494e-9cea-82d5b01cbf8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbbd79182d0c4665bf6f11fda5e9b272', 'request_id': 'req-b078f8a9-ba7e-494e-9cea-82d5b01cbf8e'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:32.454246 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b078f8a9-ba7e-494e-9cea-82d5b01cbf8e admin admin] The token cache is being invalidate because project dbbd79182d0c4665bf6f11fda5e9b272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:32.454983 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b078f8a9-ba7e-494e-9cea-82d5b01cbf8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:32.455656 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b078f8a9-ba7e-494e-9cea-82d5b01cbf8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:32.457353 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 959/1940] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:32 2022] DELETE /identity/v3/projects/dbbd79182d0c4665bf6f11fda5e9b272 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:32.463153 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02339078-cf01-4f22-9c1f-2d5022ebc65c None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:32.463449 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02339078-cf01-4f22-9c1f-2d5022ebc65c None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:32.463756 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02339078-cf01-4f22-9c1f-2d5022ebc65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:32.481389 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-02339078-cf01-4f22-9c1f-2d5022ebc65c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:32.482570 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-02339078-cf01-4f22-9c1f-2d5022ebc65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:32.487420 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 982/1941] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:32.491557 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 960/1942] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:32.497911 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff15d7-fbbd-44c1-bdc5-246911a7d286 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:32.499209 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcfa6c-426d-4b47-8f0c-c1a7633f0273 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:32.499461 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-dbff15d7-fbbd-44c1-bdc5-246911a7d286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:32.499602 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcfa6c-426d-4b47-8f0c-c1a7633f0273 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:32.499795 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcfa6c-426d-4b47-8f0c-c1a7633f0273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:32.518898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-00fcfa6c-426d-4b47-8f0c-c1a7633f0273 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:32.520397 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-00fcfa6c-426d-4b47-8f0c-c1a7633f0273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:32.528360 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 961/1943] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:32.532648 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcfa6c-426d-4b47-8f0c-c1a7633f0273 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:32.542661 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcfa6c-426d-4b47-8f0c-c1a7633f0273 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:32.547792 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ffb23-7700-428f-972d-4ac31f5ff090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:32.548573 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ffb23-7700-428f-972d-4ac31f5ff090 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:32.548851 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ffb23-7700-428f-972d-4ac31f5ff090 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:32.549118 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ffb23-7700-428f-972d-4ac31f5ff090 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:32.549860 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ffb23-7700-428f-972d-4ac31f5ff090 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:48:32.550162 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ffb23-7700-428f-972d-4ac31f5ff090 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:32.552809 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ffb23-7700-428f-972d-4ac31f5ff090 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:32.561885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff15d7-fbbd-44c1-bdc5-246911a7d286 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:32.569151 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e40a5-10e5-4ba5-8e20-eca7e659c72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:32.570099 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e40a5-10e5-4ba5-8e20-eca7e659c72d service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:32.570384 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e40a5-10e5-4ba5-8e20-eca7e659c72d service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:32.570660 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e40a5-10e5-4ba5-8e20-eca7e659c72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:32.575549 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 962/1944] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:48:32.576692 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ffb23-7700-428f-972d-4ac31f5ff090 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:32.585536 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e40a5-10e5-4ba5-8e20-eca7e659c72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:32.587024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e40a5-10e5-4ba5-8e20-eca7e659c72d service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:32.587588 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ffb23-7700-428f-972d-4ac31f5ff090 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:32.593532 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc6e72-652e-4de2-bab5-0e0d10438574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:32.594360 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc6e72-652e-4de2-bab5-0e0d10438574 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:32.594761 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc6e72-652e-4de2-bab5-0e0d10438574 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:32.595163 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc6e72-652e-4de2-bab5-0e0d10438574 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:32.596019 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc6e72-652e-4de2-bab5-0e0d10438574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:32.598781 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc6e72-652e-4de2-bab5-0e0d10438574 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:32.600095 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 983/1945] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:32.625447 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 963/1946] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:32 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:32.629701 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e40a5-10e5-4ba5-8e20-eca7e659c72d service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:32.639197 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e40a5-10e5-4ba5-8e20-eca7e659c72d service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:32.694935 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9ed60-1459-472d-a1d9-307def365bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:32.695801 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9ed60-1459-472d-a1d9-307def365bab admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:32.696148 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9ed60-1459-472d-a1d9-307def365bab admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:32.696425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9ed60-1459-472d-a1d9-307def365bab admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:32.697144 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9ed60-1459-472d-a1d9-307def365bab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:32.699215 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9ed60-1459-472d-a1d9-307def365bab admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:32.721747 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 984/1947] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:32 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:32.723294 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc6e72-652e-4de2-bab5-0e0d10438574 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:32.734266 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc6e72-652e-4de2-bab5-0e0d10438574 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:32.741567 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2fa68-bc70-4998-82a5-03dd22696c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:32.742624 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2fa68-bc70-4998-82a5-03dd22696c81 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:32.743095 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2fa68-bc70-4998-82a5-03dd22696c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:32.743507 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2fa68-bc70-4998-82a5-03dd22696c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:32.744476 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2fa68-bc70-4998-82a5-03dd22696c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:32.746493 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2fa68-bc70-4998-82a5-03dd22696c81 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:32.761528 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 964/1948] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:32.765862 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9ed60-1459-472d-a1d9-307def365bab admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:32.776156 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9ed60-1459-472d-a1d9-307def365bab admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:32.780715 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8def00f-95b8-4693-a53a-f8d01661eee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:32.781387 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8def00f-95b8-4693-a53a-f8d01661eee7 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:32.781665 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8def00f-95b8-4693-a53a-f8d01661eee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:32.781933 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8def00f-95b8-4693-a53a-f8d01661eee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:32.783080 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8def00f-95b8-4693-a53a-f8d01661eee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:32.784793 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8def00f-95b8-4693-a53a-f8d01661eee7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:32.795584 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 985/1949] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:32.799386 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2fa68-bc70-4998-82a5-03dd22696c81 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:32.809853 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2fa68-bc70-4998-82a5-03dd22696c81 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:32.814965 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eb173-bae5-4470-b3fd-67501a0755b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:32.815918 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eb173-bae5-4470-b3fd-67501a0755b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:32.816328 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eb173-bae5-4470-b3fd-67501a0755b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:32.816987 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eb173-bae5-4470-b3fd-67501a0755b4 admin admin] PATH_INFO: `/v3/projects/f944382a80b04e22b2fc42c83e08abf6/users/ebff39f961ca4b70ae050b03e2325507/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:32.834027 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63eb173-bae5-4470-b3fd-67501a0755b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f944382a80b04e22b2fc42c83e08abf6, user_id=ebff39f961ca4b70ae050b03e2325507, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:32.837400 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63eb173-bae5-4470-b3fd-67501a0755b4 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:32.861505 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 965/1950] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:32 2022] PUT /identity/v3/projects/f944382a80b04e22b2fc42c83e08abf6/users/ebff39f961ca4b70ae050b03e2325507/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:32.864649 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285477c8-6a95-4c08-a19d-c07bd26a7af7 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:32.865007 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285477c8-6a95-4c08-a19d-c07bd26a7af7 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:32.865284 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285477c8-6a95-4c08-a19d-c07bd26a7af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:32.897399 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-285477c8-6a95-4c08-a19d-c07bd26a7af7 None None] MFA Rules not processed for user `ebff39f961ca4b70ae050b03e2325507`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:32.898787 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-285477c8-6a95-4c08-a19d-c07bd26a7af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:32.955531 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eb173-bae5-4470-b3fd-67501a0755b4 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:32.958443 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e63eb173-bae5-4470-b3fd-67501a0755b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:32.981112 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 986/1951] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:32.993029 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285477c8-6a95-4c08-a19d-c07bd26a7af7 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:32.997011 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-285477c8-6a95-4c08-a19d-c07bd26a7af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:33.046058 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eb173-bae5-4470-b3fd-67501a0755b4 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:33.051160 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ef2bd-7ee9-46d7-aab2-9425772c0444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:33.052170 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ef2bd-7ee9-46d7-aab2-9425772c0444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:33.052448 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ef2bd-7ee9-46d7-aab2-9425772c0444 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:33.052749 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ef2bd-7ee9-46d7-aab2-9425772c0444 admin admin] PATH_INFO: `/v3/projects/ea9b04b9134b419581e41b6f1a950269` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:33.053977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ef2bd-7ee9-46d7-aab2-9425772c0444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9b04b9134b419581e41b6f1a950269)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:33.056568 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ef2bd-7ee9-46d7-aab2-9425772c0444 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:33.067041 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285477c8-6a95-4c08-a19d-c07bd26a7af7 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:33.068575 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f777b-6b83-4168-bb29-7e059488c5d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:33.069316 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f777b-6b83-4168-bb29-7e059488c5d6 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:33.069667 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f777b-6b83-4168-bb29-7e059488c5d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:33.069940 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f777b-6b83-4168-bb29-7e059488c5d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:33.078522 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f777b-6b83-4168-bb29-7e059488c5d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:33.080221 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f777b-6b83-4168-bb29-7e059488c5d6 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:33.089196 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 987/1952] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:48:33.113886 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-f77ef2bd-7ee9-46d7-aab2-9425772c0444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9b04b9134b419581e41b6f1a950269', 'request_id': 'req-f77ef2bd-7ee9-46d7-aab2-9425772c0444'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:33.123716 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-f77ef2bd-7ee9-46d7-aab2-9425772c0444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9b04b9134b419581e41b6f1a950269', 'request_id': 'req-f77ef2bd-7ee9-46d7-aab2-9425772c0444'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:33.130583 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-f77ef2bd-7ee9-46d7-aab2-9425772c0444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9b04b9134b419581e41b6f1a950269', 'request_id': 'req-f77ef2bd-7ee9-46d7-aab2-9425772c0444'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:33.141764 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-f77ef2bd-7ee9-46d7-aab2-9425772c0444 admin admin] The token cache is being invalidate because project ea9b04b9134b419581e41b6f1a950269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:33.142051 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-f77ef2bd-7ee9-46d7-aab2-9425772c0444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:33.142780 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-f77ef2bd-7ee9-46d7-aab2-9425772c0444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:33.144824 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 966/1953] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:32 2022] DELETE /identity/v3/projects/ea9b04b9134b419581e41b6f1a950269 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:33.149277 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f777b-6b83-4168-bb29-7e059488c5d6 service cinder] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:33.160430 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f777b-6b83-4168-bb29-7e059488c5d6 service cinder] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:33.215204 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2394d9c-b4b5-4c57-9da3-7d779f2bed53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:33.216263 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2394d9c-b4b5-4c57-9da3-7d779f2bed53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:33.216661 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2394d9c-b4b5-4c57-9da3-7d779f2bed53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:33.216936 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2394d9c-b4b5-4c57-9da3-7d779f2bed53 admin admin] PATH_INFO: `/v3/users/aeaa13c57c7c4edbb9fa97d405a47c63` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:33.218250 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2394d9c-b4b5-4c57-9da3-7d779f2bed53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeaa13c57c7c4edbb9fa97d405a47c63)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:33.220363 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2394d9c-b4b5-4c57-9da3-7d779f2bed53 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:33.273845 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-a2394d9c-b4b5-4c57-9da3-7d779f2bed53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeaa13c57c7c4edbb9fa97d405a47c63'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:33.281507 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-a2394d9c-b4b5-4c57-9da3-7d779f2bed53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeaa13c57c7c4edbb9fa97d405a47c63'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:33.290705 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-a2394d9c-b4b5-4c57-9da3-7d779f2bed53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeaa13c57c7c4edbb9fa97d405a47c63'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:33.291363 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-a2394d9c-b4b5-4c57-9da3-7d779f2bed53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeaa13c57c7c4edbb9fa97d405a47c63'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:33.292025 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-a2394d9c-b4b5-4c57-9da3-7d779f2bed53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeaa13c57c7c4edbb9fa97d405a47c63'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:33.317532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 988/1954] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:33 2022] DELETE /identity/v3/users/aeaa13c57c7c4edbb9fa97d405a47c63 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:33.652575 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ef2bd-7ee9-46d7-aab2-9425772c0444 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:33.654601 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-f77ef2bd-7ee9-46d7-aab2-9425772c0444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:33.669173 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ef2bd-7ee9-46d7-aab2-9425772c0444 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:33.739269 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d807bf-c620-44d5-96c2-6d3a6f504b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:33.740158 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d807bf-c620-44d5-96c2-6d3a6f504b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:33.740433 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d807bf-c620-44d5-96c2-6d3a6f504b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:33.740701 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d807bf-c620-44d5-96c2-6d3a6f504b50 admin admin] PATH_INFO: `/v3/projects/5576c064aaf94f58a3f560c13c37cfa7` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:33.741959 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d807bf-c620-44d5-96c2-6d3a6f504b50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5576c064aaf94f58a3f560c13c37cfa7)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:33.743972 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d807bf-c620-44d5-96c2-6d3a6f504b50 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:33.796707 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-f0d807bf-c620-44d5-96c2-6d3a6f504b50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5576c064aaf94f58a3f560c13c37cfa7', 'request_id': 'req-f0d807bf-c620-44d5-96c2-6d3a6f504b50'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:33.805028 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-f0d807bf-c620-44d5-96c2-6d3a6f504b50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5576c064aaf94f58a3f560c13c37cfa7', 'request_id': 'req-f0d807bf-c620-44d5-96c2-6d3a6f504b50'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:33.811173 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-f0d807bf-c620-44d5-96c2-6d3a6f504b50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5576c064aaf94f58a3f560c13c37cfa7', 'request_id': 'req-f0d807bf-c620-44d5-96c2-6d3a6f504b50'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:33.823066 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-f0d807bf-c620-44d5-96c2-6d3a6f504b50 admin admin] The token cache is being invalidate because project 5576c064aaf94f58a3f560c13c37cfa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:33.823353 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-f0d807bf-c620-44d5-96c2-6d3a6f504b50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:33.824136 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-f0d807bf-c620-44d5-96c2-6d3a6f504b50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:33.826159 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 967/1955] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:33 2022] DELETE /identity/v3/projects/5576c064aaf94f58a3f560c13c37cfa7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:33.834172 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34122c5-7be4-47f9-9fdd-1b57d2fce88c None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:33.834698 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34122c5-7be4-47f9-9fdd-1b57d2fce88c None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:33.835068 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34122c5-7be4-47f9-9fdd-1b57d2fce88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:33.858405 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-b34122c5-7be4-47f9-9fdd-1b57d2fce88c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:33.860045 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b34122c5-7be4-47f9-9fdd-1b57d2fce88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:33.925145 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 989/1956] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:33.933760 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee297a-83db-4b26-b68d-774920b093fd None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:33.934052 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee297a-83db-4b26-b68d-774920b093fd None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:33.934326 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee297a-83db-4b26-b68d-774920b093fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:33.955779 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-0dee297a-83db-4b26-b68d-774920b093fd None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:33.957223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-0dee297a-83db-4b26-b68d-774920b093fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:33.966306 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 968/1957] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:33.970801 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34122c5-7be4-47f9-9fdd-1b57d2fce88c None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:33.981412 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34122c5-7be4-47f9-9fdd-1b57d2fce88c None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:33.987544 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9205aa-7987-4628-9fab-d833dfdbab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:33.988206 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9205aa-7987-4628-9fab-d833dfdbab75 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:33.988836 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9205aa-7987-4628-9fab-d833dfdbab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:33.989266 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9205aa-7987-4628-9fab-d833dfdbab75 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:33.989995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9205aa-7987-4628-9fab-d833dfdbab75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:48:33.990345 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9205aa-7987-4628-9fab-d833dfdbab75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:33.991995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9205aa-7987-4628-9fab-d833dfdbab75 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:34.003635 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 990/1958] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:48:34.008268 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee297a-83db-4b26-b68d-774920b093fd None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:34.018275 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee297a-83db-4b26-b68d-774920b093fd None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:34.023954 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d25d8-9269-4826-b1c9-93eaa276e164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:34.024695 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d25d8-9269-4826-b1c9-93eaa276e164 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:34.024967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d25d8-9269-4826-b1c9-93eaa276e164 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:34.025261 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d25d8-9269-4826-b1c9-93eaa276e164 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:34.025988 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d25d8-9269-4826-b1c9-93eaa276e164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:34.028003 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d25d8-9269-4826-b1c9-93eaa276e164 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:34.055954 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 969/1959] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:34 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:34.060450 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9205aa-7987-4628-9fab-d833dfdbab75 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:34.071120 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9205aa-7987-4628-9fab-d833dfdbab75 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:34.128637 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b29bd-00ac-4225-9589-bdd943ef6098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:34.129600 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b29bd-00ac-4225-9589-bdd943ef6098 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:34.129810 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b29bd-00ac-4225-9589-bdd943ef6098 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:34.130111 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b29bd-00ac-4225-9589-bdd943ef6098 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:34.130894 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b29bd-00ac-4225-9589-bdd943ef6098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:34.132919 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b29bd-00ac-4225-9589-bdd943ef6098 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:34.154983 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 991/1960] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:34 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:34.159187 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d25d8-9269-4826-b1c9-93eaa276e164 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:34.172495 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d25d8-9269-4826-b1c9-93eaa276e164 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:34.180353 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fd5cf-e7dc-467d-9b80-11c8893c29ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:34.181217 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fd5cf-e7dc-467d-9b80-11c8893c29ea admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:34.181588 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fd5cf-e7dc-467d-9b80-11c8893c29ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:34.181862 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fd5cf-e7dc-467d-9b80-11c8893c29ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:34.182603 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307fd5cf-e7dc-467d-9b80-11c8893c29ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:34.184770 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307fd5cf-e7dc-467d-9b80-11c8893c29ea admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:34.203220 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 970/1961] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:34.204010 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b29bd-00ac-4225-9589-bdd943ef6098 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:34.215945 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b29bd-00ac-4225-9589-bdd943ef6098 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:34.222194 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80b403-2372-466d-ab0d-e4cd2b1f2ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:34.223065 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80b403-2372-466d-ab0d-e4cd2b1f2ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:34.223412 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80b403-2372-466d-ab0d-e4cd2b1f2ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:34.223717 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80b403-2372-466d-ab0d-e4cd2b1f2ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:34.224478 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80b403-2372-466d-ab0d-e4cd2b1f2ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:34.226123 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80b403-2372-466d-ab0d-e4cd2b1f2ec0 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:34.236806 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 992/1962] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:48:34.241570 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fd5cf-e7dc-467d-9b80-11c8893c29ea admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:34.251881 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fd5cf-e7dc-467d-9b80-11c8893c29ea admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:34.256710 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce1a5f-ec3c-49e6-af6b-9ac08cdf51d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:34.257619 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce1a5f-ec3c-49e6-af6b-9ac08cdf51d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:34.257900 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce1a5f-ec3c-49e6-af6b-9ac08cdf51d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:34.258168 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce1a5f-ec3c-49e6-af6b-9ac08cdf51d0 admin admin] PATH_INFO: `/v3/projects/cad93e87ae2b4ea0ae3cdee73cf03889/users/933616685bb444c39e3def25adf8a136/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:34.274745 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce1a5f-ec3c-49e6-af6b-9ac08cdf51d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad93e87ae2b4ea0ae3cdee73cf03889, user_id=933616685bb444c39e3def25adf8a136, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:34.277517 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce1a5f-ec3c-49e6-af6b-9ac08cdf51d0 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:34.291843 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 971/1963] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:34 2022] PUT /identity/v3/projects/cad93e87ae2b4ea0ae3cdee73cf03889/users/933616685bb444c39e3def25adf8a136/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:34.303250 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ff7b9-d76b-4371-9d16-656cd63fbd99 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:34.303558 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ff7b9-d76b-4371-9d16-656cd63fbd99 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:34.303838 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ff7b9-d76b-4371-9d16-656cd63fbd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:34.331912 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-057ff7b9-d76b-4371-9d16-656cd63fbd99 None None] MFA Rules not processed for user `933616685bb444c39e3def25adf8a136`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:34.333236 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-057ff7b9-d76b-4371-9d16-656cd63fbd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:34.395267 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 993/1964] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:34.401871 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce1a5f-ec3c-49e6-af6b-9ac08cdf51d0 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:34.473084 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce1a5f-ec3c-49e6-af6b-9ac08cdf51d0 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:34.479094 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681bb95-bd3f-4277-ae1e-902863e20a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:34.479958 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681bb95-bd3f-4277-ae1e-902863e20a44 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:34.480357 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681bb95-bd3f-4277-ae1e-902863e20a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:34.480755 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681bb95-bd3f-4277-ae1e-902863e20a44 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:34.481568 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681bb95-bd3f-4277-ae1e-902863e20a44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:34.484080 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681bb95-bd3f-4277-ae1e-902863e20a44 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:34.514035 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 972/1965] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:34 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:34.517650 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ff7b9-d76b-4371-9d16-656cd63fbd99 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:34.529878 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ff7b9-d76b-4371-9d16-656cd63fbd99 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:34.591419 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c51184-d538-47c1-8ba2-562f36ecc9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:34.591419 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c51184-d538-47c1-8ba2-562f36ecc9d8 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:34.591419 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c51184-d538-47c1-8ba2-562f36ecc9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:34.591419 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c51184-d538-47c1-8ba2-562f36ecc9d8 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:34.591803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c51184-d538-47c1-8ba2-562f36ecc9d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:34.591803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c51184-d538-47c1-8ba2-562f36ecc9d8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:34.615170 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 994/1966] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:34 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:34.616581 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681bb95-bd3f-4277-ae1e-902863e20a44 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:34.626843 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681bb95-bd3f-4277-ae1e-902863e20a44 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:34.631720 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3c876-3c88-4ab2-aa16-39d44256190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:34.632400 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3c876-3c88-4ab2-aa16-39d44256190c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:34.632681 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3c876-3c88-4ab2-aa16-39d44256190c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:34.632959 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3c876-3c88-4ab2-aa16-39d44256190c admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:34.633704 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3c876-3c88-4ab2-aa16-39d44256190c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:34.635302 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3c876-3c88-4ab2-aa16-39d44256190c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:34.649351 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 973/1967] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:48:34.650451 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c51184-d538-47c1-8ba2-562f36ecc9d8 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:34.661087 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c51184-d538-47c1-8ba2-562f36ecc9d8 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:34.665886 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a4f9c-de66-45a2-b09c-51ce1dda4829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:34.667225 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a4f9c-de66-45a2-b09c-51ce1dda4829 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:34.667532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a4f9c-de66-45a2-b09c-51ce1dda4829 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:34.667814 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a4f9c-de66-45a2-b09c-51ce1dda4829 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:34.668567 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a4f9c-de66-45a2-b09c-51ce1dda4829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:34.670183 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a4f9c-de66-45a2-b09c-51ce1dda4829 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:34.680652 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 995/1968] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:34.684908 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3c876-3c88-4ab2-aa16-39d44256190c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:34.696115 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3c876-3c88-4ab2-aa16-39d44256190c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:34.701700 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44495f1-a61e-48d7-92a6-4ff9aa260f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:34.702909 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44495f1-a61e-48d7-92a6-4ff9aa260f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:34.702909 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44495f1-a61e-48d7-92a6-4ff9aa260f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:34.703355 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44495f1-a61e-48d7-92a6-4ff9aa260f30 admin admin] PATH_INFO: `/v3/projects/f58ca6180eb6473587a8cfd61be467db/users/77c76878fe6b4278a5ef0551e62ad006/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:34.722303 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44495f1-a61e-48d7-92a6-4ff9aa260f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f58ca6180eb6473587a8cfd61be467db, user_id=77c76878fe6b4278a5ef0551e62ad006, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:34.725466 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44495f1-a61e-48d7-92a6-4ff9aa260f30 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:34.752373 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 974/1969] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:34 2022] PUT /identity/v3/projects/f58ca6180eb6473587a8cfd61be467db/users/77c76878fe6b4278a5ef0551e62ad006/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:34.762441 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83471a2b-a536-4534-8d35-c3978e6c14a2 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:34.762767 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83471a2b-a536-4534-8d35-c3978e6c14a2 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:34.763041 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83471a2b-a536-4534-8d35-c3978e6c14a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:34.804459 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-83471a2b-a536-4534-8d35-c3978e6c14a2 None None] MFA Rules not processed for user `77c76878fe6b4278a5ef0551e62ad006`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:34.805750 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-83471a2b-a536-4534-8d35-c3978e6c14a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:34.918786 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 996/1970] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:34.923059 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44495f1-a61e-48d7-92a6-4ff9aa260f30 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:35.010165 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44495f1-a61e-48d7-92a6-4ff9aa260f30 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:35.017081 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951822c-ef14-44e9-a573-cda9fd81e2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:35.017846 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951822c-ef14-44e9-a573-cda9fd81e2bf admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:35.018124 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951822c-ef14-44e9-a573-cda9fd81e2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:35.018475 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951822c-ef14-44e9-a573-cda9fd81e2bf admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:35.019631 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951822c-ef14-44e9-a573-cda9fd81e2bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:35.022114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951822c-ef14-44e9-a573-cda9fd81e2bf admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:35.072934 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 975/1971] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:34 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:35.076990 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83471a2b-a536-4534-8d35-c3978e6c14a2 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:35.090825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83471a2b-a536-4534-8d35-c3978e6c14a2 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:35.185489 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54181d54-ff31-4ebd-9962-c337f25a47a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:35.186562 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54181d54-ff31-4ebd-9962-c337f25a47a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:35.187039 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54181d54-ff31-4ebd-9962-c337f25a47a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:35.187319 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54181d54-ff31-4ebd-9962-c337f25a47a0 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:35.188077 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54181d54-ff31-4ebd-9962-c337f25a47a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:35.190027 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54181d54-ff31-4ebd-9962-c337f25a47a0 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:35.214557 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 997/1972] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:35 2022] POST /identity/v3/users => generated 299 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:35.218638 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951822c-ef14-44e9-a573-cda9fd81e2bf admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:35.229359 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951822c-ef14-44e9-a573-cda9fd81e2bf admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:35.234548 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970b8a1-f4f9-42f8-8098-53c8f9d04337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:35.235078 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970b8a1-f4f9-42f8-8098-53c8f9d04337 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:35.235427 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970b8a1-f4f9-42f8-8098-53c8f9d04337 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:35.235801 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d970b8a1-f4f9-42f8-8098-53c8f9d04337 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:35.236618 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970b8a1-f4f9-42f8-8098-53c8f9d04337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:35.238509 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d970b8a1-f4f9-42f8-8098-53c8f9d04337 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:35.249681 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 976/1973] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:35.254059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54181d54-ff31-4ebd-9962-c337f25a47a0 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:35.264669 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54181d54-ff31-4ebd-9962-c337f25a47a0 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:35.271868 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13560032-d559-4e84-a8a1-7d6918283a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:35.272830 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13560032-d559-4e84-a8a1-7d6918283a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:35.273060 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13560032-d559-4e84-a8a1-7d6918283a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:35.273327 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13560032-d559-4e84-a8a1-7d6918283a73 admin admin] PATH_INFO: `/v3/projects/d2f97b5f9ae54176a115b14454583d7b/users/b97aecad56294da9af617165aa272057/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:35.290754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13560032-d559-4e84-a8a1-7d6918283a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f97b5f9ae54176a115b14454583d7b, user_id=b97aecad56294da9af617165aa272057, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:35.293476 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13560032-d559-4e84-a8a1-7d6918283a73 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:35.309461 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 998/1974] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:35 2022] PUT /identity/v3/projects/d2f97b5f9ae54176a115b14454583d7b/users/b97aecad56294da9af617165aa272057/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:35.313695 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970b8a1-f4f9-42f8-8098-53c8f9d04337 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:35.325503 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d970b8a1-f4f9-42f8-8098-53c8f9d04337 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:35.399957 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f89994-ab25-4060-9a7c-265ea8d07e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:35.400639 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f89994-ab25-4060-9a7c-265ea8d07e98 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:35.400918 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f89994-ab25-4060-9a7c-265ea8d07e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:35.401191 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f89994-ab25-4060-9a7c-265ea8d07e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:35.401938 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f89994-ab25-4060-9a7c-265ea8d07e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:35.403609 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f89994-ab25-4060-9a7c-265ea8d07e98 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:35.413928 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 977/1975] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:35.418454 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13560032-d559-4e84-a8a1-7d6918283a73 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:35.419326 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f89994-ab25-4060-9a7c-265ea8d07e98 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:35.421252 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-42f89994-ab25-4060-9a7c-265ea8d07e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:35.429953 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13560032-d559-4e84-a8a1-7d6918283a73 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:35.433879 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f89994-ab25-4060-9a7c-265ea8d07e98 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:35.434628 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5c1a0-ae10-4d62-a934-3ba9d0631ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:35.435887 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5c1a0-ae10-4d62-a934-3ba9d0631ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:35.436221 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5c1a0-ae10-4d62-a934-3ba9d0631ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:35.436635 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5c1a0-ae10-4d62-a934-3ba9d0631ffc admin admin] PATH_INFO: `/v3/projects/d2f97b5f9ae54176a115b14454583d7b/users/b97aecad56294da9af617165aa272057/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:35.438609 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5c1a0-ae10-4d62-a934-3ba9d0631ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f97b5f9ae54176a115b14454583d7b, user_id=b97aecad56294da9af617165aa272057, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:35.438775 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc47d0-5882-400e-bad4-ffc41bcfbff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:35.439689 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc47d0-5882-400e-bad4-ffc41bcfbff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:35.439966 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc47d0-5882-400e-bad4-ffc41bcfbff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:35.440234 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc47d0-5882-400e-bad4-ffc41bcfbff5 admin admin] PATH_INFO: `/v3/users/f219b67d940642f297aa07d86b33e013` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:35.441360 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5c1a0-ae10-4d62-a934-3ba9d0631ffc admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:35.442200 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc47d0-5882-400e-bad4-ffc41bcfbff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f219b67d940642f297aa07d86b33e013)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:35.444200 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc47d0-5882-400e-bad4-ffc41bcfbff5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:35.452043 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 999/1976] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:35 2022] PUT /identity/v3/projects/d2f97b5f9ae54176a115b14454583d7b/users/b97aecad56294da9af617165aa272057/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:35.464136 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3dfd4-16c6-4e7f-aa87-488fbb063659 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:35.464428 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3dfd4-16c6-4e7f-aa87-488fbb063659 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:35.464704 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3dfd4-16c6-4e7f-aa87-488fbb063659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:35.492144 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d4cc47d0-5882-400e-bad4-ffc41bcfbff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f219b67d940642f297aa07d86b33e013'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:35.494179 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d4cc47d0-5882-400e-bad4-ffc41bcfbff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f219b67d940642f297aa07d86b33e013'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:35.494179 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d4cc47d0-5882-400e-bad4-ffc41bcfbff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f219b67d940642f297aa07d86b33e013'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:35.496911 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-10d3dfd4-16c6-4e7f-aa87-488fbb063659 None None] MFA Rules not processed for user `b97aecad56294da9af617165aa272057`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:35.498152 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-10d3dfd4-16c6-4e7f-aa87-488fbb063659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:35.511641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d4cc47d0-5882-400e-bad4-ffc41bcfbff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f219b67d940642f297aa07d86b33e013'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:35.518378 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d4cc47d0-5882-400e-bad4-ffc41bcfbff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f219b67d940642f297aa07d86b33e013'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:35.533608 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 978/1977] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:35 2022] DELETE /identity/v3/users/f219b67d940642f297aa07d86b33e013 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:35.539285 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce23d97-1b47-43ed-89b3-340c5523c5e4 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:35.539743 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce23d97-1b47-43ed-89b3-340c5523c5e4 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:35.540022 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce23d97-1b47-43ed-89b3-340c5523c5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:35.558478 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-cce23d97-1b47-43ed-89b3-340c5523c5e4 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:35.559835 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-cce23d97-1b47-43ed-89b3-340c5523c5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:35.569687 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1000/1978] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:35.580014 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3dfd4-16c6-4e7f-aa87-488fbb063659 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:35.581473 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-10d3dfd4-16c6-4e7f-aa87-488fbb063659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:35.627204 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 979/1979] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:35.635551 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3dfd4-16c6-4e7f-aa87-488fbb063659 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:35.637195 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce23d97-1b47-43ed-89b3-340c5523c5e4 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:35.638606 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-cce23d97-1b47-43ed-89b3-340c5523c5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:35.682871 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9400e-3841-4ba8-bb30-e3443449e139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:35.683540 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9400e-3841-4ba8-bb30-e3443449e139 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:35.683846 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9400e-3841-4ba8-bb30-e3443449e139 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:35.684100 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9400e-3841-4ba8-bb30-e3443449e139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:35.695220 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce23d97-1b47-43ed-89b3-340c5523c5e4 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:35.699052 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94691e-51db-4c5f-94fa-117d34b2a372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:35.699728 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94691e-51db-4c5f-94fa-117d34b2a372 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:35.700005 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94691e-51db-4c5f-94fa-117d34b2a372 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:35.700268 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94691e-51db-4c5f-94fa-117d34b2a372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:35.709451 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94691e-51db-4c5f-94fa-117d34b2a372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:35.710891 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94691e-51db-4c5f-94fa-117d34b2a372 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:35.720038 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 980/1980] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:48:35.742837 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9400e-3841-4ba8-bb30-e3443449e139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:35.744336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9400e-3841-4ba8-bb30-e3443449e139 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:35.754706 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1001/1981] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:48:36.000862 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94691e-51db-4c5f-94fa-117d34b2a372 service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:36.002728 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-da94691e-51db-4c5f-94fa-117d34b2a372 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:36.018678 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94691e-51db-4c5f-94fa-117d34b2a372 service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:36.025947 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425e495-9b73-4b29-ba60-d4f644dc7166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:36.027133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425e495-9b73-4b29-ba60-d4f644dc7166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:36.027436 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425e495-9b73-4b29-ba60-d4f644dc7166 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:36.027801 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425e495-9b73-4b29-ba60-d4f644dc7166 admin admin] PATH_INFO: `/v3/projects/a94a9dd330e541f7a4b43d51e5bfffe1` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:36.029502 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425e495-9b73-4b29-ba60-d4f644dc7166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a94a9dd330e541f7a4b43d51e5bfffe1)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:36.031509 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425e495-9b73-4b29-ba60-d4f644dc7166 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:36.093064 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4425e495-9b73-4b29-ba60-d4f644dc7166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a94a9dd330e541f7a4b43d51e5bfffe1', 'request_id': 'req-4425e495-9b73-4b29-ba60-d4f644dc7166'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:36.101412 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4425e495-9b73-4b29-ba60-d4f644dc7166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a94a9dd330e541f7a4b43d51e5bfffe1', 'request_id': 'req-4425e495-9b73-4b29-ba60-d4f644dc7166'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:36.108242 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4425e495-9b73-4b29-ba60-d4f644dc7166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a94a9dd330e541f7a4b43d51e5bfffe1', 'request_id': 'req-4425e495-9b73-4b29-ba60-d4f644dc7166'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:36.120350 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4425e495-9b73-4b29-ba60-d4f644dc7166 admin admin] The token cache is being invalidate because project a94a9dd330e541f7a4b43d51e5bfffe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:36.120886 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4425e495-9b73-4b29-ba60-d4f644dc7166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:36.121667 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4425e495-9b73-4b29-ba60-d4f644dc7166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:36.123419 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 981/1982] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:35 2022] DELETE /identity/v3/projects/a94a9dd330e541f7a4b43d51e5bfffe1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:36.130422 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123ac0d-fb3a-4cdd-9c17-7f7a154d9708 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:36.130709 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123ac0d-fb3a-4cdd-9c17-7f7a154d9708 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:36.130989 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123ac0d-fb3a-4cdd-9c17-7f7a154d9708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:36.157446 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-5123ac0d-fb3a-4cdd-9c17-7f7a154d9708 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:36.158643 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-5123ac0d-fb3a-4cdd-9c17-7f7a154d9708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:36.259029 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1002/1983] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:36.270295 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f7c6c-4af8-4798-9762-143b79c7e97f None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:36.270565 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f7c6c-4af8-4798-9762-143b79c7e97f None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:36.270890 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f7c6c-4af8-4798-9762-143b79c7e97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:36.275874 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123ac0d-fb3a-4cdd-9c17-7f7a154d9708 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:36.281081 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-5123ac0d-fb3a-4cdd-9c17-7f7a154d9708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:36.305798 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123ac0d-fb3a-4cdd-9c17-7f7a154d9708 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:36.312151 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538431e-aec5-4b7a-89da-ba2057f71384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:36.313022 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-506f7c6c-4af8-4798-9762-143b79c7e97f None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:36.313409 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538431e-aec5-4b7a-89da-ba2057f71384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:36.313830 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538431e-aec5-4b7a-89da-ba2057f71384 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:36.314307 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-506f7c6c-4af8-4798-9762-143b79c7e97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:36.314601 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538431e-aec5-4b7a-89da-ba2057f71384 admin admin] PATH_INFO: `/v3/users/ebff39f961ca4b70ae050b03e2325507` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:36.316997 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538431e-aec5-4b7a-89da-ba2057f71384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebff39f961ca4b70ae050b03e2325507)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:36.319163 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538431e-aec5-4b7a-89da-ba2057f71384 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:36.331470 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 982/1984] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:36.336366 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f7c6c-4af8-4798-9762-143b79c7e97f None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:36.352996 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f7c6c-4af8-4798-9762-143b79c7e97f None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:36.386180 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91771581-45a3-4865-893c-fb5dca4f8134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:36.387033 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91771581-45a3-4865-893c-fb5dca4f8134 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:36.387465 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91771581-45a3-4865-893c-fb5dca4f8134 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:36.387785 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91771581-45a3-4865-893c-fb5dca4f8134 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:36.388664 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91771581-45a3-4865-893c-fb5dca4f8134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:48:36.389118 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91771581-45a3-4865-893c-fb5dca4f8134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:36.389231 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5538431e-aec5-4b7a-89da-ba2057f71384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebff39f961ca4b70ae050b03e2325507'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:36.390799 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91771581-45a3-4865-893c-fb5dca4f8134 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:36.396379 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5538431e-aec5-4b7a-89da-ba2057f71384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebff39f961ca4b70ae050b03e2325507'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:36.407201 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 983/1985] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:48:36.407201 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91771581-45a3-4865-893c-fb5dca4f8134 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:36.407201 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-91771581-45a3-4865-893c-fb5dca4f8134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:36.408407 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5538431e-aec5-4b7a-89da-ba2057f71384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebff39f961ca4b70ae050b03e2325507'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:36.409012 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5538431e-aec5-4b7a-89da-ba2057f71384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebff39f961ca4b70ae050b03e2325507'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:36.409610 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5538431e-aec5-4b7a-89da-ba2057f71384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebff39f961ca4b70ae050b03e2325507'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:36.431708 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1003/1986] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:36 2022] DELETE /identity/v3/users/ebff39f961ca4b70ae050b03e2325507 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:36.432497 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538431e-aec5-4b7a-89da-ba2057f71384 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:36.433900 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-5538431e-aec5-4b7a-89da-ba2057f71384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:36.467365 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91771581-45a3-4865-893c-fb5dca4f8134 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:36.498296 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538431e-aec5-4b7a-89da-ba2057f71384 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:36.503165 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ae4df-2e83-422f-b9fe-7b0d56e47de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:36.504021 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ae4df-2e83-422f-b9fe-7b0d56e47de4 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:36.504437 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ae4df-2e83-422f-b9fe-7b0d56e47de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:36.504721 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ae4df-2e83-422f-b9fe-7b0d56e47de4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:36.505434 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ae4df-2e83-422f-b9fe-7b0d56e47de4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:36.507365 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ae4df-2e83-422f-b9fe-7b0d56e47de4 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:36.527177 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ae05a-85e0-4492-8055-13026d1551f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:36.528245 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ae05a-85e0-4492-8055-13026d1551f6 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:36.528529 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ae05a-85e0-4492-8055-13026d1551f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:36.528801 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ae05a-85e0-4492-8055-13026d1551f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:36.530722 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-109ae05a-85e0-4492-8055-13026d1551f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:36.534965 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1004/1987] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:36 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:36.536355 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c758f6-9233-4aa5-a63c-0b08c250f59a None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:36.536727 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c758f6-9233-4aa5-a63c-0b08c250f59a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:36.537012 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c758f6-9233-4aa5-a63c-0b08c250f59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:36.555628 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-34c758f6-9233-4aa5-a63c-0b08c250f59a None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:36.556840 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-34c758f6-9233-4aa5-a63c-0b08c250f59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:36.601487 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ae05a-85e0-4492-8055-13026d1551f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:36.603182 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ae05a-85e0-4492-8055-13026d1551f6 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:36.612615 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 984/1988] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:36.617185 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ae05a-85e0-4492-8055-13026d1551f6 service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:36.619900 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1005/1989] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:36.630142 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c758f6-9233-4aa5-a63c-0b08c250f59a None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:36.631532 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ae05a-85e0-4492-8055-13026d1551f6 service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:36.632075 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-34c758f6-9233-4aa5-a63c-0b08c250f59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:36.638795 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380c7a2-ed18-483e-b86f-3bcc0be8e8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:36.639298 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380c7a2-ed18-483e-b86f-3bcc0be8e8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:36.639649 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380c7a2-ed18-483e-b86f-3bcc0be8e8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:36.639994 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380c7a2-ed18-483e-b86f-3bcc0be8e8c6 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:36.640952 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380c7a2-ed18-483e-b86f-3bcc0be8e8c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:36.643546 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380c7a2-ed18-483e-b86f-3bcc0be8e8c6 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:36.666650 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 985/1990] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:36 2022] POST /identity/v3/users => generated 286 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:36.671956 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380c7a2-ed18-483e-b86f-3bcc0be8e8c6 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:36.682067 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380c7a2-ed18-483e-b86f-3bcc0be8e8c6 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:36.687599 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ee672-cac4-4d1c-a9b3-0ed07a70a341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:36.688477 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ee672-cac4-4d1c-a9b3-0ed07a70a341 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:36.688833 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ee672-cac4-4d1c-a9b3-0ed07a70a341 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:36.689205 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ee672-cac4-4d1c-a9b3-0ed07a70a341 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:36.690112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ee672-cac4-4d1c-a9b3-0ed07a70a341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:36.691913 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ee672-cac4-4d1c-a9b3-0ed07a70a341 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:36.696717 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c758f6-9233-4aa5-a63c-0b08c250f59a None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:36.700621 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14316d2-ff37-4297-9632-ad0c700c3562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:36.701380 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14316d2-ff37-4297-9632-ad0c700c3562 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:36.701731 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14316d2-ff37-4297-9632-ad0c700c3562 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:36.702513 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14316d2-ff37-4297-9632-ad0c700c3562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:36.702626 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 986/1991] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:48:36.706662 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ee672-cac4-4d1c-a9b3-0ed07a70a341 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:36.712094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14316d2-ff37-4297-9632-ad0c700c3562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:36.713555 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14316d2-ff37-4297-9632-ad0c700c3562 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:36.716967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ee672-cac4-4d1c-a9b3-0ed07a70a341 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:36.722172 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98701fa1-80e9-4710-a41f-6a8aeb7ef5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:36.722970 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98701fa1-80e9-4710-a41f-6a8aeb7ef5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:36.723209 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98701fa1-80e9-4710-a41f-6a8aeb7ef5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:36.723684 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98701fa1-80e9-4710-a41f-6a8aeb7ef5b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:36.724308 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1006/1992] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:48:36.724749 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98701fa1-80e9-4710-a41f-6a8aeb7ef5b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:36.726582 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98701fa1-80e9-4710-a41f-6a8aeb7ef5b8 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:36.743080 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 987/1993] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:36.746125 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14316d2-ff37-4297-9632-ad0c700c3562 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:36.757256 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14316d2-ff37-4297-9632-ad0c700c3562 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:36.763137 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb9a21-84e1-4a8f-828e-cba0ec297afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:36.764200 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb9a21-84e1-4a8f-828e-cba0ec297afc admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:36.764504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb9a21-84e1-4a8f-828e-cba0ec297afc admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:36.764677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb9a21-84e1-4a8f-828e-cba0ec297afc admin admin] PATH_INFO: `/v3/projects/9c74d48e1e934088addee3d78ddbe485/users/154d8ba69dce42fe85ae3a0ad7602bb2/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:36.783682 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb9a21-84e1-4a8f-828e-cba0ec297afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c74d48e1e934088addee3d78ddbe485, user_id=154d8ba69dce42fe85ae3a0ad7602bb2, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:36.786869 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb9a21-84e1-4a8f-828e-cba0ec297afc admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:36.800650 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1007/1994] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:36 2022] PUT /identity/v3/projects/9c74d48e1e934088addee3d78ddbe485/users/154d8ba69dce42fe85ae3a0ad7602bb2/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:36.805831 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf0e1a-08a7-4ea4-bc1e-bf05ee09d702 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:36.806188 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf0e1a-08a7-4ea4-bc1e-bf05ee09d702 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:36.806463 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf0e1a-08a7-4ea4-bc1e-bf05ee09d702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:36.828372 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-2ddf0e1a-08a7-4ea4-bc1e-bf05ee09d702 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:36.829706 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-2ddf0e1a-08a7-4ea4-bc1e-bf05ee09d702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:36.909681 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 988/1995] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:36.929206 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb9a21-84e1-4a8f-828e-cba0ec297afc admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:36.931359 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-6bcb9a21-84e1-4a8f-828e-cba0ec297afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:36.999941 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb9a21-84e1-4a8f-828e-cba0ec297afc admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:37.003672 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62794a95-24db-4ca6-9b77-cd2d16e8a188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:37.004359 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62794a95-24db-4ca6-9b77-cd2d16e8a188 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:37.004640 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62794a95-24db-4ca6-9b77-cd2d16e8a188 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:37.004929 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62794a95-24db-4ca6-9b77-cd2d16e8a188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:37.014950 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62794a95-24db-4ca6-9b77-cd2d16e8a188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:37.016594 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62794a95-24db-4ca6-9b77-cd2d16e8a188 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:37.028160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1008/1996] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:37.093431 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf0e1a-08a7-4ea4-bc1e-bf05ee09d702 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:37.095026 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-2ddf0e1a-08a7-4ea4-bc1e-bf05ee09d702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:37.108279 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf0e1a-08a7-4ea4-bc1e-bf05ee09d702 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:37.114589 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec07f87-5db4-4ba3-88be-1c776ed1815d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:37.116042 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec07f87-5db4-4ba3-88be-1c776ed1815d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:37.116042 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec07f87-5db4-4ba3-88be-1c776ed1815d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:37.116312 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec07f87-5db4-4ba3-88be-1c776ed1815d admin admin] PATH_INFO: `/v3/projects/f944382a80b04e22b2fc42c83e08abf6` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:37.117671 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec07f87-5db4-4ba3-88be-1c776ed1815d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f944382a80b04e22b2fc42c83e08abf6)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:37.119634 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec07f87-5db4-4ba3-88be-1c776ed1815d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:37.184317 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3ec07f87-5db4-4ba3-88be-1c776ed1815d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f944382a80b04e22b2fc42c83e08abf6', 'request_id': 'req-3ec07f87-5db4-4ba3-88be-1c776ed1815d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:37.193834 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3ec07f87-5db4-4ba3-88be-1c776ed1815d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f944382a80b04e22b2fc42c83e08abf6', 'request_id': 'req-3ec07f87-5db4-4ba3-88be-1c776ed1815d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:37.201427 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3ec07f87-5db4-4ba3-88be-1c776ed1815d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f944382a80b04e22b2fc42c83e08abf6', 'request_id': 'req-3ec07f87-5db4-4ba3-88be-1c776ed1815d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:37.213224 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3ec07f87-5db4-4ba3-88be-1c776ed1815d admin admin] The token cache is being invalidate because project f944382a80b04e22b2fc42c83e08abf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:37.213580 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3ec07f87-5db4-4ba3-88be-1c776ed1815d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:37.214320 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3ec07f87-5db4-4ba3-88be-1c776ed1815d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:37.216187 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 989/1997] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:37 2022] DELETE /identity/v3/projects/f944382a80b04e22b2fc42c83e08abf6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:37.222097 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bfb3f-fa5d-49c2-988e-a6ab367b432d None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:37.222381 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bfb3f-fa5d-49c2-988e-a6ab367b432d None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:37.223196 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bfb3f-fa5d-49c2-988e-a6ab367b432d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:37.245003 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-572bfb3f-fa5d-49c2-988e-a6ab367b432d None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:37.246282 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-572bfb3f-fa5d-49c2-988e-a6ab367b432d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:37.307413 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1009/1998] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:37.316906 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f30f8-92fd-4b14-a6e8-54c66601c6b8 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:37.317078 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f30f8-92fd-4b14-a6e8-54c66601c6b8 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:37.317323 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f30f8-92fd-4b14-a6e8-54c66601c6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:37.336357 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-d86f30f8-92fd-4b14-a6e8-54c66601c6b8 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:37.337570 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-d86f30f8-92fd-4b14-a6e8-54c66601c6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:37.345586 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 990/1999] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:37.350146 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bfb3f-fa5d-49c2-988e-a6ab367b432d None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:37.360028 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bfb3f-fa5d-49c2-988e-a6ab367b432d None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:37.365266 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65874908-5beb-4d0b-b069-b6b5084ad154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:37.366008 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65874908-5beb-4d0b-b069-b6b5084ad154 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:37.366263 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65874908-5beb-4d0b-b069-b6b5084ad154 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:37.366538 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65874908-5beb-4d0b-b069-b6b5084ad154 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:37.367287 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65874908-5beb-4d0b-b069-b6b5084ad154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:48:37.367612 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65874908-5beb-4d0b-b069-b6b5084ad154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:37.369261 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65874908-5beb-4d0b-b069-b6b5084ad154 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:37.385608 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1010/2000] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:48:37.387103 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f30f8-92fd-4b14-a6e8-54c66601c6b8 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:37.402989 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f30f8-92fd-4b14-a6e8-54c66601c6b8 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:37.414252 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ba46c-82c6-48b4-8d68-5c00b4bce5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:37.414940 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ba46c-82c6-48b4-8d68-5c00b4bce5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:37.415251 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ba46c-82c6-48b4-8d68-5c00b4bce5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:37.418364 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ba46c-82c6-48b4-8d68-5c00b4bce5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:37.419127 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ba46c-82c6-48b4-8d68-5c00b4bce5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:37.421790 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ba46c-82c6-48b4-8d68-5c00b4bce5a8 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:37.471563 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 991/2001] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:37 2022] POST /identity/v3/projects => generated 379 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:48:37.474039 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65874908-5beb-4d0b-b069-b6b5084ad154 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:37.485580 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65874908-5beb-4d0b-b069-b6b5084ad154 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:37.550664 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d12f1-457b-477d-bc02-6bcb33f1080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:37.551582 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d12f1-457b-477d-bc02-6bcb33f1080b admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:37.551867 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d12f1-457b-477d-bc02-6bcb33f1080b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:37.552160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d12f1-457b-477d-bc02-6bcb33f1080b admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:37.552883 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d12f1-457b-477d-bc02-6bcb33f1080b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:37.554859 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d12f1-457b-477d-bc02-6bcb33f1080b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:37.581550 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1011/2002] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:37 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:48:37.587197 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ba46c-82c6-48b4-8d68-5c00b4bce5a8 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:37.597992 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ba46c-82c6-48b4-8d68-5c00b4bce5a8 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:37.603144 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f81051-f28c-4001-acc9-104a957cd305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:37.603876 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f81051-f28c-4001-acc9-104a957cd305 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:37.604149 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f81051-f28c-4001-acc9-104a957cd305 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:37.604439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f81051-f28c-4001-acc9-104a957cd305 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:37.605306 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f81051-f28c-4001-acc9-104a957cd305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:37.606910 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f81051-f28c-4001-acc9-104a957cd305 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:37.631188 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 992/2003] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:37.632393 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d12f1-457b-477d-bc02-6bcb33f1080b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:37.642634 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d12f1-457b-477d-bc02-6bcb33f1080b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:37.649279 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfec98d-b4b7-4d22-a92d-a8da26887f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:37.650004 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfec98d-b4b7-4d22-a92d-a8da26887f50 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:37.650247 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfec98d-b4b7-4d22-a92d-a8da26887f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:37.650517 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfec98d-b4b7-4d22-a92d-a8da26887f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:37.651258 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfec98d-b4b7-4d22-a92d-a8da26887f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:37.652932 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfec98d-b4b7-4d22-a92d-a8da26887f50 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:37.664959 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1012/2004] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:37.673359 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f81051-f28c-4001-acc9-104a957cd305 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:37.688706 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f81051-f28c-4001-acc9-104a957cd305 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:37.696535 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889f83b-5148-45b1-958c-f61641affb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:37.697919 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889f83b-5148-45b1-958c-f61641affb07 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:37.698436 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889f83b-5148-45b1-958c-f61641affb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:37.698904 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889f83b-5148-45b1-958c-f61641affb07 admin admin] PATH_INFO: `/v3/projects/116ba1acf9b243448eb63b5d7a9f8eb4/users/d096cb29d5cf4cbc99f619258f198bbd/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:37.719711 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889f83b-5148-45b1-958c-f61641affb07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=116ba1acf9b243448eb63b5d7a9f8eb4, user_id=d096cb29d5cf4cbc99f619258f198bbd, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:37.723467 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889f83b-5148-45b1-958c-f61641affb07 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:37.749012 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ed044-3e52-4424-8864-b046beaf3d9d None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:37.749509 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ed044-3e52-4424-8864-b046beaf3d9d None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:37.749734 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 993/2005] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:37 2022] PUT /identity/v3/projects/116ba1acf9b243448eb63b5d7a9f8eb4/users/d096cb29d5cf4cbc99f619258f198bbd/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:37.750212 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ed044-3e52-4424-8864-b046beaf3d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:37.764710 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88277102-7f07-427d-a34b-9bac014c815c None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:37.765012 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88277102-7f07-427d-a34b-9bac014c815c None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:37.765266 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88277102-7f07-427d-a34b-9bac014c815c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:37.781609 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-dc7ed044-3e52-4424-8864-b046beaf3d9d None None] MFA Rules not processed for user `154d8ba69dce42fe85ae3a0ad7602bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:37.783193 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-dc7ed044-3e52-4424-8864-b046beaf3d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:37.794914 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-88277102-7f07-427d-a34b-9bac014c815c None None] MFA Rules not processed for user `d096cb29d5cf4cbc99f619258f198bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:37.796280 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-88277102-7f07-427d-a34b-9bac014c815c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:37.874385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1013/2006] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:37.875250 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 994/2007] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:37.882504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ed044-3e52-4424-8864-b046beaf3d9d None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:37.895332 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88277102-7f07-427d-a34b-9bac014c815c None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:37.898794 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-88277102-7f07-427d-a34b-9bac014c815c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:37.974445 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ed044-3e52-4424-8864-b046beaf3d9d None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:37.980577 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e30832-a0f1-41e0-95d5-4f90991ebd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:37.981355 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e30832-a0f1-41e0-95d5-4f90991ebd35 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:37.982769 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e30832-a0f1-41e0-95d5-4f90991ebd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:37.983880 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e30832-a0f1-41e0-95d5-4f90991ebd35 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:37.985324 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e30832-a0f1-41e0-95d5-4f90991ebd35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:37.987095 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88277102-7f07-427d-a34b-9bac014c815c None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:37.987431 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e30832-a0f1-41e0-95d5-4f90991ebd35 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:37.994093 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fb085-69ec-42df-bfb6-93efde67cee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:37.994928 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fb085-69ec-42df-bfb6-93efde67cee2 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:37.995322 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fb085-69ec-42df-bfb6-93efde67cee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:37.995646 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fb085-69ec-42df-bfb6-93efde67cee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:38.005776 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fb085-69ec-42df-bfb6-93efde67cee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:38.007213 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fb085-69ec-42df-bfb6-93efde67cee2 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:38.020467 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 995/2008] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:38.038289 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1014/2009] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:37 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:38.042384 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fb085-69ec-42df-bfb6-93efde67cee2 service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:38.053839 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fb085-69ec-42df-bfb6-93efde67cee2 service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:38.131021 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccd49a-0ee0-462f-ac94-c3e406096fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:38.132776 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccd49a-0ee0-462f-ac94-c3e406096fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:38.133307 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccd49a-0ee0-462f-ac94-c3e406096fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:38.133773 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccd49a-0ee0-462f-ac94-c3e406096fc4 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:38.134695 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccd49a-0ee0-462f-ac94-c3e406096fc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:38.136924 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccd49a-0ee0-462f-ac94-c3e406096fc4 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:38.167280 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 996/2010] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:38 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:48:38.171376 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e30832-a0f1-41e0-95d5-4f90991ebd35 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:38.184494 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e30832-a0f1-41e0-95d5-4f90991ebd35 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:38.207460 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a0ad1-8dd8-4312-8330-0f845adeb5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:38.208916 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a0ad1-8dd8-4312-8330-0f845adeb5cd admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:38.209176 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a0ad1-8dd8-4312-8330-0f845adeb5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:38.209449 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a0ad1-8dd8-4312-8330-0f845adeb5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:38.210335 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a0ad1-8dd8-4312-8330-0f845adeb5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:38.212224 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a0ad1-8dd8-4312-8330-0f845adeb5cd admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:38.225194 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1015/2011] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:48:38.229152 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccd49a-0ee0-462f-ac94-c3e406096fc4 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:38.240724 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccd49a-0ee0-462f-ac94-c3e406096fc4 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:38.245926 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1053e7-e56e-4739-b49a-a9d2a9ade212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:38.246618 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1053e7-e56e-4739-b49a-a9d2a9ade212 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:38.246896 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1053e7-e56e-4739-b49a-a9d2a9ade212 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:38.247161 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1053e7-e56e-4739-b49a-a9d2a9ade212 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:38.248267 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1053e7-e56e-4739-b49a-a9d2a9ade212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:38.249873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1053e7-e56e-4739-b49a-a9d2a9ade212 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:38.265398 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 997/2012] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:38.266312 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a0ad1-8dd8-4312-8330-0f845adeb5cd admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:38.283906 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a0ad1-8dd8-4312-8330-0f845adeb5cd admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:38.291125 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e93915-bc38-4b31-8e96-306e96e4d93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:38.292893 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e93915-bc38-4b31-8e96-306e96e4d93e admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:38.293293 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e93915-bc38-4b31-8e96-306e96e4d93e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:38.293789 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e93915-bc38-4b31-8e96-306e96e4d93e admin admin] PATH_INFO: `/v3/projects/276ae7c965f141a08cc55a37f52dee54/users/71bab49fc60e4540bb868e3061eb72f9/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:38.315389 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e93915-bc38-4b31-8e96-306e96e4d93e admin admin] RBAC: Authorizing `identity:create_grant(project_id=276ae7c965f141a08cc55a37f52dee54, user_id=71bab49fc60e4540bb868e3061eb72f9, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:38.319470 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e93915-bc38-4b31-8e96-306e96e4d93e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:38.345578 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1016/2013] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:38 2022] PUT /identity/v3/projects/276ae7c965f141a08cc55a37f52dee54/users/71bab49fc60e4540bb868e3061eb72f9/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:38.356924 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f097d2-29eb-4d27-bf08-b4882cb3831d None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:38.357860 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f097d2-29eb-4d27-bf08-b4882cb3831d None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:38.357860 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f097d2-29eb-4d27-bf08-b4882cb3831d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:38.400117 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-51f097d2-29eb-4d27-bf08-b4882cb3831d None None] MFA Rules not processed for user `71bab49fc60e4540bb868e3061eb72f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:38.401439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-51f097d2-29eb-4d27-bf08-b4882cb3831d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:38.487336 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 998/2014] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:38.488467 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e93915-bc38-4b31-8e96-306e96e4d93e admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:38.551391 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e93915-bc38-4b31-8e96-306e96e4d93e admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:38.556486 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3e99c-883e-4dbb-ae8e-808b2cdc0112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:38.557150 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3e99c-883e-4dbb-ae8e-808b2cdc0112 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:38.557419 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3e99c-883e-4dbb-ae8e-808b2cdc0112 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:38.558132 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3e99c-883e-4dbb-ae8e-808b2cdc0112 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:38.558405 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3e99c-883e-4dbb-ae8e-808b2cdc0112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:38.560352 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3e99c-883e-4dbb-ae8e-808b2cdc0112 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:38.591560 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1017/2015] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:38 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:48:38.594605 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f097d2-29eb-4d27-bf08-b4882cb3831d None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:38.610424 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f097d2-29eb-4d27-bf08-b4882cb3831d None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:38.676108 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51b04f-05bd-4aae-9fb4-529ad1f7b1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:38.676885 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51b04f-05bd-4aae-9fb4-529ad1f7b1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:38.677168 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51b04f-05bd-4aae-9fb4-529ad1f7b1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:38.677443 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51b04f-05bd-4aae-9fb4-529ad1f7b1b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:38.678159 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51b04f-05bd-4aae-9fb4-529ad1f7b1b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:38.680125 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51b04f-05bd-4aae-9fb4-529ad1f7b1b0 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:38.701615 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 999/2016] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:38 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:38.705554 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3e99c-883e-4dbb-ae8e-808b2cdc0112 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:38.727156 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3e99c-883e-4dbb-ae8e-808b2cdc0112 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:38.733580 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bf1e3-5fba-4b7f-82bd-7f5fd2a6922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:38.734790 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bf1e3-5fba-4b7f-82bd-7f5fd2a6922c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:38.735303 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bf1e3-5fba-4b7f-82bd-7f5fd2a6922c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:38.735752 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bf1e3-5fba-4b7f-82bd-7f5fd2a6922c admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:38.737879 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bf1e3-5fba-4b7f-82bd-7f5fd2a6922c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:38.747534 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bf1e3-5fba-4b7f-82bd-7f5fd2a6922c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:38.762088 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1018/2017] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:38.767012 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51b04f-05bd-4aae-9fb4-529ad1f7b1b0 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:38.778643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51b04f-05bd-4aae-9fb4-529ad1f7b1b0 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:38.783954 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b3248-e870-4435-9584-ce67a62fc8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:38.784855 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b3248-e870-4435-9584-ce67a62fc8ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:38.785309 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b3248-e870-4435-9584-ce67a62fc8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:38.785575 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b3248-e870-4435-9584-ce67a62fc8ee admin admin] PATH_INFO: `/v3/projects/d5d9d7d268a84d41a4ae8da3e0eb71e3/users/23344b405d5b4ed0a9a5d05dd9bf81cf/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:38.802404 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b3248-e870-4435-9584-ce67a62fc8ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d9d7d268a84d41a4ae8da3e0eb71e3, user_id=23344b405d5b4ed0a9a5d05dd9bf81cf, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:38.805138 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b3248-e870-4435-9584-ce67a62fc8ee admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:38.820556 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1000/2018] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:38 2022] PUT /identity/v3/projects/d5d9d7d268a84d41a4ae8da3e0eb71e3/users/23344b405d5b4ed0a9a5d05dd9bf81cf/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:38.824366 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bf1e3-5fba-4b7f-82bd-7f5fd2a6922c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:38.843253 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bf1e3-5fba-4b7f-82bd-7f5fd2a6922c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:38.928152 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c62991-ac4d-4edc-a930-a87acf07693c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:38.928842 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c62991-ac4d-4edc-a930-a87acf07693c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:38.929116 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c62991-ac4d-4edc-a930-a87acf07693c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:38.929388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c62991-ac4d-4edc-a930-a87acf07693c admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:38.930125 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c62991-ac4d-4edc-a930-a87acf07693c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:38.931797 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c62991-ac4d-4edc-a930-a87acf07693c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:38.943634 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1019/2019] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:38.948015 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b3248-e870-4435-9584-ce67a62fc8ee admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:38.960621 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b3248-e870-4435-9584-ce67a62fc8ee admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:38.968220 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f72f9-8131-40da-b7bb-4c423d2acb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:38.969199 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f72f9-8131-40da-b7bb-4c423d2acb6e admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:38.969549 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f72f9-8131-40da-b7bb-4c423d2acb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:38.969896 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f72f9-8131-40da-b7bb-4c423d2acb6e admin admin] PATH_INFO: `/v3/projects/d5d9d7d268a84d41a4ae8da3e0eb71e3/users/23344b405d5b4ed0a9a5d05dd9bf81cf/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:38.972318 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f72f9-8131-40da-b7bb-4c423d2acb6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d9d7d268a84d41a4ae8da3e0eb71e3, user_id=23344b405d5b4ed0a9a5d05dd9bf81cf, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:38.975292 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f72f9-8131-40da-b7bb-4c423d2acb6e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:38.987856 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1001/2020] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:38 2022] PUT /identity/v3/projects/d5d9d7d268a84d41a4ae8da3e0eb71e3/users/23344b405d5b4ed0a9a5d05dd9bf81cf/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:38.999658 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9604-4fcc-4c7d-a5ac-666c168605e3 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:39.000227 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9604-4fcc-4c7d-a5ac-666c168605e3 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:39.000806 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9604-4fcc-4c7d-a5ac-666c168605e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:39.034312 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-b35b9604-4fcc-4c7d-a5ac-666c168605e3 None None] MFA Rules not processed for user `23344b405d5b4ed0a9a5d05dd9bf81cf`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:39.035774 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b35b9604-4fcc-4c7d-a5ac-666c168605e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:39.103123 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1020/2021] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:39.113720 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f72f9-8131-40da-b7bb-4c423d2acb6e admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:39.172158 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f72f9-8131-40da-b7bb-4c423d2acb6e admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:39.176103 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa114f1a-8f1f-4d6e-8281-aa4afd7ed2b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:39.176848 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa114f1a-8f1f-4d6e-8281-aa4afd7ed2b1 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:39.177184 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa114f1a-8f1f-4d6e-8281-aa4afd7ed2b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:39.177461 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa114f1a-8f1f-4d6e-8281-aa4afd7ed2b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:39.196424 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b9604-4fcc-4c7d-a5ac-666c168605e3 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:39.197877 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b35b9604-4fcc-4c7d-a5ac-666c168605e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:39.241215 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa114f1a-8f1f-4d6e-8281-aa4afd7ed2b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:39.242660 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa114f1a-8f1f-4d6e-8281-aa4afd7ed2b1 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:39.251992 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1002/2022] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:39.265871 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b9604-4fcc-4c7d-a5ac-666c168605e3 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:39.270605 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fe5ed-8c17-487a-961c-0ce7129db697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:39.271508 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fe5ed-8c17-487a-961c-0ce7129db697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:39.271835 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fe5ed-8c17-487a-961c-0ce7129db697 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:39.272104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fe5ed-8c17-487a-961c-0ce7129db697 admin admin] PATH_INFO: `/v3/users/c4e14a00e91e495888b9d1ae01ed8d44` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:39.273356 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fe5ed-8c17-487a-961c-0ce7129db697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4e14a00e91e495888b9d1ae01ed8d44)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:39.275442 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92fe5ed-8c17-487a-961c-0ce7129db697 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:39.323534 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-b92fe5ed-8c17-487a-961c-0ce7129db697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4e14a00e91e495888b9d1ae01ed8d44'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:39.330135 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-b92fe5ed-8c17-487a-961c-0ce7129db697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4e14a00e91e495888b9d1ae01ed8d44'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:39.337629 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-b92fe5ed-8c17-487a-961c-0ce7129db697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4e14a00e91e495888b9d1ae01ed8d44'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:39.338383 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-b92fe5ed-8c17-487a-961c-0ce7129db697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4e14a00e91e495888b9d1ae01ed8d44'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:39.338943 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-b92fe5ed-8c17-487a-961c-0ce7129db697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4e14a00e91e495888b9d1ae01ed8d44'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:39.356188 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1021/2023] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:39 2022] DELETE /identity/v3/users/c4e14a00e91e495888b9d1ae01ed8d44 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:39.477183 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19020bab-ace3-4ada-8af5-4d99ccb5cc8c None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:39.477472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19020bab-ace3-4ada-8af5-4d99ccb5cc8c None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:39.477799 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19020bab-ace3-4ada-8af5-4d99ccb5cc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:39.501898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-19020bab-ace3-4ada-8af5-4d99ccb5cc8c None None] MFA Rules not processed for user `154d8ba69dce42fe85ae3a0ad7602bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:39.503459 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-19020bab-ace3-4ada-8af5-4d99ccb5cc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:39.603468 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fe5ed-8c17-487a-961c-0ce7129db697 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:39.606107 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b92fe5ed-8c17-487a-961c-0ce7129db697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:39.628152 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1003/2024] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:39.706600 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92fe5ed-8c17-487a-961c-0ce7129db697 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:39.714381 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefafc0-14be-4c85-8566-a4478e94177e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:39.715607 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefafc0-14be-4c85-8566-a4478e94177e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:39.715765 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefafc0-14be-4c85-8566-a4478e94177e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:39.716206 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefafc0-14be-4c85-8566-a4478e94177e admin admin] PATH_INFO: `/v3/projects/55cf2241773145dca4016f5f0fa4c0d4` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:39.717687 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefafc0-14be-4c85-8566-a4478e94177e admin admin] RBAC: Authorizing `identity:delete_project(project_id=55cf2241773145dca4016f5f0fa4c0d4)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:39.720438 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefafc0-14be-4c85-8566-a4478e94177e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:39.811619 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5aefafc0-14be-4c85-8566-a4478e94177e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55cf2241773145dca4016f5f0fa4c0d4', 'request_id': 'req-5aefafc0-14be-4c85-8566-a4478e94177e'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:39.823896 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5aefafc0-14be-4c85-8566-a4478e94177e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55cf2241773145dca4016f5f0fa4c0d4', 'request_id': 'req-5aefafc0-14be-4c85-8566-a4478e94177e'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:39.840539 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5aefafc0-14be-4c85-8566-a4478e94177e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55cf2241773145dca4016f5f0fa4c0d4', 'request_id': 'req-5aefafc0-14be-4c85-8566-a4478e94177e'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:39.853488 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5aefafc0-14be-4c85-8566-a4478e94177e admin admin] The token cache is being invalidate because project 55cf2241773145dca4016f5f0fa4c0d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:39.853849 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5aefafc0-14be-4c85-8566-a4478e94177e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:39.857048 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5aefafc0-14be-4c85-8566-a4478e94177e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:39.858354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1022/2025] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:39 2022] DELETE /identity/v3/projects/55cf2241773145dca4016f5f0fa4c0d4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:39.865307 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19020bab-ace3-4ada-8af5-4d99ccb5cc8c None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:39.892673 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19020bab-ace3-4ada-8af5-4d99ccb5cc8c None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:39.968499 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8cd7e5-2511-4032-844b-b454019e57ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:39.969433 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cd7e5-2511-4032-844b-b454019e57ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:39.969710 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cd7e5-2511-4032-844b-b454019e57ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:39.969981 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cd7e5-2511-4032-844b-b454019e57ef admin admin] PATH_INFO: `/v3/users/fa259dce16f9454fa23791685d280657` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:39.971255 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8cd7e5-2511-4032-844b-b454019e57ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa259dce16f9454fa23791685d280657)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:39.973794 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8cd7e5-2511-4032-844b-b454019e57ef admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:40.039399 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-1a8cd7e5-2511-4032-844b-b454019e57ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa259dce16f9454fa23791685d280657'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:40.040601 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-1a8cd7e5-2511-4032-844b-b454019e57ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa259dce16f9454fa23791685d280657'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:40.041654 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-1a8cd7e5-2511-4032-844b-b454019e57ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa259dce16f9454fa23791685d280657'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:40.060433 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-1a8cd7e5-2511-4032-844b-b454019e57ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa259dce16f9454fa23791685d280657'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:40.067441 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-1a8cd7e5-2511-4032-844b-b454019e57ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa259dce16f9454fa23791685d280657'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:40.081163 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1004/2026] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:39 2022] DELETE /identity/v3/users/fa259dce16f9454fa23791685d280657 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:40.277538 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefafc0-14be-4c85-8566-a4478e94177e admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:40.279202 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-5aefafc0-14be-4c85-8566-a4478e94177e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:40.297511 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefafc0-14be-4c85-8566-a4478e94177e admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:40.394434 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45e296-de93-4a26-bf36-da5dd2f369ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:40.395914 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45e296-de93-4a26-bf36-da5dd2f369ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:40.396525 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45e296-de93-4a26-bf36-da5dd2f369ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:40.397066 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45e296-de93-4a26-bf36-da5dd2f369ad admin admin] PATH_INFO: `/v3/projects/a246d3cdf9da4131a81b87e8a13bd9c3` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:40.399433 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45e296-de93-4a26-bf36-da5dd2f369ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a246d3cdf9da4131a81b87e8a13bd9c3)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:40.401904 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45e296-de93-4a26-bf36-da5dd2f369ad admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:40.474318 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-1c45e296-de93-4a26-bf36-da5dd2f369ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a246d3cdf9da4131a81b87e8a13bd9c3', 'request_id': 'req-1c45e296-de93-4a26-bf36-da5dd2f369ad'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:40.484779 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-1c45e296-de93-4a26-bf36-da5dd2f369ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a246d3cdf9da4131a81b87e8a13bd9c3', 'request_id': 'req-1c45e296-de93-4a26-bf36-da5dd2f369ad'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:40.493646 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-1c45e296-de93-4a26-bf36-da5dd2f369ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a246d3cdf9da4131a81b87e8a13bd9c3', 'request_id': 'req-1c45e296-de93-4a26-bf36-da5dd2f369ad'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:40.506062 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-1c45e296-de93-4a26-bf36-da5dd2f369ad admin admin] The token cache is being invalidate because project a246d3cdf9da4131a81b87e8a13bd9c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:40.506602 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-1c45e296-de93-4a26-bf36-da5dd2f369ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:40.507431 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-1c45e296-de93-4a26-bf36-da5dd2f369ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:40.509305 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1023/2027] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:40 2022] DELETE /identity/v3/projects/a246d3cdf9da4131a81b87e8a13bd9c3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:40.518454 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54bd4d-793f-43ab-984e-b8077a1783dc None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:40.519422 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54bd4d-793f-43ab-984e-b8077a1783dc None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:40.519815 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54bd4d-793f-43ab-984e-b8077a1783dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:40.539747 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-fa54bd4d-793f-43ab-984e-b8077a1783dc None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:40.540952 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-fa54bd4d-793f-43ab-984e-b8077a1783dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:40.602216 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1005/2028] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:40.611104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c6ca2-9605-419f-bbec-b61734372d5e None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:40.611388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c6ca2-9605-419f-bbec-b61734372d5e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:40.611694 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c6ca2-9605-419f-bbec-b61734372d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:40.634388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-2c7c6ca2-9605-419f-bbec-b61734372d5e None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:40.635984 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-2c7c6ca2-9605-419f-bbec-b61734372d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:40.644687 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1024/2029] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:40.649127 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54bd4d-793f-43ab-984e-b8077a1783dc None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:40.658627 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54bd4d-793f-43ab-984e-b8077a1783dc None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:40.663462 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d31ab-b766-444f-979e-4ff59dbc7b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:40.664159 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d31ab-b766-444f-979e-4ff59dbc7b15 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:40.664456 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d31ab-b766-444f-979e-4ff59dbc7b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:40.664714 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d31ab-b766-444f-979e-4ff59dbc7b15 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:40.665490 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d31ab-b766-444f-979e-4ff59dbc7b15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:48:40.665899 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d31ab-b766-444f-979e-4ff59dbc7b15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:40.667404 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d31ab-b766-444f-979e-4ff59dbc7b15 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:40.679722 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1006/2030] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:48:40.683991 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c6ca2-9605-419f-bbec-b61734372d5e None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:40.694240 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c6ca2-9605-419f-bbec-b61734372d5e None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:40.699218 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b526443-e11a-42de-8267-94b624323326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:40.700006 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b526443-e11a-42de-8267-94b624323326 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:40.700408 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b526443-e11a-42de-8267-94b624323326 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:40.700710 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b526443-e11a-42de-8267-94b624323326 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:40.701477 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b526443-e11a-42de-8267-94b624323326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:40.703427 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b526443-e11a-42de-8267-94b624323326 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:40.736358 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1025/2031] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:40 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:40.744713 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d31ab-b766-444f-979e-4ff59dbc7b15 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:40.759114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d31ab-b766-444f-979e-4ff59dbc7b15 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:40.836254 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89253b9-ec4f-4a2a-9c55-4bba8274e6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:40.838066 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89253b9-ec4f-4a2a-9c55-4bba8274e6bc admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:40.838341 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89253b9-ec4f-4a2a-9c55-4bba8274e6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:40.839290 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89253b9-ec4f-4a2a-9c55-4bba8274e6bc admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:40.840262 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89253b9-ec4f-4a2a-9c55-4bba8274e6bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:40.842342 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89253b9-ec4f-4a2a-9c55-4bba8274e6bc admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:40.874562 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1007/2032] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:40 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:40.874643 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b526443-e11a-42de-8267-94b624323326 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:40.883632 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b526443-e11a-42de-8267-94b624323326 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:40.888349 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc62ca-9586-4ac5-99ef-877398f3ce8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:40.889145 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc62ca-9586-4ac5-99ef-877398f3ce8f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:40.889556 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc62ca-9586-4ac5-99ef-877398f3ce8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:40.889674 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc62ca-9586-4ac5-99ef-877398f3ce8f admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:40.890416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc62ca-9586-4ac5-99ef-877398f3ce8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:40.892061 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc62ca-9586-4ac5-99ef-877398f3ce8f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:40.907485 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1026/2033] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:40.910765 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89253b9-ec4f-4a2a-9c55-4bba8274e6bc admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:40.923439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89253b9-ec4f-4a2a-9c55-4bba8274e6bc admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:40.931147 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74703098-62d7-4e96-b975-5d820b368e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:40.932163 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74703098-62d7-4e96-b975-5d820b368e13 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:40.932586 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74703098-62d7-4e96-b975-5d820b368e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:40.932999 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74703098-62d7-4e96-b975-5d820b368e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:40.934057 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74703098-62d7-4e96-b975-5d820b368e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:40.936112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74703098-62d7-4e96-b975-5d820b368e13 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:40.956845 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1008/2034] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:48:40.958489 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc62ca-9586-4ac5-99ef-877398f3ce8f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:40.972443 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc62ca-9586-4ac5-99ef-877398f3ce8f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:40.983891 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74703098-62d7-4e96-b975-5d820b368e13 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:40.984718 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f2095-7a0c-4cea-9fdd-c37c45a40236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:40.985662 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-74703098-62d7-4e96-b975-5d820b368e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:40.985794 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f2095-7a0c-4cea-9fdd-c37c45a40236 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:40.986057 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f2095-7a0c-4cea-9fdd-c37c45a40236 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:40.986325 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f2095-7a0c-4cea-9fdd-c37c45a40236 admin admin] PATH_INFO: `/v3/projects/50ecb556789f4496acf8778d25e70087/users/9849dc3d64cc44739ec127b431c673a8/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:41.006646 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f2095-7a0c-4cea-9fdd-c37c45a40236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50ecb556789f4496acf8778d25e70087, user_id=9849dc3d64cc44739ec127b431c673a8, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:41.012614 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f2095-7a0c-4cea-9fdd-c37c45a40236 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:41.029744 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1027/2035] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:40 2022] PUT /identity/v3/projects/50ecb556789f4496acf8778d25e70087/users/9849dc3d64cc44739ec127b431c673a8/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:41.040836 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b5b2e-ee70-4a50-ba82-004e37103c3a None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:41.041113 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b5b2e-ee70-4a50-ba82-004e37103c3a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:41.041381 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b5b2e-ee70-4a50-ba82-004e37103c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:41.053121 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74703098-62d7-4e96-b975-5d820b368e13 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:41.070746 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-060b5b2e-ee70-4a50-ba82-004e37103c3a None None] MFA Rules not processed for user `9849dc3d64cc44739ec127b431c673a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:41.072163 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-060b5b2e-ee70-4a50-ba82-004e37103c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:41.106145 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c874e-2cb2-4cc0-a58d-f43007310cea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:41.106846 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c874e-2cb2-4cc0-a58d-f43007310cea service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:41.107143 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c874e-2cb2-4cc0-a58d-f43007310cea service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:41.107602 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c874e-2cb2-4cc0-a58d-f43007310cea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:41.110468 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-ff1c874e-2cb2-4cc0-a58d-f43007310cea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:41.143097 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1028/2036] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:41.148424 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b5b2e-ee70-4a50-ba82-004e37103c3a None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:41.149938 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-060b5b2e-ee70-4a50-ba82-004e37103c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:41.162355 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b5b2e-ee70-4a50-ba82-004e37103c3a None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:41.166645 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acc413-e269-42dc-9e2e-3ec0449ceb13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:41.167303 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acc413-e269-42dc-9e2e-3ec0449ceb13 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:41.167615 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acc413-e269-42dc-9e2e-3ec0449ceb13 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:41.167884 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acc413-e269-42dc-9e2e-3ec0449ceb13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:41.169206 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c874e-2cb2-4cc0-a58d-f43007310cea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:41.169805 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f9acc413-e269-42dc-9e2e-3ec0449ceb13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:41.170647 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c874e-2cb2-4cc0-a58d-f43007310cea service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:41.180178 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1009/2037] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:48:41.180694 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c874e-2cb2-4cc0-a58d-f43007310cea service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:41.232645 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9acc413-e269-42dc-9e2e-3ec0449ceb13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:41.234111 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9acc413-e269-42dc-9e2e-3ec0449ceb13 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:41.243287 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1029/2038] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:41.248718 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c874e-2cb2-4cc0-a58d-f43007310cea service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:41.254502 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3734ed-ba9d-4018-a5ee-93b4814ba9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:41.257663 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3734ed-ba9d-4018-a5ee-93b4814ba9fb admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:41.257935 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3734ed-ba9d-4018-a5ee-93b4814ba9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:41.258230 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3734ed-ba9d-4018-a5ee-93b4814ba9fb admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:41.259130 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3734ed-ba9d-4018-a5ee-93b4814ba9fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:41.261099 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3734ed-ba9d-4018-a5ee-93b4814ba9fb admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:41.291641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1010/2039] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:41 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:41.296431 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acc413-e269-42dc-9e2e-3ec0449ceb13 service cinder] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:41.310899 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acc413-e269-42dc-9e2e-3ec0449ceb13 service cinder] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:41.419509 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb77cf-234a-48ef-8c3c-346d9c4eaf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:41.420382 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb77cf-234a-48ef-8c3c-346d9c4eaf27 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:41.420702 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb77cf-234a-48ef-8c3c-346d9c4eaf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:41.421038 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb77cf-234a-48ef-8c3c-346d9c4eaf27 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:41.421936 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb77cf-234a-48ef-8c3c-346d9c4eaf27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:41.424412 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb77cf-234a-48ef-8c3c-346d9c4eaf27 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:41.477423 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1030/2040] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:41 2022] POST /identity/v3/users => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:48:41.479055 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3734ed-ba9d-4018-a5ee-93b4814ba9fb admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:41.491925 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3734ed-ba9d-4018-a5ee-93b4814ba9fb admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:41.502129 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0685a-57e1-48ff-ac0b-3906d3dda332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:41.502998 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0685a-57e1-48ff-ac0b-3906d3dda332 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:41.503392 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0685a-57e1-48ff-ac0b-3906d3dda332 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:41.503905 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0685a-57e1-48ff-ac0b-3906d3dda332 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:41.505232 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0685a-57e1-48ff-ac0b-3906d3dda332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:41.512375 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0685a-57e1-48ff-ac0b-3906d3dda332 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:41.538358 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1011/2041] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:41.540689 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb77cf-234a-48ef-8c3c-346d9c4eaf27 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:41.553503 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb77cf-234a-48ef-8c3c-346d9c4eaf27 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:41.559014 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb100e1a-e932-4d6a-b5cc-452dc50580e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:41.560317 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb100e1a-e932-4d6a-b5cc-452dc50580e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:41.560454 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb100e1a-e932-4d6a-b5cc-452dc50580e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:41.561207 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb100e1a-e932-4d6a-b5cc-452dc50580e1 admin admin] PATH_INFO: `/v3/projects/a4f206734d404d248cc8692a80a1d4df/users/54f2e398f7424881807ff82468ad2143/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:41.582512 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb100e1a-e932-4d6a-b5cc-452dc50580e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4f206734d404d248cc8692a80a1d4df, user_id=54f2e398f7424881807ff82468ad2143, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:41.586291 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb100e1a-e932-4d6a-b5cc-452dc50580e1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:41.611390 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1031/2042] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:41 2022] PUT /identity/v3/projects/a4f206734d404d248cc8692a80a1d4df/users/54f2e398f7424881807ff82468ad2143/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:41.612941 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0685a-57e1-48ff-ac0b-3906d3dda332 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:41.631829 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0685a-57e1-48ff-ac0b-3906d3dda332 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:41.703810 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e685fe-2991-48a0-ac5d-32011cd2ea35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:41.705465 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e685fe-2991-48a0-ac5d-32011cd2ea35 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:41.705993 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e685fe-2991-48a0-ac5d-32011cd2ea35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:41.706535 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e685fe-2991-48a0-ac5d-32011cd2ea35 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:41.708011 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e685fe-2991-48a0-ac5d-32011cd2ea35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:41.709929 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e685fe-2991-48a0-ac5d-32011cd2ea35 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:41.738573 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1012/2043] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:41.746990 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb100e1a-e932-4d6a-b5cc-452dc50580e1 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:41.758560 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb100e1a-e932-4d6a-b5cc-452dc50580e1 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:41.764049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c1177-4a16-49f3-8e52-c1aa45a17b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:41.765065 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c1177-4a16-49f3-8e52-c1aa45a17b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:41.765444 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c1177-4a16-49f3-8e52-c1aa45a17b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:41.765813 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c1177-4a16-49f3-8e52-c1aa45a17b4c admin admin] PATH_INFO: `/v3/projects/a4f206734d404d248cc8692a80a1d4df/users/54f2e398f7424881807ff82468ad2143/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:41.768427 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c1177-4a16-49f3-8e52-c1aa45a17b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4f206734d404d248cc8692a80a1d4df, user_id=54f2e398f7424881807ff82468ad2143, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:41.771703 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c1177-4a16-49f3-8e52-c1aa45a17b4c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:41.804817 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1032/2044] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:41 2022] PUT /identity/v3/projects/a4f206734d404d248cc8692a80a1d4df/users/54f2e398f7424881807ff82468ad2143/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:41.820034 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b1876-43bc-43fd-b66e-5a5bd79ed232 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:41.821089 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b1876-43bc-43fd-b66e-5a5bd79ed232 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:41.821549 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b1876-43bc-43fd-b66e-5a5bd79ed232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:41.876579 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-086b1876-43bc-43fd-b66e-5a5bd79ed232 None None] MFA Rules not processed for user `54f2e398f7424881807ff82468ad2143`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:41.878360 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-086b1876-43bc-43fd-b66e-5a5bd79ed232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:42.012721 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1013/2045] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:42.057308 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c1177-4a16-49f3-8e52-c1aa45a17b4c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:42.126409 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c1177-4a16-49f3-8e52-c1aa45a17b4c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:42.130382 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4ce85-2de4-4458-ad06-3979f9570da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:42.131040 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4ce85-2de4-4458-ad06-3979f9570da5 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:42.131318 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4ce85-2de4-4458-ad06-3979f9570da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:42.131630 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4ce85-2de4-4458-ad06-3979f9570da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:42.202394 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4ce85-2de4-4458-ad06-3979f9570da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:42.204084 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4ce85-2de4-4458-ad06-3979f9570da5 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:42.213782 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1033/2046] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:42.255755 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b1876-43bc-43fd-b66e-5a5bd79ed232 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:42.267067 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b1876-43bc-43fd-b66e-5a5bd79ed232 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:42.271322 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64c740-b799-48cb-98e7-03a280c3b923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:42.271694 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64c740-b799-48cb-98e7-03a280c3b923 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:42.272068 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64c740-b799-48cb-98e7-03a280c3b923 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:42.272432 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64c740-b799-48cb-98e7-03a280c3b923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:42.280609 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-1c64c740-b799-48cb-98e7-03a280c3b923 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:42.359601 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64c740-b799-48cb-98e7-03a280c3b923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:42.361273 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64c740-b799-48cb-98e7-03a280c3b923 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:42.375701 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1014/2047] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:43.977595 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4ce85-2de4-4458-ad06-3979f9570da5 service cinder] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:43.979601 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-35b4ce85-2de4-4458-ad06-3979f9570da5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:44.156237 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4ce85-2de4-4458-ad06-3979f9570da5 service cinder] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:44.168932 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2659d-3267-4132-9d6a-b52bd033965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:44.170401 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2659d-3267-4132-9d6a-b52bd033965d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:44.170731 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2659d-3267-4132-9d6a-b52bd033965d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:44.171398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2659d-3267-4132-9d6a-b52bd033965d admin admin] PATH_INFO: `/v3/users/933616685bb444c39e3def25adf8a136` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:44.175470 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2659d-3267-4132-9d6a-b52bd033965d admin admin] RBAC: Authorizing `identity:delete_user(user_id=933616685bb444c39e3def25adf8a136)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:44.182724 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2659d-3267-4132-9d6a-b52bd033965d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:44.272315 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-e5b2659d-3267-4132-9d6a-b52bd033965d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '933616685bb444c39e3def25adf8a136'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:44.291228 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-e5b2659d-3267-4132-9d6a-b52bd033965d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '933616685bb444c39e3def25adf8a136'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:44.309504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-e5b2659d-3267-4132-9d6a-b52bd033965d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '933616685bb444c39e3def25adf8a136'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:44.310357 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-e5b2659d-3267-4132-9d6a-b52bd033965d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '933616685bb444c39e3def25adf8a136'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:44.311849 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-e5b2659d-3267-4132-9d6a-b52bd033965d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '933616685bb444c39e3def25adf8a136'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:44.382969 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1034/2048] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:43 2022] DELETE /identity/v3/users/933616685bb444c39e3def25adf8a136 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:44.388280 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05b59c-0e8b-4991-9147-40cfead192ce None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:44.388739 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05b59c-0e8b-4991-9147-40cfead192ce None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:44.388953 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05b59c-0e8b-4991-9147-40cfead192ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:44.425105 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-7e05b59c-0e8b-4991-9147-40cfead192ce None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:44.433321 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-7e05b59c-0e8b-4991-9147-40cfead192ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:44.538857 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1015/2049] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:44.547256 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2659d-3267-4132-9d6a-b52bd033965d admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:44.548767 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-e5b2659d-3267-4132-9d6a-b52bd033965d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:44.622102 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2659d-3267-4132-9d6a-b52bd033965d admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:44.625936 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d0e05-ed25-4c71-89f6-9a350367d0fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:44.626562 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d0e05-ed25-4c71-89f6-9a350367d0fe service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:44.626838 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d0e05-ed25-4c71-89f6-9a350367d0fe service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:44.627165 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d0e05-ed25-4c71-89f6-9a350367d0fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:44.636613 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d0e05-ed25-4c71-89f6-9a350367d0fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:44.638061 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d0e05-ed25-4c71-89f6-9a350367d0fe service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:44.647793 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1035/2050] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:45.080243 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05b59c-0e8b-4991-9147-40cfead192ce None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:45.081823 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-7e05b59c-0e8b-4991-9147-40cfead192ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:45.102591 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05b59c-0e8b-4991-9147-40cfead192ce None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:45.116113 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafca4c-fcaa-4d4d-b67d-babfe482f004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:45.117020 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafca4c-fcaa-4d4d-b67d-babfe482f004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:45.117302 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafca4c-fcaa-4d4d-b67d-babfe482f004 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:45.117575 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafca4c-fcaa-4d4d-b67d-babfe482f004 admin admin] PATH_INFO: `/v3/projects/cad93e87ae2b4ea0ae3cdee73cf03889` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:45.118779 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafca4c-fcaa-4d4d-b67d-babfe482f004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cad93e87ae2b4ea0ae3cdee73cf03889)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:45.120755 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafca4c-fcaa-4d4d-b67d-babfe482f004 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:45.169093 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6aafca4c-fcaa-4d4d-b67d-babfe482f004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad93e87ae2b4ea0ae3cdee73cf03889', 'request_id': 'req-6aafca4c-fcaa-4d4d-b67d-babfe482f004'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:45.177441 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6aafca4c-fcaa-4d4d-b67d-babfe482f004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad93e87ae2b4ea0ae3cdee73cf03889', 'request_id': 'req-6aafca4c-fcaa-4d4d-b67d-babfe482f004'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:45.186333 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6aafca4c-fcaa-4d4d-b67d-babfe482f004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad93e87ae2b4ea0ae3cdee73cf03889', 'request_id': 'req-6aafca4c-fcaa-4d4d-b67d-babfe482f004'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:45.197911 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6aafca4c-fcaa-4d4d-b67d-babfe482f004 admin admin] The token cache is being invalidate because project cad93e87ae2b4ea0ae3cdee73cf03889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:45.198200 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6aafca4c-fcaa-4d4d-b67d-babfe482f004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:45.198827 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6aafca4c-fcaa-4d4d-b67d-babfe482f004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:45.200585 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1016/2051] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:45 2022] DELETE /identity/v3/projects/cad93e87ae2b4ea0ae3cdee73cf03889 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:45.204321 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d0e05-ed25-4c71-89f6-9a350367d0fe service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:45.231326 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d0e05-ed25-4c71-89f6-9a350367d0fe service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:45.310886 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a309048-71ef-4098-bd2a-de05ec2795b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:45.311914 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a309048-71ef-4098-bd2a-de05ec2795b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:45.312267 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a309048-71ef-4098-bd2a-de05ec2795b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:45.312532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a309048-71ef-4098-bd2a-de05ec2795b7 admin admin] PATH_INFO: `/v3/users/77c76878fe6b4278a5ef0551e62ad006` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:45.313907 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a309048-71ef-4098-bd2a-de05ec2795b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77c76878fe6b4278a5ef0551e62ad006)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:45.316355 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a309048-71ef-4098-bd2a-de05ec2795b7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:45.371262 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0a309048-71ef-4098-bd2a-de05ec2795b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77c76878fe6b4278a5ef0551e62ad006'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:45.378842 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0a309048-71ef-4098-bd2a-de05ec2795b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77c76878fe6b4278a5ef0551e62ad006'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:45.387392 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0a309048-71ef-4098-bd2a-de05ec2795b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77c76878fe6b4278a5ef0551e62ad006'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:45.388186 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0a309048-71ef-4098-bd2a-de05ec2795b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77c76878fe6b4278a5ef0551e62ad006'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:45.388891 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0a309048-71ef-4098-bd2a-de05ec2795b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77c76878fe6b4278a5ef0551e62ad006'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:45.407612 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1036/2052] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:45 2022] DELETE /identity/v3/users/77c76878fe6b4278a5ef0551e62ad006 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:45.860934 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafca4c-fcaa-4d4d-b67d-babfe482f004 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:45.862440 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-6aafca4c-fcaa-4d4d-b67d-babfe482f004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:45.892822 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafca4c-fcaa-4d4d-b67d-babfe482f004 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:45.974455 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cf525-0063-4624-9170-4bb5950398e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:45.975677 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cf525-0063-4624-9170-4bb5950398e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:45.976634 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cf525-0063-4624-9170-4bb5950398e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:45.977064 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cf525-0063-4624-9170-4bb5950398e9 admin admin] PATH_INFO: `/v3/projects/f58ca6180eb6473587a8cfd61be467db` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:45.978567 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cf525-0063-4624-9170-4bb5950398e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f58ca6180eb6473587a8cfd61be467db)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:45.980849 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cf525-0063-4624-9170-4bb5950398e9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:46.045094 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b48cf525-0063-4624-9170-4bb5950398e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f58ca6180eb6473587a8cfd61be467db', 'request_id': 'req-b48cf525-0063-4624-9170-4bb5950398e9'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:46.055150 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b48cf525-0063-4624-9170-4bb5950398e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f58ca6180eb6473587a8cfd61be467db', 'request_id': 'req-b48cf525-0063-4624-9170-4bb5950398e9'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:46.063289 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b48cf525-0063-4624-9170-4bb5950398e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f58ca6180eb6473587a8cfd61be467db', 'request_id': 'req-b48cf525-0063-4624-9170-4bb5950398e9'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:46.076805 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b48cf525-0063-4624-9170-4bb5950398e9 admin admin] The token cache is being invalidate because project f58ca6180eb6473587a8cfd61be467db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:46.077099 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b48cf525-0063-4624-9170-4bb5950398e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:46.078271 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b48cf525-0063-4624-9170-4bb5950398e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:46.080933 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1017/2053] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:45 2022] DELETE /identity/v3/projects/f58ca6180eb6473587a8cfd61be467db => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:46.085221 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a309048-71ef-4098-bd2a-de05ec2795b7 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:46.087508 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-0a309048-71ef-4098-bd2a-de05ec2795b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:46.103544 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a309048-71ef-4098-bd2a-de05ec2795b7 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:46.172056 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccfb7f-d331-486f-b821-06e557a0bc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:46.173051 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccfb7f-d331-486f-b821-06e557a0bc84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:46.173398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccfb7f-d331-486f-b821-06e557a0bc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:46.173734 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccfb7f-d331-486f-b821-06e557a0bc84 admin admin] PATH_INFO: `/v3/users/b97aecad56294da9af617165aa272057` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:46.175018 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ccfb7f-d331-486f-b821-06e557a0bc84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b97aecad56294da9af617165aa272057)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:46.177178 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ccfb7f-d331-486f-b821-06e557a0bc84 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:46.231759 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c0ccfb7f-d331-486f-b821-06e557a0bc84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b97aecad56294da9af617165aa272057'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:46.238782 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c0ccfb7f-d331-486f-b821-06e557a0bc84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b97aecad56294da9af617165aa272057'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:46.248995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c0ccfb7f-d331-486f-b821-06e557a0bc84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b97aecad56294da9af617165aa272057'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:46.250673 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c0ccfb7f-d331-486f-b821-06e557a0bc84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b97aecad56294da9af617165aa272057'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:46.251291 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c0ccfb7f-d331-486f-b821-06e557a0bc84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b97aecad56294da9af617165aa272057'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:46.269113 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1037/2054] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:46 2022] DELETE /identity/v3/users/b97aecad56294da9af617165aa272057 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:46.370318 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5e562-26c6-4157-bec0-18d1b1fcb19e None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:46.370658 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5e562-26c6-4157-bec0-18d1b1fcb19e None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:46.370863 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5e562-26c6-4157-bec0-18d1b1fcb19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:46.395738 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-0fd5e562-26c6-4157-bec0-18d1b1fcb19e None None] MFA Rules not processed for user `0513eaec53d241f398508dec85f017d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:46.397542 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-0fd5e562-26c6-4157-bec0-18d1b1fcb19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:46.412378 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccfb7f-d331-486f-b821-06e557a0bc84 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:46.414183 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c0ccfb7f-d331-486f-b821-06e557a0bc84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:46.463700 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1018/2055] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:46.515111 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccfb7f-d331-486f-b821-06e557a0bc84 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:46.522569 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149a39c-d95f-4856-adea-d3cc804b03c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:46.524123 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149a39c-d95f-4856-adea-d3cc804b03c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:46.524670 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149a39c-d95f-4856-adea-d3cc804b03c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:46.525130 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149a39c-d95f-4856-adea-d3cc804b03c3 admin admin] PATH_INFO: `/v3/users/d096cb29d5cf4cbc99f619258f198bbd` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:46.526807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149a39c-d95f-4856-adea-d3cc804b03c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d096cb29d5cf4cbc99f619258f198bbd)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:46.529209 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149a39c-d95f-4856-adea-d3cc804b03c3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:46.589164 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-9149a39c-d95f-4856-adea-d3cc804b03c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd096cb29d5cf4cbc99f619258f198bbd'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:46.596214 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-9149a39c-d95f-4856-adea-d3cc804b03c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd096cb29d5cf4cbc99f619258f198bbd'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:46.606878 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-9149a39c-d95f-4856-adea-d3cc804b03c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd096cb29d5cf4cbc99f619258f198bbd'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:46.607792 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-9149a39c-d95f-4856-adea-d3cc804b03c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd096cb29d5cf4cbc99f619258f198bbd'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:46.608670 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-9149a39c-d95f-4856-adea-d3cc804b03c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd096cb29d5cf4cbc99f619258f198bbd'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:46.638576 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1038/2056] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:46 2022] DELETE /identity/v3/users/d096cb29d5cf4cbc99f619258f198bbd => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:46.643782 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a38fd-1cbc-4047-8c3e-00d55bcde3ae None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:46.644343 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a38fd-1cbc-4047-8c3e-00d55bcde3ae None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:46.644678 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a38fd-1cbc-4047-8c3e-00d55bcde3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:46.652408 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149a39c-d95f-4856-adea-d3cc804b03c3 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:46.654301 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-9149a39c-d95f-4856-adea-d3cc804b03c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:46.672528 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-992a38fd-1cbc-4047-8c3e-00d55bcde3ae None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:46.674146 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-992a38fd-1cbc-4047-8c3e-00d55bcde3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:46.751971 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149a39c-d95f-4856-adea-d3cc804b03c3 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:46.756870 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742bf89-0510-408e-bc44-1a990208dced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:46.757781 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742bf89-0510-408e-bc44-1a990208dced admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:46.758059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742bf89-0510-408e-bc44-1a990208dced admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:46.758322 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742bf89-0510-408e-bc44-1a990208dced admin admin] PATH_INFO: `/v3/projects/d2f97b5f9ae54176a115b14454583d7b` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:46.759534 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742bf89-0510-408e-bc44-1a990208dced admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f97b5f9ae54176a115b14454583d7b)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:46.761483 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742bf89-0510-408e-bc44-1a990208dced admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:46.772275 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1019/2057] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:46.781837 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a38fd-1cbc-4047-8c3e-00d55bcde3ae None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:46.783812 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-992a38fd-1cbc-4047-8c3e-00d55bcde3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:46.811405 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c742bf89-0510-408e-bc44-1a990208dced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f97b5f9ae54176a115b14454583d7b', 'request_id': 'req-c742bf89-0510-408e-bc44-1a990208dced'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:46.817902 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c742bf89-0510-408e-bc44-1a990208dced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f97b5f9ae54176a115b14454583d7b', 'request_id': 'req-c742bf89-0510-408e-bc44-1a990208dced'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:46.829607 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c742bf89-0510-408e-bc44-1a990208dced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f97b5f9ae54176a115b14454583d7b', 'request_id': 'req-c742bf89-0510-408e-bc44-1a990208dced'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:46.841810 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c742bf89-0510-408e-bc44-1a990208dced admin admin] The token cache is being invalidate because project d2f97b5f9ae54176a115b14454583d7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:46.842094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c742bf89-0510-408e-bc44-1a990208dced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:46.843436 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c742bf89-0510-408e-bc44-1a990208dced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:46.845027 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1039/2058] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:46 2022] DELETE /identity/v3/projects/d2f97b5f9ae54176a115b14454583d7b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:46.851848 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76113e79-4bb5-486f-aa23-f3448381ebf6 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:46.852129 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76113e79-4bb5-486f-aa23-f3448381ebf6 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:46.852420 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76113e79-4bb5-486f-aa23-f3448381ebf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:46.856767 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a38fd-1cbc-4047-8c3e-00d55bcde3ae None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:46.872032 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-76113e79-4bb5-486f-aa23-f3448381ebf6 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:46.873334 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-76113e79-4bb5-486f-aa23-f3448381ebf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:46.920813 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5112f-0f3e-4535-9172-2c2efec0bd9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:46.922247 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5112f-0f3e-4535-9172-2c2efec0bd9c service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:46.922611 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5112f-0f3e-4535-9172-2c2efec0bd9c service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:46.923100 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5112f-0f3e-4535-9172-2c2efec0bd9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:46.927333 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9aa5112f-0f3e-4535-9172-2c2efec0bd9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:46.948065 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1040/2059] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:46.956573 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9354b-5e73-4420-a19e-fa54951226c0 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:46.957034 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9354b-5e73-4420-a19e-fa54951226c0 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:46.957774 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9354b-5e73-4420-a19e-fa54951226c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:46.976926 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-ebb9354b-5e73-4420-a19e-fa54951226c0 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:46.978118 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ebb9354b-5e73-4420-a19e-fa54951226c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:46.986233 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1041/2060] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:46.991185 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9354b-5e73-4420-a19e-fa54951226c0 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:46.994250 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5112f-0f3e-4535-9172-2c2efec0bd9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:46.996937 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5112f-0f3e-4535-9172-2c2efec0bd9c service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:47.005066 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9354b-5e73-4420-a19e-fa54951226c0 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:47.007128 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1020/2061] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:48:47.010850 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5979d-85bd-45e7-95a3-58e1cf4315e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:47.011548 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5979d-85bd-45e7-95a3-58e1cf4315e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:47.011823 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5979d-85bd-45e7-95a3-58e1cf4315e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:47.012088 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5979d-85bd-45e7-95a3-58e1cf4315e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:47.012959 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5979d-85bd-45e7-95a3-58e1cf4315e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:48:47.013397 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5979d-85bd-45e7-95a3-58e1cf4315e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:47.015392 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5979d-85bd-45e7-95a3-58e1cf4315e5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:47.034815 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1042/2062] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:48:47.036079 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5112f-0f3e-4535-9172-2c2efec0bd9c service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:47.046240 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5112f-0f3e-4535-9172-2c2efec0bd9c service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:47.053614 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f408f32-d499-4b8e-9071-6221a486cdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:47.054565 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f408f32-d499-4b8e-9071-6221a486cdb7 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:47.055022 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f408f32-d499-4b8e-9071-6221a486cdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:47.055557 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f408f32-d499-4b8e-9071-6221a486cdb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:47.056751 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f408f32-d499-4b8e-9071-6221a486cdb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:47.059579 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f408f32-d499-4b8e-9071-6221a486cdb7 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:47.096426 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1021/2063] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:47 2022] POST /identity/v3/projects => generated 401 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:47.097738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5979d-85bd-45e7-95a3-58e1cf4315e5 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:47.113380 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5979d-85bd-45e7-95a3-58e1cf4315e5 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:47.229223 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0cd49-5529-437f-ac04-34c6e83d17f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:47.229913 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0cd49-5529-437f-ac04-34c6e83d17f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:47.230189 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0cd49-5529-437f-ac04-34c6e83d17f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:47.230555 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0cd49-5529-437f-ac04-34c6e83d17f9 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:47.231154 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0cd49-5529-437f-ac04-34c6e83d17f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:47.233304 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0cd49-5529-437f-ac04-34c6e83d17f9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:47.267556 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1043/2064] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:47 2022] POST /identity/v3/users => generated 301 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:47.274652 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f408f32-d499-4b8e-9071-6221a486cdb7 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:47.292094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0cd49-5529-437f-ac04-34c6e83d17f9 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:47.294075 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-16e0cd49-5529-437f-ac04-34c6e83d17f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:47.295729 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f408f32-d499-4b8e-9071-6221a486cdb7 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:47.309848 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555f850-6a6a-4f08-9e50-8a156afcee93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:47.311141 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555f850-6a6a-4f08-9e50-8a156afcee93 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:47.311666 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555f850-6a6a-4f08-9e50-8a156afcee93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:47.312128 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555f850-6a6a-4f08-9e50-8a156afcee93 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:47.313069 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555f850-6a6a-4f08-9e50-8a156afcee93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:47.317928 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555f850-6a6a-4f08-9e50-8a156afcee93 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:47.341525 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1022/2065] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:47.345471 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555f850-6a6a-4f08-9e50-8a156afcee93 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:47.363839 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555f850-6a6a-4f08-9e50-8a156afcee93 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:47.377669 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f0e9b-5f6f-47c5-af39-2fa678793f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:47.378429 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f0e9b-5f6f-47c5-af39-2fa678793f79 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:47.379022 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f0e9b-5f6f-47c5-af39-2fa678793f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:47.379712 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f0e9b-5f6f-47c5-af39-2fa678793f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:47.380492 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f0e9b-5f6f-47c5-af39-2fa678793f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:47.382355 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f0e9b-5f6f-47c5-af39-2fa678793f79 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:47.385084 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0cd49-5529-437f-ac04-34c6e83d17f9 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:47.393250 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1023/2066] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:48:47.396108 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506e63c-55f5-49a3-819d-4a94ba9c085c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:47.396785 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e63c-55f5-49a3-819d-4a94ba9c085c service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:47.397067 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e63c-55f5-49a3-819d-4a94ba9c085c service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:47.397336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e63c-55f5-49a3-819d-4a94ba9c085c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:47.399193 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-6506e63c-55f5-49a3-819d-4a94ba9c085c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:47.401611 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f0e9b-5f6f-47c5-af39-2fa678793f79 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:47.418373 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f0e9b-5f6f-47c5-af39-2fa678793f79 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:47.425543 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7444dd-933e-4483-a4b3-962d7c36453e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:47.427946 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7444dd-933e-4483-a4b3-962d7c36453e admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:47.428296 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7444dd-933e-4483-a4b3-962d7c36453e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:47.428578 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7444dd-933e-4483-a4b3-962d7c36453e admin admin] PATH_INFO: `/v3/projects/d46d76d53b5a4d8faeab7c9f4d3d1fc5/users/4fdcf01cfab44b0b9b0c72c0dd08e1aa/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:47.456965 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7444dd-933e-4483-a4b3-962d7c36453e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46d76d53b5a4d8faeab7c9f4d3d1fc5, user_id=4fdcf01cfab44b0b9b0c72c0dd08e1aa, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:47.462003 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7444dd-933e-4483-a4b3-962d7c36453e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:47.484069 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1024/2067] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:47 2022] PUT /identity/v3/projects/d46d76d53b5a4d8faeab7c9f4d3d1fc5/users/4fdcf01cfab44b0b9b0c72c0dd08e1aa/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:47.489518 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7444dd-933e-4483-a4b3-962d7c36453e admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:47.497617 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5d7444dd-933e-4483-a4b3-962d7c36453e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:47.522671 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506e63c-55f5-49a3-819d-4a94ba9c085c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:47.528150 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506e63c-55f5-49a3-819d-4a94ba9c085c service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:47.556557 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1044/2068] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:48:47.558046 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a31e32-81c3-4dba-937c-b1ad88fb8a73 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:47.558335 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a31e32-81c3-4dba-937c-b1ad88fb8a73 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:47.558613 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a31e32-81c3-4dba-937c-b1ad88fb8a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:47.589698 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-c7a31e32-81c3-4dba-937c-b1ad88fb8a73 None None] MFA Rules not processed for user `4fdcf01cfab44b0b9b0c72c0dd08e1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:47.591266 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c7a31e32-81c3-4dba-937c-b1ad88fb8a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:47.621321 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7444dd-933e-4483-a4b3-962d7c36453e admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:47.641281 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e75a0e-9a22-4632-afbb-608a61fb1813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:47.642193 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e75a0e-9a22-4632-afbb-608a61fb1813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:47.642457 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e75a0e-9a22-4632-afbb-608a61fb1813 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:47.642684 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e75a0e-9a22-4632-afbb-608a61fb1813 admin admin] PATH_INFO: `/v3/projects/116ba1acf9b243448eb63b5d7a9f8eb4` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:47.644121 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e75a0e-9a22-4632-afbb-608a61fb1813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=116ba1acf9b243448eb63b5d7a9f8eb4)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:47.646431 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e75a0e-9a22-4632-afbb-608a61fb1813 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:47.739747 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1045/2069] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:47.744903 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-11e75a0e-9a22-4632-afbb-608a61fb1813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '116ba1acf9b243448eb63b5d7a9f8eb4', 'request_id': 'req-11e75a0e-9a22-4632-afbb-608a61fb1813'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:47.745485 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a31e32-81c3-4dba-937c-b1ad88fb8a73 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:47.761007 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-11e75a0e-9a22-4632-afbb-608a61fb1813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '116ba1acf9b243448eb63b5d7a9f8eb4', 'request_id': 'req-11e75a0e-9a22-4632-afbb-608a61fb1813'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:47.770424 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-11e75a0e-9a22-4632-afbb-608a61fb1813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '116ba1acf9b243448eb63b5d7a9f8eb4', 'request_id': 'req-11e75a0e-9a22-4632-afbb-608a61fb1813'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:47.774161 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a31e32-81c3-4dba-937c-b1ad88fb8a73 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:47.788505 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-11e75a0e-9a22-4632-afbb-608a61fb1813 admin admin] The token cache is being invalidate because project 116ba1acf9b243448eb63b5d7a9f8eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:47.788952 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-11e75a0e-9a22-4632-afbb-608a61fb1813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:47.790803 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-11e75a0e-9a22-4632-afbb-608a61fb1813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:47.795275 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1025/2070] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:47 2022] DELETE /identity/v3/projects/116ba1acf9b243448eb63b5d7a9f8eb4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:47.799351 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e75a0e-9a22-4632-afbb-608a61fb1813 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:47.802831 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-11e75a0e-9a22-4632-afbb-608a61fb1813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:47.868658 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e773b-5e6d-4c00-955b-b62da3dce7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:47.870016 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e773b-5e6d-4c00-955b-b62da3dce7cd admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:47.870016 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e773b-5e6d-4c00-955b-b62da3dce7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:47.870396 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e773b-5e6d-4c00-955b-b62da3dce7cd admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:47.872501 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e773b-5e6d-4c00-955b-b62da3dce7cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:47.874615 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e773b-5e6d-4c00-955b-b62da3dce7cd admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:47.935803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1046/2071] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:47 2022] POST /identity/v3/projects => generated 401 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:47.938928 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e773b-5e6d-4c00-955b-b62da3dce7cd admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:47.942317 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-055e773b-5e6d-4c00-955b-b62da3dce7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:47.989371 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e75a0e-9a22-4632-afbb-608a61fb1813 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:48.076844 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e773b-5e6d-4c00-955b-b62da3dce7cd admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:48.084031 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1193df3-cbea-412d-823f-51471df88009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:48.085215 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1193df3-cbea-412d-823f-51471df88009 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:48.085508 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1193df3-cbea-412d-823f-51471df88009 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:48.085777 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1193df3-cbea-412d-823f-51471df88009 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:48.086868 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1193df3-cbea-412d-823f-51471df88009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:48.094526 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1193df3-cbea-412d-823f-51471df88009 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:48.120881 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e1cfd-485f-458e-9f3b-ec9781d7cf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:48.121876 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e1cfd-485f-458e-9f3b-ec9781d7cf8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:48.123493 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e1cfd-485f-458e-9f3b-ec9781d7cf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:48.123493 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e1cfd-485f-458e-9f3b-ec9781d7cf8a admin admin] PATH_INFO: `/v3/users/71bab49fc60e4540bb868e3061eb72f9` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:48.124472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e1cfd-485f-458e-9f3b-ec9781d7cf8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=71bab49fc60e4540bb868e3061eb72f9)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:48.128182 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1047/2072] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:47 2022] POST /identity/v3/users => generated 307 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:48.128182 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1193df3-cbea-412d-823f-51471df88009 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:48.128182 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b1193df3-cbea-412d-823f-51471df88009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:48.129708 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e1cfd-485f-458e-9f3b-ec9781d7cf8a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:48.142173 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1193df3-cbea-412d-823f-51471df88009 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:48.148523 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3380f-cd95-4cab-a57f-62b470a1a312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:48.149464 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3380f-cd95-4cab-a57f-62b470a1a312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:48.149751 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3380f-cd95-4cab-a57f-62b470a1a312 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:48.150119 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3380f-cd95-4cab-a57f-62b470a1a312 admin admin] PATH_INFO: `/v3/users/5883f052c7b64d74b361cd1c8f689061` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:48.151623 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3380f-cd95-4cab-a57f-62b470a1a312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5883f052c7b64d74b361cd1c8f689061)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:48.153856 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3380f-cd95-4cab-a57f-62b470a1a312 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:48.192072 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-1c2e1cfd-485f-458e-9f3b-ec9781d7cf8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71bab49fc60e4540bb868e3061eb72f9'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:48.193235 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-1c2e1cfd-485f-458e-9f3b-ec9781d7cf8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71bab49fc60e4540bb868e3061eb72f9'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:48.194029 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-1c2e1cfd-485f-458e-9f3b-ec9781d7cf8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71bab49fc60e4540bb868e3061eb72f9'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:48.209908 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-1c2e1cfd-485f-458e-9f3b-ec9781d7cf8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71bab49fc60e4540bb868e3061eb72f9'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:48.215700 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fab3380f-cd95-4cab-a57f-62b470a1a312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5883f052c7b64d74b361cd1c8f689061'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:48.217413 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-1c2e1cfd-485f-458e-9f3b-ec9781d7cf8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71bab49fc60e4540bb868e3061eb72f9'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:48.223157 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fab3380f-cd95-4cab-a57f-62b470a1a312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5883f052c7b64d74b361cd1c8f689061'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:48.231776 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fab3380f-cd95-4cab-a57f-62b470a1a312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5883f052c7b64d74b361cd1c8f689061'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:48.232597 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fab3380f-cd95-4cab-a57f-62b470a1a312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5883f052c7b64d74b361cd1c8f689061'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:48.233362 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fab3380f-cd95-4cab-a57f-62b470a1a312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5883f052c7b64d74b361cd1c8f689061'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:48.235644 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1026/2073] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:47 2022] DELETE /identity/v3/users/71bab49fc60e4540bb868e3061eb72f9 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:48.236800 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e1cfd-485f-458e-9f3b-ec9781d7cf8a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:48.253179 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-1c2e1cfd-485f-458e-9f3b-ec9781d7cf8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:48.263859 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1048/2074] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:48 2022] DELETE /identity/v3/users/5883f052c7b64d74b361cd1c8f689061 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:48.333287 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e1cfd-485f-458e-9f3b-ec9781d7cf8a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:48.405165 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa491e-9c93-4c9a-94f7-6f51933dfc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:48.405859 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa491e-9c93-4c9a-94f7-6f51933dfc20 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:48.406136 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa491e-9c93-4c9a-94f7-6f51933dfc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:48.406467 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa491e-9c93-4c9a-94f7-6f51933dfc20 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:48.407172 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa491e-9c93-4c9a-94f7-6f51933dfc20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:48.409007 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa491e-9c93-4c9a-94f7-6f51933dfc20 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:48.420623 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1027/2075] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:48.424660 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3380f-cd95-4cab-a57f-62b470a1a312 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:48.426435 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-fab3380f-cd95-4cab-a57f-62b470a1a312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:48.440270 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3380f-cd95-4cab-a57f-62b470a1a312 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:48.445396 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d371b3-1187-4225-9769-52536c0d7e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:48.446376 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d371b3-1187-4225-9769-52536c0d7e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:48.446758 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d371b3-1187-4225-9769-52536c0d7e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:48.447055 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d371b3-1187-4225-9769-52536c0d7e0e admin admin] PATH_INFO: `/v3/projects/5ccbb6776ed64395b91cafb365c8fcd9/users/84c50ff3f6d64c13a05ee4b0c2fcb730/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:48.462668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d371b3-1187-4225-9769-52536c0d7e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ccbb6776ed64395b91cafb365c8fcd9, user_id=84c50ff3f6d64c13a05ee4b0c2fcb730, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:48.465434 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d371b3-1187-4225-9769-52536c0d7e0e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:48.479759 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1049/2076] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:48 2022] PUT /identity/v3/projects/5ccbb6776ed64395b91cafb365c8fcd9/users/84c50ff3f6d64c13a05ee4b0c2fcb730/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:48.483999 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa491e-9c93-4c9a-94f7-6f51933dfc20 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:48.497363 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa491e-9c93-4c9a-94f7-6f51933dfc20 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:48.541457 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d371b3-1187-4225-9769-52536c0d7e0e admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:48.543320 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f9d371b3-1187-4225-9769-52536c0d7e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:48.579407 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc7459-d5de-4dab-9926-9677bb44f087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:48.580446 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc7459-d5de-4dab-9926-9677bb44f087 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:48.580901 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc7459-d5de-4dab-9926-9677bb44f087 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:48.581317 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc7459-d5de-4dab-9926-9677bb44f087 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:48.582504 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc7459-d5de-4dab-9926-9677bb44f087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:48.584347 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc7459-d5de-4dab-9926-9677bb44f087 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:48.600478 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1028/2077] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:48:48.604657 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc7459-d5de-4dab-9926-9677bb44f087 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:48.619825 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc7459-d5de-4dab-9926-9677bb44f087 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:48.625629 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f495d-01e1-4ddb-be1c-68aac56c6ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:48.626702 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f495d-01e1-4ddb-be1c-68aac56c6ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:48.627022 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f495d-01e1-4ddb-be1c-68aac56c6ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:48.627300 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f495d-01e1-4ddb-be1c-68aac56c6ce6 admin admin] PATH_INFO: `/v3/projects/5ccbb6776ed64395b91cafb365c8fcd9/users/84c50ff3f6d64c13a05ee4b0c2fcb730/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:48.629521 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f495d-01e1-4ddb-be1c-68aac56c6ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ccbb6776ed64395b91cafb365c8fcd9, user_id=84c50ff3f6d64c13a05ee4b0c2fcb730, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:48.632816 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f495d-01e1-4ddb-be1c-68aac56c6ce6 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:48.636972 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d371b3-1187-4225-9769-52536c0d7e0e admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:48.645706 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef446c5e-fca7-4576-96f8-560ac67d0e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:48.646695 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef446c5e-fca7-4576-96f8-560ac67d0e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:48.647004 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef446c5e-fca7-4576-96f8-560ac67d0e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:48.647306 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef446c5e-fca7-4576-96f8-560ac67d0e9c admin admin] PATH_INFO: `/v3/projects/30d54bc5b800487db219940267292ed4` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:48.648721 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef446c5e-fca7-4576-96f8-560ac67d0e9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d54bc5b800487db219940267292ed4)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:48.650913 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef446c5e-fca7-4576-96f8-560ac67d0e9c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:48.661360 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1029/2078] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:48 2022] PUT /identity/v3/projects/5ccbb6776ed64395b91cafb365c8fcd9/users/84c50ff3f6d64c13a05ee4b0c2fcb730/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:48.664264 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6886d-a9d6-460b-8586-ee9cbb0bcbb6 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:48.664557 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6886d-a9d6-460b-8586-ee9cbb0bcbb6 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:48.664836 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6886d-a9d6-460b-8586-ee9cbb0bcbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:48.696542 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-65f6886d-a9d6-460b-8586-ee9cbb0bcbb6 None None] MFA Rules not processed for user `84c50ff3f6d64c13a05ee4b0c2fcb730`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:48.698112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-65f6886d-a9d6-460b-8586-ee9cbb0bcbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:48.756920 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ef446c5e-fca7-4576-96f8-560ac67d0e9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d54bc5b800487db219940267292ed4', 'request_id': 'req-ef446c5e-fca7-4576-96f8-560ac67d0e9c'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:48.765748 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ef446c5e-fca7-4576-96f8-560ac67d0e9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d54bc5b800487db219940267292ed4', 'request_id': 'req-ef446c5e-fca7-4576-96f8-560ac67d0e9c'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:48.789780 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ef446c5e-fca7-4576-96f8-560ac67d0e9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d54bc5b800487db219940267292ed4', 'request_id': 'req-ef446c5e-fca7-4576-96f8-560ac67d0e9c'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:48.817766 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ef446c5e-fca7-4576-96f8-560ac67d0e9c admin admin] The token cache is being invalidate because project 30d54bc5b800487db219940267292ed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:48.818112 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ef446c5e-fca7-4576-96f8-560ac67d0e9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:48.819736 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ef446c5e-fca7-4576-96f8-560ac67d0e9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:48.823894 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1050/2079] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:48 2022] DELETE /identity/v3/projects/30d54bc5b800487db219940267292ed4 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:48.828943 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef446c5e-fca7-4576-96f8-560ac67d0e9c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:48.828943 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ef446c5e-fca7-4576-96f8-560ac67d0e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:48.832536 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1030/2080] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:48 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:48.838488 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b195a-4d04-407b-bcdf-6f8cdf4b1689 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:48.838836 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b195a-4d04-407b-bcdf-6f8cdf4b1689 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:48.839115 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b195a-4d04-407b-bcdf-6f8cdf4b1689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:48.862372 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-b85b195a-4d04-407b-bcdf-6f8cdf4b1689 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:48.863962 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-b85b195a-4d04-407b-bcdf-6f8cdf4b1689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:48.955249 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef446c5e-fca7-4576-96f8-560ac67d0e9c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:48.972798 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f51afa-5eb8-4e5f-9d8b-51566e64213b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:48.973172 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1031/2081] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:48.980246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f51afa-5eb8-4e5f-9d8b-51566e64213b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:48.980246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f51afa-5eb8-4e5f-9d8b-51566e64213b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:48.980246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f51afa-5eb8-4e5f-9d8b-51566e64213b admin admin] PATH_INFO: `/v3/projects/276ae7c965f141a08cc55a37f52dee54` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:48.980246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f51afa-5eb8-4e5f-9d8b-51566e64213b admin admin] RBAC: Authorizing `identity:delete_project(project_id=276ae7c965f141a08cc55a37f52dee54)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:48.980246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f51afa-5eb8-4e5f-9d8b-51566e64213b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:48.982999 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b195a-4d04-407b-bcdf-6f8cdf4b1689 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:48.985034 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-b85b195a-4d04-407b-bcdf-6f8cdf4b1689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:49.064996 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b195a-4d04-407b-bcdf-6f8cdf4b1689 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:49.072168 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-72f51afa-5eb8-4e5f-9d8b-51566e64213b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '276ae7c965f141a08cc55a37f52dee54', 'request_id': 'req-72f51afa-5eb8-4e5f-9d8b-51566e64213b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:49.092114 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-72f51afa-5eb8-4e5f-9d8b-51566e64213b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '276ae7c965f141a08cc55a37f52dee54', 'request_id': 'req-72f51afa-5eb8-4e5f-9d8b-51566e64213b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:49.108340 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-72f51afa-5eb8-4e5f-9d8b-51566e64213b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '276ae7c965f141a08cc55a37f52dee54', 'request_id': 'req-72f51afa-5eb8-4e5f-9d8b-51566e64213b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:49.126627 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-72f51afa-5eb8-4e5f-9d8b-51566e64213b admin admin] The token cache is being invalidate because project 276ae7c965f141a08cc55a37f52dee54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:49.126922 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-72f51afa-5eb8-4e5f-9d8b-51566e64213b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:49.127671 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-72f51afa-5eb8-4e5f-9d8b-51566e64213b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:49.133520 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1051/2082] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:48 2022] DELETE /identity/v3/projects/276ae7c965f141a08cc55a37f52dee54 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:49.135012 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d3309-155b-4fcb-957d-b1e39acc338c None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:49.135289 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d3309-155b-4fcb-957d-b1e39acc338c None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:49.135602 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d3309-155b-4fcb-957d-b1e39acc338c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:49.156933 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3162acc-782c-438a-8c99-93209587fc37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:49.157591 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3162acc-782c-438a-8c99-93209587fc37 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:49.157876 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3162acc-782c-438a-8c99-93209587fc37 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:49.158789 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3162acc-782c-438a-8c99-93209587fc37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:49.165149 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-b3162acc-782c-438a-8c99-93209587fc37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:49.172917 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-d30d3309-155b-4fcb-957d-b1e39acc338c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:49.174147 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d30d3309-155b-4fcb-957d-b1e39acc338c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:49.266800 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1052/2083] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:49.267414 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d3309-155b-4fcb-957d-b1e39acc338c None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:49.268787 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d30d3309-155b-4fcb-957d-b1e39acc338c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:49.272579 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3162acc-782c-438a-8c99-93209587fc37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:49.273431 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3162acc-782c-438a-8c99-93209587fc37 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:49.282511 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d3309-155b-4fcb-957d-b1e39acc338c None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:49.287405 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1032/2084] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:48 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:49.288593 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7702c-1abf-476d-8d8b-4c7ee5f9f111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:49.289576 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7702c-1abf-476d-8d8b-4c7ee5f9f111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:49.290026 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7702c-1abf-476d-8d8b-4c7ee5f9f111 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:49.290393 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7702c-1abf-476d-8d8b-4c7ee5f9f111 admin admin] PATH_INFO: `/v3/users/23344b405d5b4ed0a9a5d05dd9bf81cf` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:49.291784 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7702c-1abf-476d-8d8b-4c7ee5f9f111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23344b405d5b4ed0a9a5d05dd9bf81cf)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:49.294380 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7702c-1abf-476d-8d8b-4c7ee5f9f111 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:49.299666 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3162acc-782c-438a-8c99-93209587fc37 service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:49.316784 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3162acc-782c-438a-8c99-93209587fc37 service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:49.322653 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c50449-280c-4e9e-b925-731731d3705a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:49.324000 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c50449-280c-4e9e-b925-731731d3705a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:49.324000 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c50449-280c-4e9e-b925-731731d3705a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:49.324310 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c50449-280c-4e9e-b925-731731d3705a admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:49.325165 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c50449-280c-4e9e-b925-731731d3705a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:48:49.325479 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c50449-280c-4e9e-b925-731731d3705a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:49.327169 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c50449-280c-4e9e-b925-731731d3705a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:49.346132 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1033/2085] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:48:49.352164 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c50449-280c-4e9e-b925-731731d3705a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:49.362992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-9db7702c-1abf-476d-8d8b-4c7ee5f9f111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23344b405d5b4ed0a9a5d05dd9bf81cf'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:49.363242 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c50449-280c-4e9e-b925-731731d3705a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:49.369128 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e9977-8009-41f4-93c4-144dcc2a2c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:49.369888 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e9977-8009-41f4-93c4-144dcc2a2c42 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:49.370310 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e9977-8009-41f4-93c4-144dcc2a2c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:49.370676 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e9977-8009-41f4-93c4-144dcc2a2c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:49.371618 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e9977-8009-41f4-93c4-144dcc2a2c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:49.373252 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-9db7702c-1abf-476d-8d8b-4c7ee5f9f111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23344b405d5b4ed0a9a5d05dd9bf81cf'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:49.373733 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e9977-8009-41f4-93c4-144dcc2a2c42 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:49.390090 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-9db7702c-1abf-476d-8d8b-4c7ee5f9f111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23344b405d5b4ed0a9a5d05dd9bf81cf'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:49.392083 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-9db7702c-1abf-476d-8d8b-4c7ee5f9f111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23344b405d5b4ed0a9a5d05dd9bf81cf'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:49.392944 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-9db7702c-1abf-476d-8d8b-4c7ee5f9f111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23344b405d5b4ed0a9a5d05dd9bf81cf'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:49.423746 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1053/2086] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:49 2022] DELETE /identity/v3/users/23344b405d5b4ed0a9a5d05dd9bf81cf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:49.441528 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7702c-1abf-476d-8d8b-4c7ee5f9f111 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:49.443098 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-9db7702c-1abf-476d-8d8b-4c7ee5f9f111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:49.448837 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1034/2087] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:49 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:49.449716 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e9977-8009-41f4-93c4-144dcc2a2c42 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:49.461959 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-2d0e9977-8009-41f4-93c4-144dcc2a2c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:49.604356 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7702c-1abf-476d-8d8b-4c7ee5f9f111 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:49.611827 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e9977-8009-41f4-93c4-144dcc2a2c42 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:49.629065 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f8917-0c27-4791-8f04-193c39902b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:49.629764 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f8917-0c27-4791-8f04-193c39902b19 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:49.630042 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f8917-0c27-4791-8f04-193c39902b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:49.630313 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f8917-0c27-4791-8f04-193c39902b19 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:49.633238 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f8917-0c27-4791-8f04-193c39902b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:49.647090 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f8917-0c27-4791-8f04-193c39902b19 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:49.673585 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1bf90-602f-4e24-a7df-af6881d88dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:49.674134 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1bf90-602f-4e24-a7df-af6881d88dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:49.674437 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1bf90-602f-4e24-a7df-af6881d88dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:49.674733 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1bf90-602f-4e24-a7df-af6881d88dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:49.677767 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-aee1bf90-602f-4e24-a7df-af6881d88dc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:49.692566 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1035/2088] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:49 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:49.697974 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f8917-0c27-4791-8f04-193c39902b19 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:49.713638 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f8917-0c27-4791-8f04-193c39902b19 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:49.724230 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ffdae-237a-4bde-ae4e-53e0ebd4701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:49.725335 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ffdae-237a-4bde-ae4e-53e0ebd4701b admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:49.725718 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ffdae-237a-4bde-ae4e-53e0ebd4701b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:49.726255 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ffdae-237a-4bde-ae4e-53e0ebd4701b admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:49.727227 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ffdae-237a-4bde-ae4e-53e0ebd4701b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:49.756191 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ffdae-237a-4bde-ae4e-53e0ebd4701b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:49.777539 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1bf90-602f-4e24-a7df-af6881d88dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:49.779485 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1bf90-602f-4e24-a7df-af6881d88dc2 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:49.785825 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1036/2089] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:49.790341 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ffdae-237a-4bde-ae4e-53e0ebd4701b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:49.791605 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1054/2090] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:49 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:48:49.817391 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ffdae-237a-4bde-ae4e-53e0ebd4701b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:49.830691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11140f-bd61-4bd2-8d91-a4341a6e4ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:49.831392 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11140f-bd61-4bd2-8d91-a4341a6e4ecf admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:49.831816 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11140f-bd61-4bd2-8d91-a4341a6e4ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:49.834279 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11140f-bd61-4bd2-8d91-a4341a6e4ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:49.835127 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11140f-bd61-4bd2-8d91-a4341a6e4ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:49.841446 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11140f-bd61-4bd2-8d91-a4341a6e4ecf admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:49.855980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1037/2091] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:49.860213 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1bf90-602f-4e24-a7df-af6881d88dc2 service cinder] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:49.876680 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1bf90-602f-4e24-a7df-af6881d88dc2 service cinder] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:49.890223 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fab665-8642-469a-84f9-4baecf9b264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:49.891247 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fab665-8642-469a-84f9-4baecf9b264b admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:49.891632 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fab665-8642-469a-84f9-4baecf9b264b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:49.891979 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fab665-8642-469a-84f9-4baecf9b264b admin admin] PATH_INFO: `/v3/projects/42f048bd448f467aa0b37935d03a60e9/users/9bbc10f093cd4a3f9de4d874cfa8b831/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:49.908453 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fab665-8642-469a-84f9-4baecf9b264b admin admin] RBAC: Authorizing `identity:create_grant(project_id=42f048bd448f467aa0b37935d03a60e9, user_id=9bbc10f093cd4a3f9de4d874cfa8b831, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:49.911423 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fab665-8642-469a-84f9-4baecf9b264b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:49.928377 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1055/2092] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:49 2022] PUT /identity/v3/projects/42f048bd448f467aa0b37935d03a60e9/users/9bbc10f093cd4a3f9de4d874cfa8b831/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:49.933325 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d0560-09d3-4844-ae7c-705ff44aa82f None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:49.933837 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d0560-09d3-4844-ae7c-705ff44aa82f None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:49.934408 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d0560-09d3-4844-ae7c-705ff44aa82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:49.955003 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-572d0560-09d3-4844-ae7c-705ff44aa82f None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:49.957306 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-572d0560-09d3-4844-ae7c-705ff44aa82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:50.030099 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1038/2093] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:50.044368 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fab665-8642-469a-84f9-4baecf9b264b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:50.047112 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b2fab665-8642-469a-84f9-4baecf9b264b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:50.121151 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fab665-8642-469a-84f9-4baecf9b264b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:50.121493 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d0560-09d3-4844-ae7c-705ff44aa82f None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:50.123991 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-572d0560-09d3-4844-ae7c-705ff44aa82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:50.125970 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf31ca-ed82-493d-8a7e-7df22399203f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:50.136448 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf31ca-ed82-493d-8a7e-7df22399203f service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:50.136963 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf31ca-ed82-493d-8a7e-7df22399203f service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:50.137469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf31ca-ed82-493d-8a7e-7df22399203f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:50.151587 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d0560-09d3-4844-ae7c-705ff44aa82f None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:50.154221 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf31ca-ed82-493d-8a7e-7df22399203f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:50.155711 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf31ca-ed82-493d-8a7e-7df22399203f service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:50.158936 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3857f-de9b-4c17-b77d-cb8a8860dd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:50.160879 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3857f-de9b-4c17-b77d-cb8a8860dd1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:50.161428 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3857f-de9b-4c17-b77d-cb8a8860dd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:50.161899 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3857f-de9b-4c17-b77d-cb8a8860dd1f admin admin] PATH_INFO: `/v3/projects/d5d9d7d268a84d41a4ae8da3e0eb71e3` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:50.163900 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3857f-de9b-4c17-b77d-cb8a8860dd1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d9d7d268a84d41a4ae8da3e0eb71e3)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:50.167316 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3857f-de9b-4c17-b77d-cb8a8860dd1f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:50.179665 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1056/2094] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:50.305349 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d7b3857f-de9b-4c17-b77d-cb8a8860dd1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d9d7d268a84d41a4ae8da3e0eb71e3', 'request_id': 'req-d7b3857f-de9b-4c17-b77d-cb8a8860dd1f'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:50.318214 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d7b3857f-de9b-4c17-b77d-cb8a8860dd1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d9d7d268a84d41a4ae8da3e0eb71e3', 'request_id': 'req-d7b3857f-de9b-4c17-b77d-cb8a8860dd1f'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:50.328631 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d7b3857f-de9b-4c17-b77d-cb8a8860dd1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d9d7d268a84d41a4ae8da3e0eb71e3', 'request_id': 'req-d7b3857f-de9b-4c17-b77d-cb8a8860dd1f'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:50.348479 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d7b3857f-de9b-4c17-b77d-cb8a8860dd1f admin admin] The token cache is being invalidate because project d5d9d7d268a84d41a4ae8da3e0eb71e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:50.348883 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d7b3857f-de9b-4c17-b77d-cb8a8860dd1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:50.351256 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d7b3857f-de9b-4c17-b77d-cb8a8860dd1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:50.353328 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1039/2095] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:50 2022] DELETE /identity/v3/projects/d5d9d7d268a84d41a4ae8da3e0eb71e3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:50.360121 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be0d4-f752-46a3-99df-cc0bee60aed8 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:50.360642 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be0d4-f752-46a3-99df-cc0bee60aed8 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:50.360642 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078be0d4-f752-46a3-99df-cc0bee60aed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:50.390952 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-078be0d4-f752-46a3-99df-cc0bee60aed8 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:50.393135 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-078be0d4-f752-46a3-99df-cc0bee60aed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:50.461164 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1057/2096] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:50.469399 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd8d6a-4447-4a46-a715-08923ae76a6c None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:50.469823 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd8d6a-4447-4a46-a715-08923ae76a6c None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:50.470149 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd8d6a-4447-4a46-a715-08923ae76a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:50.489001 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-cefd8d6a-4447-4a46-a715-08923ae76a6c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:50.490201 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-cefd8d6a-4447-4a46-a715-08923ae76a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:50.500405 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1040/2097] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:50.504938 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078be0d4-f752-46a3-99df-cc0bee60aed8 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:50.514863 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078be0d4-f752-46a3-99df-cc0bee60aed8 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:50.520727 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc990c-36c6-4ac5-8dfc-7f0d97d7a34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:50.521765 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc990c-36c6-4ac5-8dfc-7f0d97d7a34c admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:50.522054 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc990c-36c6-4ac5-8dfc-7f0d97d7a34c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:50.522331 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc990c-36c6-4ac5-8dfc-7f0d97d7a34c admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:50.523087 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc990c-36c6-4ac5-8dfc-7f0d97d7a34c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:48:50.523391 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc990c-36c6-4ac5-8dfc-7f0d97d7a34c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:50.525094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc990c-36c6-4ac5-8dfc-7f0d97d7a34c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:50.542324 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1058/2098] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:48:50.543688 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd8d6a-4447-4a46-a715-08923ae76a6c None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:50.554446 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd8d6a-4447-4a46-a715-08923ae76a6c None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:50.561326 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d0388-7827-4f34-bc53-60c2541d94bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:50.561930 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d0388-7827-4f34-bc53-60c2541d94bb admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:50.562205 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d0388-7827-4f34-bc53-60c2541d94bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:50.562461 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d0388-7827-4f34-bc53-60c2541d94bb admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:50.563245 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d0388-7827-4f34-bc53-60c2541d94bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:50.565417 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d0388-7827-4f34-bc53-60c2541d94bb admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:50.602408 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1041/2099] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:50 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:50.610498 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc990c-36c6-4ac5-8dfc-7f0d97d7a34c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:50.623369 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc990c-36c6-4ac5-8dfc-7f0d97d7a34c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:50.721753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5429c1-c05d-4d39-95ec-aa5b14cb54ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:50.724897 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5429c1-c05d-4d39-95ec-aa5b14cb54ec admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:50.725409 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5429c1-c05d-4d39-95ec-aa5b14cb54ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:50.725790 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5429c1-c05d-4d39-95ec-aa5b14cb54ec admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:50.727987 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5429c1-c05d-4d39-95ec-aa5b14cb54ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:50.731086 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5429c1-c05d-4d39-95ec-aa5b14cb54ec admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:50.775783 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1059/2100] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:50 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:48:50.779730 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d0388-7827-4f34-bc53-60c2541d94bb admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:50.803358 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d0388-7827-4f34-bc53-60c2541d94bb admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:50.808875 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff12cd-a656-4464-8ccb-c2ec4bcb7255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:50.809559 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff12cd-a656-4464-8ccb-c2ec4bcb7255 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:50.809837 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff12cd-a656-4464-8ccb-c2ec4bcb7255 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:50.810116 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff12cd-a656-4464-8ccb-c2ec4bcb7255 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:50.811204 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff12cd-a656-4464-8ccb-c2ec4bcb7255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:50.812960 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff12cd-a656-4464-8ccb-c2ec4bcb7255 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:50.830964 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1042/2101] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:50.832832 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5429c1-c05d-4d39-95ec-aa5b14cb54ec admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:50.844631 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5429c1-c05d-4d39-95ec-aa5b14cb54ec admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:50.850075 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5772e4b-65f8-45b1-9f66-3313eddd35e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:50.851048 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5772e4b-65f8-45b1-9f66-3313eddd35e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:50.851591 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5772e4b-65f8-45b1-9f66-3313eddd35e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:50.852086 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5772e4b-65f8-45b1-9f66-3313eddd35e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:50.853190 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5772e4b-65f8-45b1-9f66-3313eddd35e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:50.855029 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5772e4b-65f8-45b1-9f66-3313eddd35e9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:50.878740 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1060/2102] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:50.884875 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff12cd-a656-4464-8ccb-c2ec4bcb7255 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:50.903869 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff12cd-a656-4464-8ccb-c2ec4bcb7255 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:50.910613 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0988704-9a2e-4e77-98ee-ffd2b51c681f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:50.911863 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0988704-9a2e-4e77-98ee-ffd2b51c681f admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:50.912202 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0988704-9a2e-4e77-98ee-ffd2b51c681f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:50.912480 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0988704-9a2e-4e77-98ee-ffd2b51c681f admin admin] PATH_INFO: `/v3/projects/e9b01dad6c93486fb7b38f4531a85c9b/users/bd2cd4a0dfc2451aa4bc4147d412b8d3/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:50.942668 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0988704-9a2e-4e77-98ee-ffd2b51c681f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9b01dad6c93486fb7b38f4531a85c9b, user_id=bd2cd4a0dfc2451aa4bc4147d412b8d3, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:50.946503 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0988704-9a2e-4e77-98ee-ffd2b51c681f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:50.984488 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1043/2103] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:50 2022] PUT /identity/v3/projects/e9b01dad6c93486fb7b38f4531a85c9b/users/bd2cd4a0dfc2451aa4bc4147d412b8d3/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:50.996690 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dae99c-f90e-45ec-b128-6a8397e3dc54 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:50.997062 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dae99c-f90e-45ec-b128-6a8397e3dc54 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:50.998269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dae99c-f90e-45ec-b128-6a8397e3dc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:51.039986 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-26dae99c-f90e-45ec-b128-6a8397e3dc54 None None] MFA Rules not processed for user `bd2cd4a0dfc2451aa4bc4147d412b8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:51.041592 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-26dae99c-f90e-45ec-b128-6a8397e3dc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:51.219451 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1061/2104] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:51.230976 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0988704-9a2e-4e77-98ee-ffd2b51c681f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:51.232989 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-a0988704-9a2e-4e77-98ee-ffd2b51c681f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:51.322638 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0988704-9a2e-4e77-98ee-ffd2b51c681f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:51.327571 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a74376-770c-4345-ad06-521cba58befb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:51.333775 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a74376-770c-4345-ad06-521cba58befb service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:51.334064 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a74376-770c-4345-ad06-521cba58befb service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:51.337110 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a74376-770c-4345-ad06-521cba58befb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:51.368554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a74376-770c-4345-ad06-521cba58befb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:51.370278 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a74376-770c-4345-ad06-521cba58befb service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:51.396809 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1044/2105] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:53.079192 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dae99c-f90e-45ec-b128-6a8397e3dc54 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:53.080636 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-26dae99c-f90e-45ec-b128-6a8397e3dc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:53.211647 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dae99c-f90e-45ec-b128-6a8397e3dc54 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:53.216351 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a04ac7-2ef1-43fd-8563-0fc7b5bb4cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:53.217383 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a04ac7-2ef1-43fd-8563-0fc7b5bb4cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:53.217762 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a04ac7-2ef1-43fd-8563-0fc7b5bb4cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:53.218068 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a04ac7-2ef1-43fd-8563-0fc7b5bb4cb8 admin admin] PATH_INFO: `/v3/users/9849dc3d64cc44739ec127b431c673a8` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:53.219592 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a04ac7-2ef1-43fd-8563-0fc7b5bb4cb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9849dc3d64cc44739ec127b431c673a8)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:53.238431 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a04ac7-2ef1-43fd-8563-0fc7b5bb4cb8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:53.306762 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-20a04ac7-2ef1-43fd-8563-0fc7b5bb4cb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9849dc3d64cc44739ec127b431c673a8'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:53.321519 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-20a04ac7-2ef1-43fd-8563-0fc7b5bb4cb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9849dc3d64cc44739ec127b431c673a8'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:53.335788 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-20a04ac7-2ef1-43fd-8563-0fc7b5bb4cb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9849dc3d64cc44739ec127b431c673a8'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:53.336512 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-20a04ac7-2ef1-43fd-8563-0fc7b5bb4cb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9849dc3d64cc44739ec127b431c673a8'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:53.337142 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-20a04ac7-2ef1-43fd-8563-0fc7b5bb4cb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9849dc3d64cc44739ec127b431c673a8'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:53.381899 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1062/2106] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:53 2022] DELETE /identity/v3/users/9849dc3d64cc44739ec127b431c673a8 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:53.384129 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124457b-a632-455b-9e07-a4380addf583 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:53.385087 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124457b-a632-455b-9e07-a4380addf583 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:53.386158 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124457b-a632-455b-9e07-a4380addf583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:53.417955 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-f124457b-a632-455b-9e07-a4380addf583 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:53.419407 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-f124457b-a632-455b-9e07-a4380addf583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:53.508150 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1045/2107] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:53.518097 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a04ac7-2ef1-43fd-8563-0fc7b5bb4cb8 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:53.519948 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-20a04ac7-2ef1-43fd-8563-0fc7b5bb4cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:53.593633 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a04ac7-2ef1-43fd-8563-0fc7b5bb4cb8 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:53.597691 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaba207-7eaa-4b49-98e9-394f56825d74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:53.598485 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaba207-7eaa-4b49-98e9-394f56825d74 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:53.598622 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaba207-7eaa-4b49-98e9-394f56825d74 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:53.598902 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaba207-7eaa-4b49-98e9-394f56825d74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:53.610714 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaba207-7eaa-4b49-98e9-394f56825d74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:53.612461 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaba207-7eaa-4b49-98e9-394f56825d74 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:53.625865 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1063/2108] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:53.915502 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124457b-a632-455b-9e07-a4380addf583 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:53.916994 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-f124457b-a632-455b-9e07-a4380addf583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:53.929585 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124457b-a632-455b-9e07-a4380addf583 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:53.936017 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c11266-362e-494d-948d-f23ce77dab58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:53.936930 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c11266-362e-494d-948d-f23ce77dab58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:53.937207 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c11266-362e-494d-948d-f23ce77dab58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:53.937478 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c11266-362e-494d-948d-f23ce77dab58 admin admin] PATH_INFO: `/v3/projects/50ecb556789f4496acf8778d25e70087` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:53.938718 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c11266-362e-494d-948d-f23ce77dab58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50ecb556789f4496acf8778d25e70087)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:53.940670 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c11266-362e-494d-948d-f23ce77dab58 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:54.002206 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a8c11266-362e-494d-948d-f23ce77dab58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50ecb556789f4496acf8778d25e70087', 'request_id': 'req-a8c11266-362e-494d-948d-f23ce77dab58'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:54.012685 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a8c11266-362e-494d-948d-f23ce77dab58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50ecb556789f4496acf8778d25e70087', 'request_id': 'req-a8c11266-362e-494d-948d-f23ce77dab58'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:54.021387 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a8c11266-362e-494d-948d-f23ce77dab58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50ecb556789f4496acf8778d25e70087', 'request_id': 'req-a8c11266-362e-494d-948d-f23ce77dab58'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:54.039371 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a8c11266-362e-494d-948d-f23ce77dab58 admin admin] The token cache is being invalidate because project 50ecb556789f4496acf8778d25e70087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:54.039772 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a8c11266-362e-494d-948d-f23ce77dab58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:54.040433 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a8c11266-362e-494d-948d-f23ce77dab58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:54.042446 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1046/2109] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:53 2022] DELETE /identity/v3/projects/50ecb556789f4496acf8778d25e70087 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:54.047454 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaba207-7eaa-4b49-98e9-394f56825d74 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:54.061563 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaba207-7eaa-4b49-98e9-394f56825d74 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:54.172650 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42049558-b98c-4a36-9019-ef4b3744c2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:54.175146 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42049558-b98c-4a36-9019-ef4b3744c2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:54.175657 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42049558-b98c-4a36-9019-ef4b3744c2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:54.176251 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42049558-b98c-4a36-9019-ef4b3744c2f6 admin admin] PATH_INFO: `/v3/users/54f2e398f7424881807ff82468ad2143` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:54.178712 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42049558-b98c-4a36-9019-ef4b3744c2f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f2e398f7424881807ff82468ad2143)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:54.181163 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42049558-b98c-4a36-9019-ef4b3744c2f6 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:54.267420 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-42049558-b98c-4a36-9019-ef4b3744c2f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f2e398f7424881807ff82468ad2143'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:54.281007 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c11266-362e-494d-948d-f23ce77dab58 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:54.289081 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-a8c11266-362e-494d-948d-f23ce77dab58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:54.291677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-42049558-b98c-4a36-9019-ef4b3744c2f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f2e398f7424881807ff82468ad2143'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:54.304955 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-42049558-b98c-4a36-9019-ef4b3744c2f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f2e398f7424881807ff82468ad2143'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:54.307980 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-42049558-b98c-4a36-9019-ef4b3744c2f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f2e398f7424881807ff82468ad2143'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:54.308218 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-42049558-b98c-4a36-9019-ef4b3744c2f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f2e398f7424881807ff82468ad2143'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:54.324343 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c11266-362e-494d-948d-f23ce77dab58 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:54.343664 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a20ac-327e-4517-9399-8152273ec8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:54.344670 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a20ac-327e-4517-9399-8152273ec8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:54.344887 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a20ac-327e-4517-9399-8152273ec8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:54.345113 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a20ac-327e-4517-9399-8152273ec8e9 admin admin] PATH_INFO: `/v3/users/bd2cd4a0dfc2451aa4bc4147d412b8d3` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:54.346890 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a20ac-327e-4517-9399-8152273ec8e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2cd4a0dfc2451aa4bc4147d412b8d3)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:54.351448 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a20ac-327e-4517-9399-8152273ec8e9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:54.359010 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1064/2110] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:54 2022] DELETE /identity/v3/users/54f2e398f7424881807ff82468ad2143 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:48:54.411658 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42049558-b98c-4a36-9019-ef4b3744c2f6 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:54.413287 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-42049558-b98c-4a36-9019-ef4b3744c2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:54.509270 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-691a20ac-327e-4517-9399-8152273ec8e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2cd4a0dfc2451aa4bc4147d412b8d3'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:54.510692 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-691a20ac-327e-4517-9399-8152273ec8e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2cd4a0dfc2451aa4bc4147d412b8d3'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:54.511927 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-691a20ac-327e-4517-9399-8152273ec8e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2cd4a0dfc2451aa4bc4147d412b8d3'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:54.544625 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-691a20ac-327e-4517-9399-8152273ec8e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2cd4a0dfc2451aa4bc4147d412b8d3'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:54.545289 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42049558-b98c-4a36-9019-ef4b3744c2f6 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:54.559094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d17409-d7b4-41ad-902f-fd21b123a5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:54.560322 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d17409-d7b4-41ad-902f-fd21b123a5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:54.561049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d17409-d7b4-41ad-902f-fd21b123a5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:54.561524 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d17409-d7b4-41ad-902f-fd21b123a5e4 admin admin] PATH_INFO: `/v3/users/4fdcf01cfab44b0b9b0c72c0dd08e1aa` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:54.563188 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d17409-d7b4-41ad-902f-fd21b123a5e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fdcf01cfab44b0b9b0c72c0dd08e1aa)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:54.566352 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-691a20ac-327e-4517-9399-8152273ec8e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2cd4a0dfc2451aa4bc4147d412b8d3'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:54.570280 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d17409-d7b4-41ad-902f-fd21b123a5e4 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:54.613360 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1047/2111] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:54 2022] DELETE /identity/v3/users/bd2cd4a0dfc2451aa4bc4147d412b8d3 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:54.619977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730958b5-0c37-46ce-bc15-a006de2fc706 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:54.620258 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730958b5-0c37-46ce-bc15-a006de2fc706 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:54.620530 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730958b5-0c37-46ce-bc15-a006de2fc706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:54.664797 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-730958b5-0c37-46ce-bc15-a006de2fc706 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:54.666385 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-730958b5-0c37-46ce-bc15-a006de2fc706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:54.669934 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-57d17409-d7b4-41ad-902f-fd21b123a5e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fdcf01cfab44b0b9b0c72c0dd08e1aa'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:54.684573 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-57d17409-d7b4-41ad-902f-fd21b123a5e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fdcf01cfab44b0b9b0c72c0dd08e1aa'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:54.702206 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-57d17409-d7b4-41ad-902f-fd21b123a5e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fdcf01cfab44b0b9b0c72c0dd08e1aa'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:54.703780 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-57d17409-d7b4-41ad-902f-fd21b123a5e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fdcf01cfab44b0b9b0c72c0dd08e1aa'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:54.706000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-57d17409-d7b4-41ad-902f-fd21b123a5e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fdcf01cfab44b0b9b0c72c0dd08e1aa'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:54.759102 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1065/2112] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:54 2022] DELETE /identity/v3/users/4fdcf01cfab44b0b9b0c72c0dd08e1aa => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:54.763547 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812096ef-05e4-449c-ab65-39ebcaf37586 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:54.764230 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812096ef-05e4-449c-ab65-39ebcaf37586 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:54.764629 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812096ef-05e4-449c-ab65-39ebcaf37586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:54.803905 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-812096ef-05e4-449c-ab65-39ebcaf37586 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:54.807382 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-812096ef-05e4-449c-ab65-39ebcaf37586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:54.829167 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1048/2113] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:54.874441 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730958b5-0c37-46ce-bc15-a006de2fc706 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:54.876393 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-730958b5-0c37-46ce-bc15-a006de2fc706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:54.964543 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1066/2114] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:55.022702 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812096ef-05e4-449c-ab65-39ebcaf37586 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:55.028391 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730958b5-0c37-46ce-bc15-a006de2fc706 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:55.143372 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8180c7-2ae1-4628-8e34-0055e749284a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:55.144313 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8180c7-2ae1-4628-8e34-0055e749284a service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:55.144948 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8180c7-2ae1-4628-8e34-0055e749284a service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:55.145130 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8180c7-2ae1-4628-8e34-0055e749284a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:55.161664 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8180c7-2ae1-4628-8e34-0055e749284a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:55.161939 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812096ef-05e4-449c-ab65-39ebcaf37586 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:55.163832 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8180c7-2ae1-4628-8e34-0055e749284a service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:55.176660 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1049/2115] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:55.176844 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab440cc-1482-452e-8301-f6e9a76a4706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:55.177560 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab440cc-1482-452e-8301-f6e9a76a4706 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:55.177916 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab440cc-1482-452e-8301-f6e9a76a4706 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:55.178193 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab440cc-1482-452e-8301-f6e9a76a4706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:55.191797 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab440cc-1482-452e-8301-f6e9a76a4706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:55.194651 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab440cc-1482-452e-8301-f6e9a76a4706 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:55.204144 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8180c7-2ae1-4628-8e34-0055e749284a service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:55.206293 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-8e8180c7-2ae1-4628-8e34-0055e749284a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:55.231966 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8180c7-2ae1-4628-8e34-0055e749284a service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:55.233348 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1067/2116] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:55.239575 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43ab31-cb2d-42d4-9cec-6ab542781023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:55.241295 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43ab31-cb2d-42d4-9cec-6ab542781023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:55.241731 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43ab31-cb2d-42d4-9cec-6ab542781023 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:55.242073 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43ab31-cb2d-42d4-9cec-6ab542781023 admin admin] PATH_INFO: `/v3/projects/a4f206734d404d248cc8692a80a1d4df` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:55.243794 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43ab31-cb2d-42d4-9cec-6ab542781023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4f206734d404d248cc8692a80a1d4df)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:55.246361 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43ab31-cb2d-42d4-9cec-6ab542781023 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:55.352969 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-cc43ab31-cb2d-42d4-9cec-6ab542781023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4f206734d404d248cc8692a80a1d4df', 'request_id': 'req-cc43ab31-cb2d-42d4-9cec-6ab542781023'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:55.369913 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-cc43ab31-cb2d-42d4-9cec-6ab542781023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4f206734d404d248cc8692a80a1d4df', 'request_id': 'req-cc43ab31-cb2d-42d4-9cec-6ab542781023'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:55.377261 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-cc43ab31-cb2d-42d4-9cec-6ab542781023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4f206734d404d248cc8692a80a1d4df', 'request_id': 'req-cc43ab31-cb2d-42d4-9cec-6ab542781023'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:55.399343 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-cc43ab31-cb2d-42d4-9cec-6ab542781023 admin admin] The token cache is being invalidate because project a4f206734d404d248cc8692a80a1d4df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:55.399698 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-cc43ab31-cb2d-42d4-9cec-6ab542781023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:55.400674 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-cc43ab31-cb2d-42d4-9cec-6ab542781023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:55.402460 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1050/2117] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:55 2022] DELETE /identity/v3/projects/a4f206734d404d248cc8692a80a1d4df => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:55.409496 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57239c19-8d59-40c3-9f62-d48f4cc3b505 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:55.409938 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57239c19-8d59-40c3-9f62-d48f4cc3b505 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:55.410201 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57239c19-8d59-40c3-9f62-d48f4cc3b505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:55.451318 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-57239c19-8d59-40c3-9f62-d48f4cc3b505 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:55.452509 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-57239c19-8d59-40c3-9f62-d48f4cc3b505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:55.558233 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1068/2118] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:55.560122 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0441ce-a966-4a1c-b455-e845927a2079 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:55.560961 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0441ce-a966-4a1c-b455-e845927a2079 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:55.561057 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0441ce-a966-4a1c-b455-e845927a2079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:55.594263 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-8e0441ce-a966-4a1c-b455-e845927a2079 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:55.596428 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-8e0441ce-a966-4a1c-b455-e845927a2079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:55.613273 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57239c19-8d59-40c3-9f62-d48f4cc3b505 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:55.614038 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1051/2119] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:55.625857 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57239c19-8d59-40c3-9f62-d48f4cc3b505 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:55.631421 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8964e6-ae19-4843-b743-b8f72f8013e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:55.632299 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8964e6-ae19-4843-b743-b8f72f8013e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:55.632689 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8964e6-ae19-4843-b743-b8f72f8013e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:55.633055 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8964e6-ae19-4843-b743-b8f72f8013e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:55.634659 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8964e6-ae19-4843-b743-b8f72f8013e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:48:55.635351 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8964e6-ae19-4843-b743-b8f72f8013e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:55.637320 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8964e6-ae19-4843-b743-b8f72f8013e7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:55.654688 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1069/2120] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:48:55.659973 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0441ce-a966-4a1c-b455-e845927a2079 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:55.672480 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0441ce-a966-4a1c-b455-e845927a2079 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:55.681813 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1137ef0-b322-4c76-8287-a37c8162d0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:55.682619 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1137ef0-b322-4c76-8287-a37c8162d0ad admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:55.683079 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1137ef0-b322-4c76-8287-a37c8162d0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:55.683451 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1137ef0-b322-4c76-8287-a37c8162d0ad admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:55.684348 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1137ef0-b322-4c76-8287-a37c8162d0ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:55.686994 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1137ef0-b322-4c76-8287-a37c8162d0ad admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:55.733032 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8964e6-ae19-4843-b743-b8f72f8013e7 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:55.734027 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1052/2121] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:55 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:55.745668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8964e6-ae19-4843-b743-b8f72f8013e7 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:55.825711 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdfb47-fe59-44cf-92fa-41850cfdd59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:55.826555 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdfb47-fe59-44cf-92fa-41850cfdd59c admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:55.827497 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdfb47-fe59-44cf-92fa-41850cfdd59c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:55.827497 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdfb47-fe59-44cf-92fa-41850cfdd59c admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:55.828372 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdfb47-fe59-44cf-92fa-41850cfdd59c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:55.830798 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdfb47-fe59-44cf-92fa-41850cfdd59c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:55.881307 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1137ef0-b322-4c76-8287-a37c8162d0ad admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:55.888577 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1070/2122] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:55 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:55.899093 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1137ef0-b322-4c76-8287-a37c8162d0ad admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:55.906634 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76513997-93e8-4426-aa27-234690b4b948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:55.907639 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76513997-93e8-4426-aa27-234690b4b948 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:55.908143 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76513997-93e8-4426-aa27-234690b4b948 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:55.908610 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76513997-93e8-4426-aa27-234690b4b948 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:55.909792 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76513997-93e8-4426-aa27-234690b4b948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:55.912463 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76513997-93e8-4426-aa27-234690b4b948 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:55.929257 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdfb47-fe59-44cf-92fa-41850cfdd59c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:55.939610 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1053/2123] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:55.941707 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdfb47-fe59-44cf-92fa-41850cfdd59c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:55.949114 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b9448-9d71-4f2c-b3b2-85fe65fbdddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:55.949917 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b9448-9d71-4f2c-b3b2-85fe65fbdddd admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:55.950266 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b9448-9d71-4f2c-b3b2-85fe65fbdddd admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:55.950638 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b9448-9d71-4f2c-b3b2-85fe65fbdddd admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:55.951536 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b9448-9d71-4f2c-b3b2-85fe65fbdddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:55.953790 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b9448-9d71-4f2c-b3b2-85fe65fbdddd admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:55.969150 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1071/2124] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:55.974257 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76513997-93e8-4426-aa27-234690b4b948 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:55.985899 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76513997-93e8-4426-aa27-234690b4b948 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:56.015930 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e8358-0a41-4ce5-8159-b825984b3c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:56.017049 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e8358-0a41-4ce5-8159-b825984b3c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:56.017504 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e8358-0a41-4ce5-8159-b825984b3c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:56.017923 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e8358-0a41-4ce5-8159-b825984b3c15 admin admin] PATH_INFO: `/v3/projects/0947d56a9556441f8d8aec6e0958ef4f/users/b164879d4c6a44398cecc8c8b910e61b/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:56.028175 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b9448-9d71-4f2c-b3b2-85fe65fbdddd admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:56.030979 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-295b9448-9d71-4f2c-b3b2-85fe65fbdddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:56.069831 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b9448-9d71-4f2c-b3b2-85fe65fbdddd admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:56.088177 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5a5a3-3a7c-4bf6-a435-e797dbcd21f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:56.089070 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5a5a3-3a7c-4bf6-a435-e797dbcd21f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:56.089348 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5a5a3-3a7c-4bf6-a435-e797dbcd21f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:56.089609 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5a5a3-3a7c-4bf6-a435-e797dbcd21f8 admin admin] PATH_INFO: `/v3/projects/d46d76d53b5a4d8faeab7c9f4d3d1fc5` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:56.090351 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e8358-0a41-4ce5-8159-b825984b3c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0947d56a9556441f8d8aec6e0958ef4f, user_id=b164879d4c6a44398cecc8c8b910e61b, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:56.096827 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5a5a3-3a7c-4bf6-a435-e797dbcd21f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46d76d53b5a4d8faeab7c9f4d3d1fc5)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:56.099544 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5a5a3-3a7c-4bf6-a435-e797dbcd21f8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:56.103925 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e8358-0a41-4ce5-8159-b825984b3c15 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:56.143569 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1054/2125] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:55 2022] PUT /identity/v3/projects/0947d56a9556441f8d8aec6e0958ef4f/users/b164879d4c6a44398cecc8c8b910e61b/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:56.147018 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf3547-22b2-42db-8803-ff70eb78e025 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:56.147801 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf3547-22b2-42db-8803-ff70eb78e025 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:56.148071 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf3547-22b2-42db-8803-ff70eb78e025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:56.202978 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-4eaf3547-22b2-42db-8803-ff70eb78e025 None None] MFA Rules not processed for user `b164879d4c6a44398cecc8c8b910e61b`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:56.215269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-02d5a5a3-3a7c-4bf6-a435-e797dbcd21f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46d76d53b5a4d8faeab7c9f4d3d1fc5', 'request_id': 'req-02d5a5a3-3a7c-4bf6-a435-e797dbcd21f8'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:56.223013 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-02d5a5a3-3a7c-4bf6-a435-e797dbcd21f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46d76d53b5a4d8faeab7c9f4d3d1fc5', 'request_id': 'req-02d5a5a3-3a7c-4bf6-a435-e797dbcd21f8'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:56.225104 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-4eaf3547-22b2-42db-8803-ff70eb78e025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:56.255952 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-02d5a5a3-3a7c-4bf6-a435-e797dbcd21f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46d76d53b5a4d8faeab7c9f4d3d1fc5', 'request_id': 'req-02d5a5a3-3a7c-4bf6-a435-e797dbcd21f8'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:56.285767 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-02d5a5a3-3a7c-4bf6-a435-e797dbcd21f8 admin admin] The token cache is being invalidate because project d46d76d53b5a4d8faeab7c9f4d3d1fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:56.286058 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-02d5a5a3-3a7c-4bf6-a435-e797dbcd21f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:56.286726 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-02d5a5a3-3a7c-4bf6-a435-e797dbcd21f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:56.294516 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1072/2126] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:56 2022] DELETE /identity/v3/projects/d46d76d53b5a4d8faeab7c9f4d3d1fc5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:56.295479 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5a5a3-3a7c-4bf6-a435-e797dbcd21f8 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:56.298173 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-02d5a5a3-3a7c-4bf6-a435-e797dbcd21f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:56.407425 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1055/2127] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:56.415822 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf3547-22b2-42db-8803-ff70eb78e025 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:56.417355 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-4eaf3547-22b2-42db-8803-ff70eb78e025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:56.493059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5a5a3-3a7c-4bf6-a435-e797dbcd21f8 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:56.508946 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89bac5-4928-417c-85d1-20650c3fd8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:56.510316 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89bac5-4928-417c-85d1-20650c3fd8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:56.510863 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89bac5-4928-417c-85d1-20650c3fd8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:56.511144 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89bac5-4928-417c-85d1-20650c3fd8c6 admin admin] PATH_INFO: `/v3/users/84c50ff3f6d64c13a05ee4b0c2fcb730` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:56.513394 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89bac5-4928-417c-85d1-20650c3fd8c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84c50ff3f6d64c13a05ee4b0c2fcb730)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:56.527982 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89bac5-4928-417c-85d1-20650c3fd8c6 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:56.548865 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf3547-22b2-42db-8803-ff70eb78e025 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:56.558090 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892c772-a176-4254-9270-234868ec1e4e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f812f38c242d4530b3fc73013f66c9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:56.559163 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892c772-a176-4254-9270-234868ec1e4e service glance] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:56.559446 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892c772-a176-4254-9270-234868ec1e4e service glance] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:56.559752 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892c772-a176-4254-9270-234868ec1e4e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:56.577486 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892c772-a176-4254-9270-234868ec1e4e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:56.581227 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892c772-a176-4254-9270-234868ec1e4e service glance] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:56.596516 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1056/2128] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:56.598333 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892c772-a176-4254-9270-234868ec1e4e service glance] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:56.600408 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-b892c772-a176-4254-9270-234868ec1e4e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:56.619107 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892c772-a176-4254-9270-234868ec1e4e service glance] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:56.626825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5d89bac5-4928-417c-85d1-20650c3fd8c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84c50ff3f6d64c13a05ee4b0c2fcb730'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:56.629855 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb5c45-dbce-43e3-92a5-e5d28882f2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:56.631472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb5c45-dbce-43e3-92a5-e5d28882f2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:56.631955 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb5c45-dbce-43e3-92a5-e5d28882f2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:56.632238 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb5c45-dbce-43e3-92a5-e5d28882f2d1 admin admin] PATH_INFO: `/v3/projects/e9b01dad6c93486fb7b38f4531a85c9b` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:56.634644 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5d89bac5-4928-417c-85d1-20650c3fd8c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84c50ff3f6d64c13a05ee4b0c2fcb730'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:56.635327 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb5c45-dbce-43e3-92a5-e5d28882f2d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9b01dad6c93486fb7b38f4531a85c9b)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:56.639618 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb5c45-dbce-43e3-92a5-e5d28882f2d1 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:56.646026 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5d89bac5-4928-417c-85d1-20650c3fd8c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84c50ff3f6d64c13a05ee4b0c2fcb730'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:56.646724 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5d89bac5-4928-417c-85d1-20650c3fd8c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84c50ff3f6d64c13a05ee4b0c2fcb730'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:56.647403 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5d89bac5-4928-417c-85d1-20650c3fd8c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84c50ff3f6d64c13a05ee4b0c2fcb730'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:56.685039 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1073/2129] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:48:56 2022] DELETE /identity/v3/users/84c50ff3f6d64c13a05ee4b0c2fcb730 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:56.711411 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-efbb5c45-dbce-43e3-92a5-e5d28882f2d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9b01dad6c93486fb7b38f4531a85c9b', 'request_id': 'req-efbb5c45-dbce-43e3-92a5-e5d28882f2d1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:56.725736 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-efbb5c45-dbce-43e3-92a5-e5d28882f2d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9b01dad6c93486fb7b38f4531a85c9b', 'request_id': 'req-efbb5c45-dbce-43e3-92a5-e5d28882f2d1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:56.749725 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-efbb5c45-dbce-43e3-92a5-e5d28882f2d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9b01dad6c93486fb7b38f4531a85c9b', 'request_id': 'req-efbb5c45-dbce-43e3-92a5-e5d28882f2d1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:56.768485 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-efbb5c45-dbce-43e3-92a5-e5d28882f2d1 admin admin] The token cache is being invalidate because project e9b01dad6c93486fb7b38f4531a85c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:56.768813 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-efbb5c45-dbce-43e3-92a5-e5d28882f2d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:56.769810 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-efbb5c45-dbce-43e3-92a5-e5d28882f2d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:56.775432 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1057/2130] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:56 2022] DELETE /identity/v3/projects/e9b01dad6c93486fb7b38f4531a85c9b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:56.778535 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea226bca-808a-4bba-ae9c-f3ed2012ff84 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:56.779028 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea226bca-808a-4bba-ae9c-f3ed2012ff84 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:56.779607 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea226bca-808a-4bba-ae9c-f3ed2012ff84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:56.808563 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-ea226bca-808a-4bba-ae9c-f3ed2012ff84 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:56.810199 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ea226bca-808a-4bba-ae9c-f3ed2012ff84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:56.952490 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1074/2131] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:56.956681 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce66d5e-6abc-4ae9-9109-0b9b05052e5e None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:56.957198 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce66d5e-6abc-4ae9-9109-0b9b05052e5e None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:56.958468 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce66d5e-6abc-4ae9-9109-0b9b05052e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:56.984690 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-bce66d5e-6abc-4ae9-9109-0b9b05052e5e None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:56.986870 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-bce66d5e-6abc-4ae9-9109-0b9b05052e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:57.041371 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1058/2132] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:57.042379 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea226bca-808a-4bba-ae9c-f3ed2012ff84 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:57.069529 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea226bca-808a-4bba-ae9c-f3ed2012ff84 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:57.090973 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9402b-6dde-411a-bf2e-29cf35a69be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:57.094593 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9402b-6dde-411a-bf2e-29cf35a69be1 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:57.095181 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9402b-6dde-411a-bf2e-29cf35a69be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:57.096460 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9402b-6dde-411a-bf2e-29cf35a69be1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:57.098474 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9402b-6dde-411a-bf2e-29cf35a69be1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:48:57.101700 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9402b-6dde-411a-bf2e-29cf35a69be1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:57.104231 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9402b-6dde-411a-bf2e-29cf35a69be1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:57.142797 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1075/2133] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:48:57.145657 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce66d5e-6abc-4ae9-9109-0b9b05052e5e None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:57.164500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce66d5e-6abc-4ae9-9109-0b9b05052e5e None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:57.181858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc11d0-c248-46cf-844a-059957f5cb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:57.187967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc11d0-c248-46cf-844a-059957f5cb2f admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:57.188260 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc11d0-c248-46cf-844a-059957f5cb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:57.188966 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc11d0-c248-46cf-844a-059957f5cb2f admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:57.189272 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc11d0-c248-46cf-844a-059957f5cb2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:57.191683 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cc11d0-c248-46cf-844a-059957f5cb2f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:57.261704 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1059/2134] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:57 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:57.263999 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9402b-6dde-411a-bf2e-29cf35a69be1 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:57.283256 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9402b-6dde-411a-bf2e-29cf35a69be1 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:57.493553 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8468e-f5b4-4047-abff-22aefdf379bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:57.494272 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8468e-f5b4-4047-abff-22aefdf379bf admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:57.494561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8468e-f5b4-4047-abff-22aefdf379bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:57.494838 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8468e-f5b4-4047-abff-22aefdf379bf admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:57.495646 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8468e-f5b4-4047-abff-22aefdf379bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:57.497658 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8468e-f5b4-4047-abff-22aefdf379bf admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:57.513406 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc11d0-c248-46cf-844a-059957f5cb2f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:57.515470 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-11cc11d0-c248-46cf-844a-059957f5cb2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:57.529398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1076/2135] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:57 2022] POST /identity/v3/users => generated 284 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:57.534067 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8468e-f5b4-4047-abff-22aefdf379bf admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:57.543422 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc11d0-c248-46cf-844a-059957f5cb2f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:57.580249 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8468e-f5b4-4047-abff-22aefdf379bf admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:57.590618 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d2faf-163a-4064-af5a-7bfae9aeb33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:57.591886 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d2faf-163a-4064-af5a-7bfae9aeb33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:57.592171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d2faf-163a-4064-af5a-7bfae9aeb33e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:57.592445 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d2faf-163a-4064-af5a-7bfae9aeb33e admin admin] PATH_INFO: `/v3/projects/5ccbb6776ed64395b91cafb365c8fcd9` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:57.596699 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d2faf-163a-4064-af5a-7bfae9aeb33e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ccbb6776ed64395b91cafb365c8fcd9)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:57.599108 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d2faf-163a-4064-af5a-7bfae9aeb33e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:57.610810 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54252b-846b-463f-8d32-521022082bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:57.611654 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54252b-846b-463f-8d32-521022082bbf admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:57.612126 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54252b-846b-463f-8d32-521022082bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:57.612497 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54252b-846b-463f-8d32-521022082bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:57.613768 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54252b-846b-463f-8d32-521022082bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:57.615336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54252b-846b-463f-8d32-521022082bbf admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:57.644160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1077/2136] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:57.646061 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54252b-846b-463f-8d32-521022082bbf admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:57.666038 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54252b-846b-463f-8d32-521022082bbf admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:57.679096 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fb3b0-4c44-424e-abf2-67dae3f6a4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:57.679914 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fb3b0-4c44-424e-abf2-67dae3f6a4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:57.680262 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fb3b0-4c44-424e-abf2-67dae3f6a4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:57.680587 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fb3b0-4c44-424e-abf2-67dae3f6a4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:57.681423 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49fb3b0-4c44-424e-abf2-67dae3f6a4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:57.683047 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49fb3b0-4c44-424e-abf2-67dae3f6a4a0 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:57.702442 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-331d2faf-163a-4064-af5a-7bfae9aeb33e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ccbb6776ed64395b91cafb365c8fcd9', 'request_id': 'req-331d2faf-163a-4064-af5a-7bfae9aeb33e'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:57.708237 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1078/2137] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:57.709448 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fb3b0-4c44-424e-abf2-67dae3f6a4a0 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:57.723267 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49fb3b0-4c44-424e-abf2-67dae3f6a4a0 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:57.742621 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-331d2faf-163a-4064-af5a-7bfae9aeb33e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ccbb6776ed64395b91cafb365c8fcd9', 'request_id': 'req-331d2faf-163a-4064-af5a-7bfae9aeb33e'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:57.753054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-331d2faf-163a-4064-af5a-7bfae9aeb33e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ccbb6776ed64395b91cafb365c8fcd9', 'request_id': 'req-331d2faf-163a-4064-af5a-7bfae9aeb33e'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:57.788401 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-331d2faf-163a-4064-af5a-7bfae9aeb33e admin admin] The token cache is being invalidate because project 5ccbb6776ed64395b91cafb365c8fcd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:48:57.788966 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-331d2faf-163a-4064-af5a-7bfae9aeb33e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:57.789847 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-331d2faf-163a-4064-af5a-7bfae9aeb33e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:48:57.792014 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1060/2138] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:48:57 2022] DELETE /identity/v3/projects/5ccbb6776ed64395b91cafb365c8fcd9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:57.798287 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eed4e-7840-4255-996a-b11a547856a2 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:57.799401 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eed4e-7840-4255-996a-b11a547856a2 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:57.799893 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eed4e-7840-4255-996a-b11a547856a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:57.817773 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8343a-a741-43cc-92d5-f824830f183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:57.826548 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8343a-a741-43cc-92d5-f824830f183d admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:57.828846 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8343a-a741-43cc-92d5-f824830f183d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:57.829797 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8343a-a741-43cc-92d5-f824830f183d admin admin] PATH_INFO: `/v3/projects/65feacd0c25b473b9f36d5ae181cbeca/users/e4b91a6e1c1b4b5ba6c6a68bd28c827b/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:57.845538 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-4d7eed4e-7840-4255-996a-b11a547856a2 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:57.846795 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-4d7eed4e-7840-4255-996a-b11a547856a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:57.866643 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8343a-a741-43cc-92d5-f824830f183d admin admin] RBAC: Authorizing `identity:create_grant(project_id=65feacd0c25b473b9f36d5ae181cbeca, user_id=e4b91a6e1c1b4b5ba6c6a68bd28c827b, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:57.871589 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8343a-a741-43cc-92d5-f824830f183d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:57.879592 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1061/2139] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:57.886807 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18485f-e305-4c20-913e-74083b302f63 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:57.887094 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18485f-e305-4c20-913e-74083b302f63 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:57.887420 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18485f-e305-4c20-913e-74083b302f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:57.903975 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1079/2140] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:57 2022] PUT /identity/v3/projects/65feacd0c25b473b9f36d5ae181cbeca/users/e4b91a6e1c1b4b5ba6c6a68bd28c827b/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:57.919963 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e0a1d-1b64-49eb-b10d-27e3464bee31 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:57.920287 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e0a1d-1b64-49eb-b10d-27e3464bee31 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:57.920558 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e0a1d-1b64-49eb-b10d-27e3464bee31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:57.932615 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-fb18485f-e305-4c20-913e-74083b302f63 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:57.934705 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-fb18485f-e305-4c20-913e-74083b302f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:57.961518 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-c92e0a1d-1b64-49eb-b10d-27e3464bee31 None None] MFA Rules not processed for user `e4b91a6e1c1b4b5ba6c6a68bd28c827b`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:57.963221 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c92e0a1d-1b64-49eb-b10d-27e3464bee31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:58.064947 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1062/2141] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:48:58.072172 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7278ee0-5ae8-4edf-a37d-6c9624e09938 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:58.072623 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7278ee0-5ae8-4edf-a37d-6c9624e09938 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:58.075502 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7278ee0-5ae8-4edf-a37d-6c9624e09938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:58.098971 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1080/2142] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:58.100918 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e0a1d-1b64-49eb-b10d-27e3464bee31 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:58.112073 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-c7278ee0-5ae8-4edf-a37d-6c9624e09938 None None] MFA Rules not processed for user `9bbc10f093cd4a3f9de4d874cfa8b831`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:58.114104 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-c7278ee0-5ae8-4edf-a37d-6c9624e09938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:58.114235 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e0a1d-1b64-49eb-b10d-27e3464bee31 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:58.119980 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec2e04-389e-4f1a-8959-0540a6fdd674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:58.120677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec2e04-389e-4f1a-8959-0540a6fdd674 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:58.121337 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec2e04-389e-4f1a-8959-0540a6fdd674 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:58.121610 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec2e04-389e-4f1a-8959-0540a6fdd674 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:58.122366 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec2e04-389e-4f1a-8959-0540a6fdd674 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:48:58.122668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec2e04-389e-4f1a-8959-0540a6fdd674 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:58.124762 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec2e04-389e-4f1a-8959-0540a6fdd674 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:58.143667 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1081/2143] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:48:58.143667 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec2e04-389e-4f1a-8959-0540a6fdd674 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:58.144463 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-e1ec2e04-389e-4f1a-8959-0540a6fdd674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:58.213831 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1063/2144] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:58.214754 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7278ee0-5ae8-4edf-a37d-6c9624e09938 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:58.222266 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec2e04-389e-4f1a-8959-0540a6fdd674 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:58.226426 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c69965-3619-4b6a-afa5-234229632767 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f812f38c242d4530b3fc73013f66c9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:58.227785 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c69965-3619-4b6a-afa5-234229632767 service glance] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:58.228136 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c69965-3619-4b6a-afa5-234229632767 service glance] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:58.228471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c69965-3619-4b6a-afa5-234229632767 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:58.237262 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7278ee0-5ae8-4edf-a37d-6c9624e09938 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:58.242947 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c69965-3619-4b6a-afa5-234229632767 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:58.244707 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c69965-3619-4b6a-afa5-234229632767 service glance] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:58.245409 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845f727-ad39-4e80-9d16-dba1861873a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:58.246148 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845f727-ad39-4e80-9d16-dba1861873a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:58.246430 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845f727-ad39-4e80-9d16-dba1861873a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:58.246700 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845f727-ad39-4e80-9d16-dba1861873a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:58.247415 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845f727-ad39-4e80-9d16-dba1861873a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:58.249404 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845f727-ad39-4e80-9d16-dba1861873a5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:58.276026 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1082/2145] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:58.278345 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c69965-3619-4b6a-afa5-234229632767 service glance] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:58.281364 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-e7c69965-3619-4b6a-afa5-234229632767 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:58.287830 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1064/2146] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:48:58 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:48:58.292118 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845f727-ad39-4e80-9d16-dba1861873a5 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:58.414393 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c69965-3619-4b6a-afa5-234229632767 service glance] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:58.420284 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845f727-ad39-4e80-9d16-dba1861873a5 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:58.427346 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95b073-f09c-4666-b6f2-d3d8c02d4396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:58.428071 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95b073-f09c-4666-b6f2-d3d8c02d4396 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:58.428347 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95b073-f09c-4666-b6f2-d3d8c02d4396 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:58.428614 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95b073-f09c-4666-b6f2-d3d8c02d4396 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:58.429603 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95b073-f09c-4666-b6f2-d3d8c02d4396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:58.433123 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95b073-f09c-4666-b6f2-d3d8c02d4396 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:58.464830 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1065/2147] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:48:58 2022] POST /identity/v3/users => generated 284 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:48:58.475892 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95b073-f09c-4666-b6f2-d3d8c02d4396 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:58.512598 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95b073-f09c-4666-b6f2-d3d8c02d4396 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:58.525729 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090aa4d2-23a2-4238-960b-023041729455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:58.526306 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090aa4d2-23a2-4238-960b-023041729455 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:58.527415 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090aa4d2-23a2-4238-960b-023041729455 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:58.527415 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090aa4d2-23a2-4238-960b-023041729455 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:58.527738 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090aa4d2-23a2-4238-960b-023041729455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:58.529292 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090aa4d2-23a2-4238-960b-023041729455 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:58.567210 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1066/2148] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:58.575382 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090aa4d2-23a2-4238-960b-023041729455 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:58.591916 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090aa4d2-23a2-4238-960b-023041729455 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:58.592977 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87db90-03ce-469e-8a9d-dafc70402bb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:58.593710 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87db90-03ce-469e-8a9d-dafc70402bb2 service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:58.594074 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87db90-03ce-469e-8a9d-dafc70402bb2 service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:58.594349 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87db90-03ce-469e-8a9d-dafc70402bb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:58.604844 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad74020-7d5d-4a06-b867-910e31bd44f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:58.606653 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad74020-7d5d-4a06-b867-910e31bd44f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:58.607093 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad74020-7d5d-4a06-b867-910e31bd44f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:58.607790 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad74020-7d5d-4a06-b867-910e31bd44f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:58.611617 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad74020-7d5d-4a06-b867-910e31bd44f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:58.613490 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad74020-7d5d-4a06-b867-910e31bd44f2 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:58.650817 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1067/2149] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:48:58.655465 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad74020-7d5d-4a06-b867-910e31bd44f2 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:58.676347 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87db90-03ce-469e-8a9d-dafc70402bb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:58.678840 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87db90-03ce-469e-8a9d-dafc70402bb2 service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:58.678965 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad74020-7d5d-4a06-b867-910e31bd44f2 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:58.693124 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ac7d3-8ae7-4225-83be-d9f7807d9cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:58.694071 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ac7d3-8ae7-4225-83be-d9f7807d9cff admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:58.694375 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ac7d3-8ae7-4225-83be-d9f7807d9cff admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:58.694644 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ac7d3-8ae7-4225-83be-d9f7807d9cff admin admin] PATH_INFO: `/v3/projects/4681904d2b064a288df52876cff36041/users/104102203672497e881cbbebfb991716/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:58.746556 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1083/2150] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:58.750229 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ac7d3-8ae7-4225-83be-d9f7807d9cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4681904d2b064a288df52876cff36041, user_id=104102203672497e881cbbebfb991716, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:58.757839 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ac7d3-8ae7-4225-83be-d9f7807d9cff admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:58.803792 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1068/2151] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:48:58 2022] PUT /identity/v3/projects/4681904d2b064a288df52876cff36041/users/104102203672497e881cbbebfb991716/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:48:58.808125 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ff410-0c12-4614-9e68-f2c32300d1fb None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:58.808517 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ff410-0c12-4614-9e68-f2c32300d1fb None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:58.808839 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ff410-0c12-4614-9e68-f2c32300d1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:58.855171 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-b99ff410-0c12-4614-9e68-f2c32300d1fb None None] MFA Rules not processed for user `104102203672497e881cbbebfb991716`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:58.856832 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b99ff410-0c12-4614-9e68-f2c32300d1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:59.017404 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1084/2152] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:48:59.038795 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ac7d3-8ae7-4225-83be-d9f7807d9cff admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:48:59.122559 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ac7d3-8ae7-4225-83be-d9f7807d9cff admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:48:59.128819 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c58b2b0-db74-46fc-8771-782dfaff6e66 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f812f38c242d4530b3fc73013f66c9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:48:59.129478 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58b2b0-db74-46fc-8771-782dfaff6e66 service glance] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:59.129755 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58b2b0-db74-46fc-8771-782dfaff6e66 service glance] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:59.130019 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c58b2b0-db74-46fc-8771-782dfaff6e66 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:59.145711 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58b2b0-db74-46fc-8771-782dfaff6e66 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:48:59.147478 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c58b2b0-db74-46fc-8771-782dfaff6e66 service glance] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:48:59.160702 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1069/2153] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:48:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:48:59.865235 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0098c-a969-45d0-98fc-43a7b79447ad None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:48:59.865771 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0098c-a969-45d0-98fc-43a7b79447ad None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:48:59.865771 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0098c-a969-45d0-98fc-43a7b79447ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:48:59.899914 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-c3d0098c-a969-45d0-98fc-43a7b79447ad None None] MFA Rules not processed for user `154d8ba69dce42fe85ae3a0ad7602bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:48:59.903324 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c3d0098c-a969-45d0-98fc-43a7b79447ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:48:59.999807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1085/2154] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:48:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:49:01.236772 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779b52d-3ddd-47e7-b7ef-0ddf57723f6d None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:01.237338 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779b52d-3ddd-47e7-b7ef-0ddf57723f6d None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:01.237338 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779b52d-3ddd-47e7-b7ef-0ddf57723f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:01.268143 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-9779b52d-3ddd-47e7-b7ef-0ddf57723f6d None None] MFA Rules not processed for user `9bbc10f093cd4a3f9de4d874cfa8b831`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:49:01.269641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9779b52d-3ddd-47e7-b7ef-0ddf57723f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:01.343196 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1070/2155] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:49:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:49:14.980164 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aee4d-ddac-40f2-a0b4-1735f9587956 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:14.980841 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aee4d-ddac-40f2-a0b4-1735f9587956 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:14.980841 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aee4d-ddac-40f2-a0b4-1735f9587956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:15.009648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-994aee4d-ddac-40f2-a0b4-1735f9587956 None None] MFA Rules not processed for user `0513eaec53d241f398508dec85f017d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:49:15.011381 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-994aee4d-ddac-40f2-a0b4-1735f9587956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:15.119551 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1086/2156] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:49:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:49:26.331500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779b52d-3ddd-47e7-b7ef-0ddf57723f6d None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:26.333226 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9779b52d-3ddd-47e7-b7ef-0ddf57723f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:26.410027 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779b52d-3ddd-47e7-b7ef-0ddf57723f6d None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:26.414477 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af476c-0989-42b0-a494-427a6438e3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:26.415420 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af476c-0989-42b0-a494-427a6438e3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:26.416071 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af476c-0989-42b0-a494-427a6438e3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:26.416071 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af476c-0989-42b0-a494-427a6438e3dd admin admin] PATH_INFO: `/v3/users/b164879d4c6a44398cecc8c8b910e61b` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:26.417227 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af476c-0989-42b0-a494-427a6438e3dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b164879d4c6a44398cecc8c8b910e61b)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:26.419146 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af476c-0989-42b0-a494-427a6438e3dd admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:26.468929 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d3af476c-0989-42b0-a494-427a6438e3dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b164879d4c6a44398cecc8c8b910e61b'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:26.469810 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d3af476c-0989-42b0-a494-427a6438e3dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b164879d4c6a44398cecc8c8b910e61b'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:26.471551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d3af476c-0989-42b0-a494-427a6438e3dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b164879d4c6a44398cecc8c8b910e61b'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:26.493926 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d3af476c-0989-42b0-a494-427a6438e3dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b164879d4c6a44398cecc8c8b910e61b'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:26.501446 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d3af476c-0989-42b0-a494-427a6438e3dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b164879d4c6a44398cecc8c8b910e61b'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:26.518849 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1071/2157] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:49:26 2022] DELETE /identity/v3/users/b164879d4c6a44398cecc8c8b910e61b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:49:26.523599 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f767f-b50c-46b1-b356-1208083f6fc5 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:26.524080 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f767f-b50c-46b1-b356-1208083f6fc5 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:26.524080 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f767f-b50c-46b1-b356-1208083f6fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:26.542103 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-d13f767f-b50c-46b1-b356-1208083f6fc5 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:49:26.543284 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d13f767f-b50c-46b1-b356-1208083f6fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:26.616564 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1087/2158] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:49:26.631472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af476c-0989-42b0-a494-427a6438e3dd admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:26.632940 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-d3af476c-0989-42b0-a494-427a6438e3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:26.711932 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af476c-0989-42b0-a494-427a6438e3dd admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:26.715650 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ac43e-ee7b-4f62-b28c-17a2dc7c52c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:26.716324 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ac43e-ee7b-4f62-b28c-17a2dc7c52c6 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:26.716593 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ac43e-ee7b-4f62-b28c-17a2dc7c52c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:26.716864 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ac43e-ee7b-4f62-b28c-17a2dc7c52c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:26.740731 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ac43e-ee7b-4f62-b28c-17a2dc7c52c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:26.742261 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ac43e-ee7b-4f62-b28c-17a2dc7c52c6 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:26.756069 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1072/2159] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:49:27.049497 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f767f-b50c-46b1-b356-1208083f6fc5 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:27.050986 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d13f767f-b50c-46b1-b356-1208083f6fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:27.065385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f767f-b50c-46b1-b356-1208083f6fc5 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:27.072442 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de36f9d-9ff3-438d-9c1b-ac22adcd5f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:27.073324 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de36f9d-9ff3-438d-9c1b-ac22adcd5f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:27.073600 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de36f9d-9ff3-438d-9c1b-ac22adcd5f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:27.073868 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de36f9d-9ff3-438d-9c1b-ac22adcd5f39 admin admin] PATH_INFO: `/v3/projects/0947d56a9556441f8d8aec6e0958ef4f` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:27.075081 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de36f9d-9ff3-438d-9c1b-ac22adcd5f39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0947d56a9556441f8d8aec6e0958ef4f)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:27.077320 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de36f9d-9ff3-438d-9c1b-ac22adcd5f39 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:27.140830 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3de36f9d-9ff3-438d-9c1b-ac22adcd5f39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0947d56a9556441f8d8aec6e0958ef4f', 'request_id': 'req-3de36f9d-9ff3-438d-9c1b-ac22adcd5f39'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:27.151753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3de36f9d-9ff3-438d-9c1b-ac22adcd5f39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0947d56a9556441f8d8aec6e0958ef4f', 'request_id': 'req-3de36f9d-9ff3-438d-9c1b-ac22adcd5f39'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:27.161891 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3de36f9d-9ff3-438d-9c1b-ac22adcd5f39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0947d56a9556441f8d8aec6e0958ef4f', 'request_id': 'req-3de36f9d-9ff3-438d-9c1b-ac22adcd5f39'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:27.185722 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3de36f9d-9ff3-438d-9c1b-ac22adcd5f39 admin admin] The token cache is being invalidate because project 0947d56a9556441f8d8aec6e0958ef4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:49:27.186017 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3de36f9d-9ff3-438d-9c1b-ac22adcd5f39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:27.191857 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3de36f9d-9ff3-438d-9c1b-ac22adcd5f39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:27.194803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1088/2160] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:49:27 2022] DELETE /identity/v3/projects/0947d56a9556441f8d8aec6e0958ef4f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:49:27.206584 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f8b98-608e-46ad-9755-a370582cd993 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:27.206868 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f8b98-608e-46ad-9755-a370582cd993 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:27.207149 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f8b98-608e-46ad-9755-a370582cd993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:27.227672 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-3c2f8b98-608e-46ad-9755-a370582cd993 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:49:27.229130 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-3c2f8b98-608e-46ad-9755-a370582cd993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:27.306478 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1073/2161] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:49:27.316029 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a50b1-d13a-4c29-bac1-cad1982c7b03 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:27.316531 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a50b1-d13a-4c29-bac1-cad1982c7b03 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:27.317562 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a50b1-d13a-4c29-bac1-cad1982c7b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:27.340206 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-b33a50b1-d13a-4c29-bac1-cad1982c7b03 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:49:27.341520 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b33a50b1-d13a-4c29-bac1-cad1982c7b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:27.351440 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1089/2162] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:49:27.356371 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f8b98-608e-46ad-9755-a370582cd993 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:27.368219 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f8b98-608e-46ad-9755-a370582cd993 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:27.373529 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38350abd-b4fa-4be6-b0eb-d88e3c59575b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:27.374700 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38350abd-b4fa-4be6-b0eb-d88e3c59575b admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:27.374700 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38350abd-b4fa-4be6-b0eb-d88e3c59575b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:27.374891 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38350abd-b4fa-4be6-b0eb-d88e3c59575b admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:27.375728 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38350abd-b4fa-4be6-b0eb-d88e3c59575b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:49:27.376088 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38350abd-b4fa-4be6-b0eb-d88e3c59575b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:27.377807 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38350abd-b4fa-4be6-b0eb-d88e3c59575b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:27.403699 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1074/2163] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:49:27.407713 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a50b1-d13a-4c29-bac1-cad1982c7b03 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:27.418894 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a50b1-d13a-4c29-bac1-cad1982c7b03 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:27.425201 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87089c89-ccb9-45bc-9af1-de9fde7d7b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:27.426337 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87089c89-ccb9-45bc-9af1-de9fde7d7b6e admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:27.426923 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87089c89-ccb9-45bc-9af1-de9fde7d7b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:27.427582 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87089c89-ccb9-45bc-9af1-de9fde7d7b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:27.428524 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87089c89-ccb9-45bc-9af1-de9fde7d7b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:27.431480 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87089c89-ccb9-45bc-9af1-de9fde7d7b6e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:27.472844 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1090/2164] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:49:27 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:49:27.473211 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38350abd-b4fa-4be6-b0eb-d88e3c59575b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:27.484956 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38350abd-b4fa-4be6-b0eb-d88e3c59575b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:27.568393 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5755f-81b4-4aa5-a7a3-ddd8dafc2c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:27.572251 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5755f-81b4-4aa5-a7a3-ddd8dafc2c52 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:27.572251 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5755f-81b4-4aa5-a7a3-ddd8dafc2c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:27.572251 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5755f-81b4-4aa5-a7a3-ddd8dafc2c52 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:27.572251 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5755f-81b4-4aa5-a7a3-ddd8dafc2c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:27.573127 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5755f-81b4-4aa5-a7a3-ddd8dafc2c52 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:27.599597 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1075/2165] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:49:27 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:49:27.603856 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87089c89-ccb9-45bc-9af1-de9fde7d7b6e admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:27.615303 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87089c89-ccb9-45bc-9af1-de9fde7d7b6e admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:27.620416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedb372-7667-4963-8817-7da33f96c8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:27.621264 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedb372-7667-4963-8817-7da33f96c8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:27.622543 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedb372-7667-4963-8817-7da33f96c8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:27.622648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedb372-7667-4963-8817-7da33f96c8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:27.623828 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fedb372-7667-4963-8817-7da33f96c8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:27.625685 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fedb372-7667-4963-8817-7da33f96c8d1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:27.636821 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1091/2166] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:49:27.641170 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5755f-81b4-4aa5-a7a3-ddd8dafc2c52 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:27.655618 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5755f-81b4-4aa5-a7a3-ddd8dafc2c52 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:27.660740 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a54948-a08a-4d20-bc4c-c02a89fae53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:27.661529 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a54948-a08a-4d20-bc4c-c02a89fae53a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:27.661791 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a54948-a08a-4d20-bc4c-c02a89fae53a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:27.662076 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a54948-a08a-4d20-bc4c-c02a89fae53a admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:27.666040 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a54948-a08a-4d20-bc4c-c02a89fae53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:27.666040 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a54948-a08a-4d20-bc4c-c02a89fae53a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:27.679142 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1076/2167] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:49:27.680363 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedb372-7667-4963-8817-7da33f96c8d1 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:27.691973 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedb372-7667-4963-8817-7da33f96c8d1 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:27.698305 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b99908-3c29-4d32-a0b9-6150cba91c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:27.699413 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b99908-3c29-4d32-a0b9-6150cba91c09 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:27.699726 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b99908-3c29-4d32-a0b9-6150cba91c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:27.700000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b99908-3c29-4d32-a0b9-6150cba91c09 admin admin] PATH_INFO: `/v3/projects/ffce67ba10f14f44a9f43e2d35b6b3d5/users/35cc6e060bd443a0a49af9a54da595b1/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:27.719453 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b99908-3c29-4d32-a0b9-6150cba91c09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffce67ba10f14f44a9f43e2d35b6b3d5, user_id=35cc6e060bd443a0a49af9a54da595b1, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:27.722188 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b99908-3c29-4d32-a0b9-6150cba91c09 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:27.740535 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1092/2168] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:49:27 2022] PUT /identity/v3/projects/ffce67ba10f14f44a9f43e2d35b6b3d5/users/35cc6e060bd443a0a49af9a54da595b1/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:49:27.753777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579988ad-1f0a-4954-a69a-b95f3655db21 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:27.754065 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579988ad-1f0a-4954-a69a-b95f3655db21 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:27.754340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579988ad-1f0a-4954-a69a-b95f3655db21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:27.789876 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-579988ad-1f0a-4954-a69a-b95f3655db21 None None] MFA Rules not processed for user `35cc6e060bd443a0a49af9a54da595b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:49:27.792284 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-579988ad-1f0a-4954-a69a-b95f3655db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:27.901484 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1077/2169] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:49:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:49:27.923049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b99908-3c29-4d32-a0b9-6150cba91c09 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:27.925700 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-67b99908-3c29-4d32-a0b9-6150cba91c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:27.995446 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b99908-3c29-4d32-a0b9-6150cba91c09 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:27.999817 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67093f81-c0db-47bd-94f5-8db3fbea6d05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:28.000469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67093f81-c0db-47bd-94f5-8db3fbea6d05 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:28.000754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67093f81-c0db-47bd-94f5-8db3fbea6d05 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:28.001034 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67093f81-c0db-47bd-94f5-8db3fbea6d05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:28.011932 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67093f81-c0db-47bd-94f5-8db3fbea6d05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:28.013399 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67093f81-c0db-47bd-94f5-8db3fbea6d05 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:28.025140 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1093/2170] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:49:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:49:41.037383 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b2b3b-e6f8-4b95-a982-328a796f18db None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:41.037942 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b2b3b-e6f8-4b95-a982-328a796f18db None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:41.037942 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b2b3b-e6f8-4b95-a982-328a796f18db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:41.057378 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-5f1b2b3b-e6f8-4b95-a982-328a796f18db None None] MFA Rules not processed for user `44e5602fd019411aa8f0e091ed533ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:49:41.058587 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5f1b2b3b-e6f8-4b95-a982-328a796f18db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:41.116695 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1078/2171] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jan 10 12:49:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:49:41.161568 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67093f81-c0db-47bd-94f5-8db3fbea6d05 service cinder] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:41.163145 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-67093f81-c0db-47bd-94f5-8db3fbea6d05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:41.241781 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67093f81-c0db-47bd-94f5-8db3fbea6d05 service cinder] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:41.248254 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135ffa2-c8ac-489a-8183-9d107b8c7f2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd898c7c2974bb38998ebad22fd5a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:41.248980 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135ffa2-c8ac-489a-8183-9d107b8c7f2a service swift] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:41.249296 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135ffa2-c8ac-489a-8183-9d107b8c7f2a service swift] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:41.249599 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135ffa2-c8ac-489a-8183-9d107b8c7f2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:41.258642 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135ffa2-c8ac-489a-8183-9d107b8c7f2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:41.260408 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135ffa2-c8ac-489a-8183-9d107b8c7f2a service swift] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:41.268995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1094/2172] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jan 10 12:49:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:49:41.739215 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b2b3b-e6f8-4b95-a982-328a796f18db None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:41.741887 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5f1b2b3b-e6f8-4b95-a982-328a796f18db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:41.826495 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b2b3b-e6f8-4b95-a982-328a796f18db None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:41.833930 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80ba29-a9d6-42a2-842d-5565a15333c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:41.834843 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80ba29-a9d6-42a2-842d-5565a15333c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:41.835254 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80ba29-a9d6-42a2-842d-5565a15333c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:41.835544 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80ba29-a9d6-42a2-842d-5565a15333c4 admin admin] PATH_INFO: `/v3/users/e4b91a6e1c1b4b5ba6c6a68bd28c827b` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:41.836942 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80ba29-a9d6-42a2-842d-5565a15333c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b91a6e1c1b4b5ba6c6a68bd28c827b)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:41.839253 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80ba29-a9d6-42a2-842d-5565a15333c4 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:41.891982 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5b80ba29-a9d6-42a2-842d-5565a15333c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b91a6e1c1b4b5ba6c6a68bd28c827b'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:41.892651 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5b80ba29-a9d6-42a2-842d-5565a15333c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b91a6e1c1b4b5ba6c6a68bd28c827b'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:41.893369 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5b80ba29-a9d6-42a2-842d-5565a15333c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b91a6e1c1b4b5ba6c6a68bd28c827b'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:41.909215 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5b80ba29-a9d6-42a2-842d-5565a15333c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b91a6e1c1b4b5ba6c6a68bd28c827b'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:41.917945 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5b80ba29-a9d6-42a2-842d-5565a15333c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b91a6e1c1b4b5ba6c6a68bd28c827b'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:41.934856 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1079/2173] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:49:41 2022] DELETE /identity/v3/users/e4b91a6e1c1b4b5ba6c6a68bd28c827b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:49:41.940175 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88966a-bd04-46c3-a1ed-f9b67c1ae512 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:41.940492 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88966a-bd04-46c3-a1ed-f9b67c1ae512 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:41.940752 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88966a-bd04-46c3-a1ed-f9b67c1ae512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:41.961661 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-dc88966a-bd04-46c3-a1ed-f9b67c1ae512 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:49:41.962930 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-dc88966a-bd04-46c3-a1ed-f9b67c1ae512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:42.035955 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1095/2174] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:49:42.046976 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80ba29-a9d6-42a2-842d-5565a15333c4 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:42.048549 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5b80ba29-a9d6-42a2-842d-5565a15333c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:42.141359 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80ba29-a9d6-42a2-842d-5565a15333c4 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:42.147878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b785d3-ece2-412c-b859-388c08f7b23d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:42.149151 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b785d3-ece2-412c-b859-388c08f7b23d service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:42.149606 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b785d3-ece2-412c-b859-388c08f7b23d service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:42.150100 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b785d3-ece2-412c-b859-388c08f7b23d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:42.193097 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b785d3-ece2-412c-b859-388c08f7b23d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:42.197079 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b785d3-ece2-412c-b859-388c08f7b23d service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:42.216373 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1080/2175] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:49:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:49:42.617519 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88966a-bd04-46c3-a1ed-f9b67c1ae512 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:42.619936 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-dc88966a-bd04-46c3-a1ed-f9b67c1ae512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:42.640104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88966a-bd04-46c3-a1ed-f9b67c1ae512 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:42.652594 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e84690-c553-447a-a1c9-c3c32a0f36f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:42.653850 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e84690-c553-447a-a1c9-c3c32a0f36f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:42.654358 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e84690-c553-447a-a1c9-c3c32a0f36f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:42.655187 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e84690-c553-447a-a1c9-c3c32a0f36f8 admin admin] PATH_INFO: `/v3/projects/65feacd0c25b473b9f36d5ae181cbeca` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:42.656876 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e84690-c553-447a-a1c9-c3c32a0f36f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65feacd0c25b473b9f36d5ae181cbeca)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:42.659267 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e84690-c553-447a-a1c9-c3c32a0f36f8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:42.768226 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-e2e84690-c553-447a-a1c9-c3c32a0f36f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65feacd0c25b473b9f36d5ae181cbeca', 'request_id': 'req-e2e84690-c553-447a-a1c9-c3c32a0f36f8'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:42.775727 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-e2e84690-c553-447a-a1c9-c3c32a0f36f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65feacd0c25b473b9f36d5ae181cbeca', 'request_id': 'req-e2e84690-c553-447a-a1c9-c3c32a0f36f8'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:42.794950 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-e2e84690-c553-447a-a1c9-c3c32a0f36f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65feacd0c25b473b9f36d5ae181cbeca', 'request_id': 'req-e2e84690-c553-447a-a1c9-c3c32a0f36f8'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:42.813220 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-e2e84690-c553-447a-a1c9-c3c32a0f36f8 admin admin] The token cache is being invalidate because project 65feacd0c25b473b9f36d5ae181cbeca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:49:42.813611 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-e2e84690-c553-447a-a1c9-c3c32a0f36f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:42.814389 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-e2e84690-c553-447a-a1c9-c3c32a0f36f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:42.816528 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1096/2176] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:49:42 2022] DELETE /identity/v3/projects/65feacd0c25b473b9f36d5ae181cbeca => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:49:48.720092 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b785d3-ece2-412c-b859-388c08f7b23d service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:48.722393 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-37b785d3-ece2-412c-b859-388c08f7b23d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:48.754864 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b785d3-ece2-412c-b859-388c08f7b23d service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:48.824981 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f9ef8-b165-440f-8469-9a50fa68e4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:48.825814 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f9ef8-b165-440f-8469-9a50fa68e4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:48.826169 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f9ef8-b165-440f-8469-9a50fa68e4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:48.826348 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f9ef8-b165-440f-8469-9a50fa68e4fe admin admin] PATH_INFO: `/v3/users/35cc6e060bd443a0a49af9a54da595b1` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:48.827710 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f9ef8-b165-440f-8469-9a50fa68e4fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=35cc6e060bd443a0a49af9a54da595b1)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:48.829860 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9f9ef8-b165-440f-8469-9a50fa68e4fe admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:48.895771 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-ef9f9ef8-b165-440f-8469-9a50fa68e4fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35cc6e060bd443a0a49af9a54da595b1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:48.896444 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-ef9f9ef8-b165-440f-8469-9a50fa68e4fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35cc6e060bd443a0a49af9a54da595b1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:48.898897 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-ef9f9ef8-b165-440f-8469-9a50fa68e4fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35cc6e060bd443a0a49af9a54da595b1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:48.915999 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-ef9f9ef8-b165-440f-8469-9a50fa68e4fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35cc6e060bd443a0a49af9a54da595b1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:48.924755 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-ef9f9ef8-b165-440f-8469-9a50fa68e4fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35cc6e060bd443a0a49af9a54da595b1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:48.942512 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1081/2177] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:49:48 2022] DELETE /identity/v3/users/35cc6e060bd443a0a49af9a54da595b1 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:49:48.947182 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b6c39-d838-471f-9706-826fd1f962d8 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:48.947814 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b6c39-d838-471f-9706-826fd1f962d8 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:48.947814 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b6c39-d838-471f-9706-826fd1f962d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:48.967279 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-c48b6c39-d838-471f-9706-826fd1f962d8 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:49:48.968530 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c48b6c39-d838-471f-9706-826fd1f962d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:49.030680 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1097/2178] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:49:49.040965 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f9ef8-b165-440f-8469-9a50fa68e4fe admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:49.042489 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-ef9f9ef8-b165-440f-8469-9a50fa68e4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:49.126827 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f9ef8-b165-440f-8469-9a50fa68e4fe admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:49.131771 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3d778-f1f9-4a11-baae-55d4f9064344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:49.132731 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3d778-f1f9-4a11-baae-55d4f9064344 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:49.133203 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3d778-f1f9-4a11-baae-55d4f9064344 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:49.133678 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3d778-f1f9-4a11-baae-55d4f9064344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:49.153488 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3d778-f1f9-4a11-baae-55d4f9064344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:49.155472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3d778-f1f9-4a11-baae-55d4f9064344 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:49.170112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1082/2179] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:49:49.548165 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b6c39-d838-471f-9706-826fd1f962d8 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:49.551369 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c48b6c39-d838-471f-9706-826fd1f962d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:49.570006 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b6c39-d838-471f-9706-826fd1f962d8 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:49.581839 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5ffc3-74a5-470d-a767-3737c290e501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:49.582814 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5ffc3-74a5-470d-a767-3737c290e501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:49.583371 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5ffc3-74a5-470d-a767-3737c290e501 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:49.583784 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5ffc3-74a5-470d-a767-3737c290e501 admin admin] PATH_INFO: `/v3/projects/ffce67ba10f14f44a9f43e2d35b6b3d5` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:49.585236 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5ffc3-74a5-470d-a767-3737c290e501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffce67ba10f14f44a9f43e2d35b6b3d5)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:49.587291 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5ffc3-74a5-470d-a767-3737c290e501 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:49.680649 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-80e5ffc3-74a5-470d-a767-3737c290e501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffce67ba10f14f44a9f43e2d35b6b3d5', 'request_id': 'req-80e5ffc3-74a5-470d-a767-3737c290e501'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:49.688744 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-80e5ffc3-74a5-470d-a767-3737c290e501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffce67ba10f14f44a9f43e2d35b6b3d5', 'request_id': 'req-80e5ffc3-74a5-470d-a767-3737c290e501'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:49.707892 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-80e5ffc3-74a5-470d-a767-3737c290e501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffce67ba10f14f44a9f43e2d35b6b3d5', 'request_id': 'req-80e5ffc3-74a5-470d-a767-3737c290e501'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:49.722178 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-80e5ffc3-74a5-470d-a767-3737c290e501 admin admin] The token cache is being invalidate because project ffce67ba10f14f44a9f43e2d35b6b3d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:49:49.722605 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-80e5ffc3-74a5-470d-a767-3737c290e501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:49.723330 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-80e5ffc3-74a5-470d-a767-3737c290e501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:49:49.730995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1098/2180] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:49:49 2022] DELETE /identity/v3/projects/ffce67ba10f14f44a9f43e2d35b6b3d5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:49:49.731746 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a518d-2c96-4e84-9dc7-4efa437e082e None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:49.732204 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a518d-2c96-4e84-9dc7-4efa437e082e None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:49.732308 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a518d-2c96-4e84-9dc7-4efa437e082e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:49.764428 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-8d9a518d-2c96-4e84-9dc7-4efa437e082e None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:49:49.765958 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-8d9a518d-2c96-4e84-9dc7-4efa437e082e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:49.858143 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1083/2181] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:49:49.865629 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca85e2-ece8-4529-a062-c4ab37497025 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:49.866010 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca85e2-ece8-4529-a062-c4ab37497025 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:49.866384 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca85e2-ece8-4529-a062-c4ab37497025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:49.894310 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-9dca85e2-ece8-4529-a062-c4ab37497025 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:49:49.895642 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-9dca85e2-ece8-4529-a062-c4ab37497025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:49.908878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a518d-2c96-4e84-9dc7-4efa437e082e None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:49.919869 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1099/2182] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:49:49.921099 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a518d-2c96-4e84-9dc7-4efa437e082e None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:49.927425 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f83e34-3e17-4ca2-bbc2-f2326e6174d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:49.928880 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f83e34-3e17-4ca2-bbc2-f2326e6174d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:49.929162 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f83e34-3e17-4ca2-bbc2-f2326e6174d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:49.929790 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f83e34-3e17-4ca2-bbc2-f2326e6174d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:49.930975 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f83e34-3e17-4ca2-bbc2-f2326e6174d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:49:49.931399 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f83e34-3e17-4ca2-bbc2-f2326e6174d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:49.933770 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f83e34-3e17-4ca2-bbc2-f2326e6174d9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:49.953270 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca85e2-ece8-4529-a062-c4ab37497025 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:49.954071 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1084/2183] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:49:49.963902 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca85e2-ece8-4529-a062-c4ab37497025 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:49.996235 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c772b29-e11d-4544-85eb-ed6235ffc4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:49.998962 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c772b29-e11d-4544-85eb-ed6235ffc4d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:49.999420 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c772b29-e11d-4544-85eb-ed6235ffc4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:50.000053 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c772b29-e11d-4544-85eb-ed6235ffc4d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:50.002140 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c772b29-e11d-4544-85eb-ed6235ffc4d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:50.006346 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c772b29-e11d-4544-85eb-ed6235ffc4d3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:50.068879 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1100/2184] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:49:49 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:49:50.070668 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f83e34-3e17-4ca2-bbc2-f2326e6174d9 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:50.097001 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f83e34-3e17-4ca2-bbc2-f2326e6174d9 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:50.263279 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf25c2e-754e-49f4-8350-3b9a68977ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:50.264016 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf25c2e-754e-49f4-8350-3b9a68977ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:50.265812 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf25c2e-754e-49f4-8350-3b9a68977ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:50.266095 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf25c2e-754e-49f4-8350-3b9a68977ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:50.267018 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf25c2e-754e-49f4-8350-3b9a68977ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:50.269212 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf25c2e-754e-49f4-8350-3b9a68977ce6 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:50.318132 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1085/2185] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:49:50 2022] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:49:50.341898 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c772b29-e11d-4544-85eb-ed6235ffc4d3 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:50.360368 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c772b29-e11d-4544-85eb-ed6235ffc4d3 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:50.375507 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0674dc2-182e-46c2-84cc-2a621e376aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:50.376436 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0674dc2-182e-46c2-84cc-2a621e376aab admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:50.376870 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0674dc2-182e-46c2-84cc-2a621e376aab admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:50.377291 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0674dc2-182e-46c2-84cc-2a621e376aab admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:50.378194 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0674dc2-182e-46c2-84cc-2a621e376aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:50.380768 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0674dc2-182e-46c2-84cc-2a621e376aab admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:50.394467 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1101/2186] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:49:50.398630 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf25c2e-754e-49f4-8350-3b9a68977ce6 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:50.435904 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf25c2e-754e-49f4-8350-3b9a68977ce6 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:50.447142 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60524f0a-2aba-4945-832f-a0b815c6ec26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:50.448267 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60524f0a-2aba-4945-832f-a0b815c6ec26 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:50.448608 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60524f0a-2aba-4945-832f-a0b815c6ec26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:50.448989 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60524f0a-2aba-4945-832f-a0b815c6ec26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:50.449932 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60524f0a-2aba-4945-832f-a0b815c6ec26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:50.451945 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60524f0a-2aba-4945-832f-a0b815c6ec26 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:50.469919 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1086/2187] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:49:50.474573 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0674dc2-182e-46c2-84cc-2a621e376aab admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:50.505842 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0674dc2-182e-46c2-84cc-2a621e376aab admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:50.523608 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb01c5-7f1c-4d24-a5bd-695c1041a92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:50.524469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb01c5-7f1c-4d24-a5bd-695c1041a92a admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:50.524741 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb01c5-7f1c-4d24-a5bd-695c1041a92a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:50.525013 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb01c5-7f1c-4d24-a5bd-695c1041a92a admin admin] PATH_INFO: `/v3/projects/36b1b002256e43eba62e736d945f9049/users/90f35219a70d4e0596a6c28bd9ef9acc/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:50.575226 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb01c5-7f1c-4d24-a5bd-695c1041a92a admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b1b002256e43eba62e736d945f9049, user_id=90f35219a70d4e0596a6c28bd9ef9acc, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:50.577922 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb01c5-7f1c-4d24-a5bd-695c1041a92a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:50.612382 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1102/2188] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:49:50 2022] PUT /identity/v3/projects/36b1b002256e43eba62e736d945f9049/users/90f35219a70d4e0596a6c28bd9ef9acc/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:49:50.618159 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd99384-b1d7-49c2-9a46-c5b85ee2ee9a None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:50.618448 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd99384-b1d7-49c2-9a46-c5b85ee2ee9a None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:50.618754 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd99384-b1d7-49c2-9a46-c5b85ee2ee9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:50.656574 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-2bd99384-b1d7-49c2-9a46-c5b85ee2ee9a None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:49:50.663809 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-2bd99384-b1d7-49c2-9a46-c5b85ee2ee9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:50.767707 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1087/2189] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:49:50.784131 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb01c5-7f1c-4d24-a5bd-695c1041a92a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:50.786095 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-e7bb01c5-7f1c-4d24-a5bd-695c1041a92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:50.927309 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb01c5-7f1c-4d24-a5bd-695c1041a92a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:50.938691 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d88f7-9ab9-4f32-bc36-fc80ca752b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:50.939769 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d88f7-9ab9-4f32-bc36-fc80ca752b96 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:50.940210 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d88f7-9ab9-4f32-bc36-fc80ca752b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:50.940634 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d88f7-9ab9-4f32-bc36-fc80ca752b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:50.955406 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d88f7-9ab9-4f32-bc36-fc80ca752b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:50.957435 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d88f7-9ab9-4f32-bc36-fc80ca752b96 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:50.972901 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1103/2190] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:49:51.910472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250adcd-f5aa-4542-aa26-f0b9a3b36869 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:51.911531 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250adcd-f5aa-4542-aa26-f0b9a3b36869 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:51.911970 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250adcd-f5aa-4542-aa26-f0b9a3b36869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:51.947916 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-d250adcd-f5aa-4542-aa26-f0b9a3b36869 None None] MFA Rules not processed for user `90f35219a70d4e0596a6c28bd9ef9acc`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:49:51.949527 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-d250adcd-f5aa-4542-aa26-f0b9a3b36869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:52.041367 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1088/2191] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:49:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:49:52.047647 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d88f7-9ab9-4f32-bc36-fc80ca752b96 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:52.050781 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b48d88f7-9ab9-4f32-bc36-fc80ca752b96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:52.158254 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d88f7-9ab9-4f32-bc36-fc80ca752b96 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:49:52.162826 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b66cb-cad3-4df4-940a-b2a133d36162 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:49:52.163911 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b66cb-cad3-4df4-940a-b2a133d36162 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:52.164363 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b66cb-cad3-4df4-940a-b2a133d36162 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:52.164815 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b66cb-cad3-4df4-940a-b2a133d36162 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:52.183814 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b66cb-cad3-4df4-940a-b2a133d36162 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:49:52.185913 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b66cb-cad3-4df4-940a-b2a133d36162 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:49:52.197499 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1104/2192] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:49:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:49:52.844256 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c2d89-812e-410b-8125-736c01297eba None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:52.844601 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c2d89-812e-410b-8125-736c01297eba None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:52.844980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c2d89-812e-410b-8125-736c01297eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:52.864475 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-692c2d89-812e-410b-8125-736c01297eba None None] MFA Rules not processed for user `0513eaec53d241f398508dec85f017d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:49:52.865731 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-692c2d89-812e-410b-8125-736c01297eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:52.931077 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1089/2193] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:49:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:49:55.756048 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905c12c-e123-438d-a360-797de57d3057 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:55.756588 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905c12c-e123-438d-a360-797de57d3057 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:55.756588 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905c12c-e123-438d-a360-797de57d3057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:55.790632 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-1905c12c-e123-438d-a360-797de57d3057 None None] MFA Rules not processed for user `90f35219a70d4e0596a6c28bd9ef9acc`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:49:55.792971 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-1905c12c-e123-438d-a360-797de57d3057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:55.803084 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1105/2194] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:49:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:49:59.776998 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ed8c5-ff58-4ef2-8b7f-873cb0c3f474 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:49:59.777599 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ed8c5-ff58-4ef2-8b7f-873cb0c3f474 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:49:59.778045 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ed8c5-ff58-4ef2-8b7f-873cb0c3f474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:49:59.812681 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-069ed8c5-ff58-4ef2-8b7f-873cb0c3f474 None None] MFA Rules not processed for user `44e5602fd019411aa8f0e091ed533ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:49:59.814463 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-069ed8c5-ff58-4ef2-8b7f-873cb0c3f474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:49:59.923964 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1090/2195] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jan 10 12:49:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:49:59.960173 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905c12c-e123-438d-a360-797de57d3057 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:49:59.961760 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-1905c12c-e123-438d-a360-797de57d3057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:00.095621 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905c12c-e123-438d-a360-797de57d3057 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:00.101655 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23dfa1-b8d8-4b7c-a0b8-fa9a0ae03cb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd898c7c2974bb38998ebad22fd5a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:00.102709 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23dfa1-b8d8-4b7c-a0b8-fa9a0ae03cb1 service swift] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:00.103209 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23dfa1-b8d8-4b7c-a0b8-fa9a0ae03cb1 service swift] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:00.103729 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23dfa1-b8d8-4b7c-a0b8-fa9a0ae03cb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:00.113849 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23dfa1-b8d8-4b7c-a0b8-fa9a0ae03cb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:00.116065 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23dfa1-b8d8-4b7c-a0b8-fa9a0ae03cb1 service swift] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:00.126819 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1106/2196] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jan 10 12:49:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:50:00.532247 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ed8c5-ff58-4ef2-8b7f-873cb0c3f474 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:00.533320 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-069ed8c5-ff58-4ef2-8b7f-873cb0c3f474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:00.576880 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ed8c5-ff58-4ef2-8b7f-873cb0c3f474 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:00.597614 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f96a0-0464-49a1-8266-9f561a14e768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:00.598513 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f96a0-0464-49a1-8266-9f561a14e768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:00.598895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f96a0-0464-49a1-8266-9f561a14e768 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:00.599052 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f96a0-0464-49a1-8266-9f561a14e768 admin admin] PATH_INFO: `/v3/users/104102203672497e881cbbebfb991716` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:00.602632 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f96a0-0464-49a1-8266-9f561a14e768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=104102203672497e881cbbebfb991716)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:00.604920 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f96a0-0464-49a1-8266-9f561a14e768 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:00.711857 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bb9f96a0-0464-49a1-8266-9f561a14e768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '104102203672497e881cbbebfb991716'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:00.713979 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bb9f96a0-0464-49a1-8266-9f561a14e768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '104102203672497e881cbbebfb991716'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:00.715410 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bb9f96a0-0464-49a1-8266-9f561a14e768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '104102203672497e881cbbebfb991716'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:00.766186 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bb9f96a0-0464-49a1-8266-9f561a14e768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '104102203672497e881cbbebfb991716'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:00.778000 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bb9f96a0-0464-49a1-8266-9f561a14e768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '104102203672497e881cbbebfb991716'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:00.808722 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1091/2197] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:50:00 2022] DELETE /identity/v3/users/104102203672497e881cbbebfb991716 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:50:00.813298 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f69abe-b594-4889-a4f2-95041141960c None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:00.814040 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f69abe-b594-4889-a4f2-95041141960c None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:00.814317 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f69abe-b594-4889-a4f2-95041141960c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:00.854169 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-60f69abe-b594-4889-a4f2-95041141960c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:50:00.855973 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-60f69abe-b594-4889-a4f2-95041141960c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:00.995985 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1107/2198] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:50:01.013663 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f96a0-0464-49a1-8266-9f561a14e768 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:01.015209 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-bb9f96a0-0464-49a1-8266-9f561a14e768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:01.270081 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f96a0-0464-49a1-8266-9f561a14e768 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:01.275895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4f8a4-a017-44a3-a2a5-c2a10e54f0e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:01.276888 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f8a4-a017-44a3-a2a5-c2a10e54f0e0 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:01.277387 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f8a4-a017-44a3-a2a5-c2a10e54f0e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:01.277888 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4f8a4-a017-44a3-a2a5-c2a10e54f0e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:01.300064 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4f8a4-a017-44a3-a2a5-c2a10e54f0e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:01.304052 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4f8a4-a017-44a3-a2a5-c2a10e54f0e0 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:01.319444 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1092/2199] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:50:01.969226 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f69abe-b594-4889-a4f2-95041141960c None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:01.971013 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-60f69abe-b594-4889-a4f2-95041141960c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:01.998160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f69abe-b594-4889-a4f2-95041141960c None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:02.017275 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba190b63-f245-482b-944e-b1659061c318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:02.018853 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba190b63-f245-482b-944e-b1659061c318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:02.019344 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba190b63-f245-482b-944e-b1659061c318 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:02.020007 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba190b63-f245-482b-944e-b1659061c318 admin admin] PATH_INFO: `/v3/projects/4681904d2b064a288df52876cff36041` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:02.022323 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba190b63-f245-482b-944e-b1659061c318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4681904d2b064a288df52876cff36041)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:02.025578 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba190b63-f245-482b-944e-b1659061c318 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:02.101257 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ba190b63-f245-482b-944e-b1659061c318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4681904d2b064a288df52876cff36041', 'request_id': 'req-ba190b63-f245-482b-944e-b1659061c318'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:02.114193 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ba190b63-f245-482b-944e-b1659061c318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4681904d2b064a288df52876cff36041', 'request_id': 'req-ba190b63-f245-482b-944e-b1659061c318'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:02.127685 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ba190b63-f245-482b-944e-b1659061c318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4681904d2b064a288df52876cff36041', 'request_id': 'req-ba190b63-f245-482b-944e-b1659061c318'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:02.167158 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ba190b63-f245-482b-944e-b1659061c318 admin admin] The token cache is being invalidate because project 4681904d2b064a288df52876cff36041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:50:02.177449 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ba190b63-f245-482b-944e-b1659061c318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:02.188328 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ba190b63-f245-482b-944e-b1659061c318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:02.209213 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1108/2200] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:50:01 2022] DELETE /identity/v3/projects/4681904d2b064a288df52876cff36041 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:50:02.211154 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d5028-4b1d-4284-9644-8d587c00633b None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:02.212536 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d5028-4b1d-4284-9644-8d587c00633b None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:02.212536 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d5028-4b1d-4284-9644-8d587c00633b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:02.282277 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-1f8d5028-4b1d-4284-9644-8d587c00633b None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:50:02.283714 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-1f8d5028-4b1d-4284-9644-8d587c00633b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:02.611638 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1093/2201] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:50:02.613881 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be9df1-0c95-4da5-b9e5-e583f9a279b3 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:02.614417 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be9df1-0c95-4da5-b9e5-e583f9a279b3 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:02.615033 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be9df1-0c95-4da5-b9e5-e583f9a279b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:02.708615 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-66be9df1-0c95-4da5-b9e5-e583f9a279b3 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:50:02.723162 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-66be9df1-0c95-4da5-b9e5-e583f9a279b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:02.770430 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1109/2202] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:50:02.771361 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d5028-4b1d-4284-9644-8d587c00633b None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:02.786388 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d5028-4b1d-4284-9644-8d587c00633b None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:02.799737 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3716f8-48e9-4d01-a9f0-5ee056c70883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:02.800593 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3716f8-48e9-4d01-a9f0-5ee056c70883 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:02.801045 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3716f8-48e9-4d01-a9f0-5ee056c70883 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:02.801152 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3716f8-48e9-4d01-a9f0-5ee056c70883 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:02.808325 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3716f8-48e9-4d01-a9f0-5ee056c70883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:50:02.808972 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3716f8-48e9-4d01-a9f0-5ee056c70883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:02.816959 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3716f8-48e9-4d01-a9f0-5ee056c70883 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:02.868207 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1094/2203] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:50:02.869955 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be9df1-0c95-4da5-b9e5-e583f9a279b3 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:02.882900 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be9df1-0c95-4da5-b9e5-e583f9a279b3 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:02.916928 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082aaae-eb94-40a1-a915-bd6ba96b2cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:02.918027 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082aaae-eb94-40a1-a915-bd6ba96b2cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:02.920350 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082aaae-eb94-40a1-a915-bd6ba96b2cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:02.920832 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082aaae-eb94-40a1-a915-bd6ba96b2cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:02.924335 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082aaae-eb94-40a1-a915-bd6ba96b2cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:02.927889 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082aaae-eb94-40a1-a915-bd6ba96b2cd1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:03.002025 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1110/2204] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:50:02 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:50:03.003000 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3716f8-48e9-4d01-a9f0-5ee056c70883 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:03.025502 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3716f8-48e9-4d01-a9f0-5ee056c70883 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:03.143246 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04199601-0364-4183-b61f-8c1cd869e126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:03.144554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04199601-0364-4183-b61f-8c1cd869e126 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:03.145058 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04199601-0364-4183-b61f-8c1cd869e126 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:03.145569 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04199601-0364-4183-b61f-8c1cd869e126 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:03.146552 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04199601-0364-4183-b61f-8c1cd869e126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:03.148794 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04199601-0364-4183-b61f-8c1cd869e126 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:03.183125 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1095/2205] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:50:03 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:50:03.183944 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082aaae-eb94-40a1-a915-bd6ba96b2cd1 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:03.199363 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082aaae-eb94-40a1-a915-bd6ba96b2cd1 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:03.211082 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c6a79-876b-4472-990b-bd715b9b85a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:03.212358 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c6a79-876b-4472-990b-bd715b9b85a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:03.213142 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c6a79-876b-4472-990b-bd715b9b85a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:03.217637 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c6a79-876b-4472-990b-bd715b9b85a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:03.220269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c6a79-876b-4472-990b-bd715b9b85a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:03.223433 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c6a79-876b-4472-990b-bd715b9b85a1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:03.263030 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1111/2206] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:50:03.264513 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04199601-0364-4183-b61f-8c1cd869e126 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:03.278012 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04199601-0364-4183-b61f-8c1cd869e126 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:03.293595 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d192e9-703d-4090-a02a-9256e599fba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:03.294769 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d192e9-703d-4090-a02a-9256e599fba5 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:03.296101 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d192e9-703d-4090-a02a-9256e599fba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:03.296627 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d192e9-703d-4090-a02a-9256e599fba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:03.297596 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d192e9-703d-4090-a02a-9256e599fba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:03.299711 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d192e9-703d-4090-a02a-9256e599fba5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:03.331957 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1096/2207] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:50:03.335675 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c6a79-876b-4472-990b-bd715b9b85a1 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:03.365574 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c6a79-876b-4472-990b-bd715b9b85a1 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:03.375803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca003a1-7fea-408e-8c15-bec9408bafde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:03.377043 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca003a1-7fea-408e-8c15-bec9408bafde admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:03.377314 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca003a1-7fea-408e-8c15-bec9408bafde admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:03.377756 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca003a1-7fea-408e-8c15-bec9408bafde admin admin] PATH_INFO: `/v3/projects/503dbd8843034c38a1dbc86c07c6f549/users/ffd65d5f1d484d48a3ed84cf1592956c/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:03.413536 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca003a1-7fea-408e-8c15-bec9408bafde admin admin] RBAC: Authorizing `identity:create_grant(project_id=503dbd8843034c38a1dbc86c07c6f549, user_id=ffd65d5f1d484d48a3ed84cf1592956c, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:03.417187 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca003a1-7fea-408e-8c15-bec9408bafde admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:03.447415 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1112/2208] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:50:03 2022] PUT /identity/v3/projects/503dbd8843034c38a1dbc86c07c6f549/users/ffd65d5f1d484d48a3ed84cf1592956c/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:50:03.449520 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601266f-4f40-4bc7-9c3f-58e03d599da0 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:03.449931 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601266f-4f40-4bc7-9c3f-58e03d599da0 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:03.450605 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601266f-4f40-4bc7-9c3f-58e03d599da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:03.507128 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-2601266f-4f40-4bc7-9c3f-58e03d599da0 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:50:03.508774 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-2601266f-4f40-4bc7-9c3f-58e03d599da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:03.722194 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1097/2209] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:50:03.732962 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca003a1-7fea-408e-8c15-bec9408bafde admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:03.734863 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-aca003a1-7fea-408e-8c15-bec9408bafde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:03.929014 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca003a1-7fea-408e-8c15-bec9408bafde admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:03.944228 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24373c68-d524-4cf4-a919-68a1f4a81ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:03.944918 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24373c68-d524-4cf4-a919-68a1f4a81ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:03.945198 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24373c68-d524-4cf4-a919-68a1f4a81ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:03.945474 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24373c68-d524-4cf4-a919-68a1f4a81ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:03.970401 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24373c68-d524-4cf4-a919-68a1f4a81ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:03.971947 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24373c68-d524-4cf4-a919-68a1f4a81ee7 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:03.984165 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1113/2210] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:50:08.075002 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d929773-bbf6-47c8-96d9-fd19ba666367 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:08.077745 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d929773-bbf6-47c8-96d9-fd19ba666367 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:08.078224 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d929773-bbf6-47c8-96d9-fd19ba666367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:08.117687 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-9d929773-bbf6-47c8-96d9-fd19ba666367 None None] MFA Rules not processed for user `44e5602fd019411aa8f0e091ed533ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:50:08.132285 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9d929773-bbf6-47c8-96d9-fd19ba666367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:08.295601 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1098/2211] 10.222.0.13 () {58 vars in 967 bytes} [Mon Jan 10 12:50:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:50:08.320756 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24373c68-d524-4cf4-a919-68a1f4a81ee7 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:08.323957 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-24373c68-d524-4cf4-a919-68a1f4a81ee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:08.564153 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24373c68-d524-4cf4-a919-68a1f4a81ee7 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:08.583015 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d834e12-74db-4c54-9c24-2a1279ba9c7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd898c7c2974bb38998ebad22fd5a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:08.584061 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d834e12-74db-4c54-9c24-2a1279ba9c7d service swift] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:08.584530 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d834e12-74db-4c54-9c24-2a1279ba9c7d service swift] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:08.584998 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d834e12-74db-4c54-9c24-2a1279ba9c7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:08.630480 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d834e12-74db-4c54-9c24-2a1279ba9c7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:08.638741 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d834e12-74db-4c54-9c24-2a1279ba9c7d service swift] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:08.663252 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1114/2212] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jan 10 12:50:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:50:12.582898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d929773-bbf6-47c8-96d9-fd19ba666367 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:12.585385 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9d929773-bbf6-47c8-96d9-fd19ba666367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:12.615116 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d929773-bbf6-47c8-96d9-fd19ba666367 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:12.626883 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9435de5-dbcb-4c64-ba70-35790f0a6c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:12.628385 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9435de5-dbcb-4c64-ba70-35790f0a6c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:12.628872 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9435de5-dbcb-4c64-ba70-35790f0a6c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:12.629368 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9435de5-dbcb-4c64-ba70-35790f0a6c37 admin admin] PATH_INFO: `/v3/users/154d8ba69dce42fe85ae3a0ad7602bb2` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:12.630882 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9435de5-dbcb-4c64-ba70-35790f0a6c37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=154d8ba69dce42fe85ae3a0ad7602bb2)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:12.633133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9435de5-dbcb-4c64-ba70-35790f0a6c37 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:12.710348 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b9435de5-dbcb-4c64-ba70-35790f0a6c37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '154d8ba69dce42fe85ae3a0ad7602bb2'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:12.711408 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b9435de5-dbcb-4c64-ba70-35790f0a6c37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '154d8ba69dce42fe85ae3a0ad7602bb2'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:12.716573 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b9435de5-dbcb-4c64-ba70-35790f0a6c37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '154d8ba69dce42fe85ae3a0ad7602bb2'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:12.743170 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b9435de5-dbcb-4c64-ba70-35790f0a6c37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '154d8ba69dce42fe85ae3a0ad7602bb2'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:12.757609 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b9435de5-dbcb-4c64-ba70-35790f0a6c37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '154d8ba69dce42fe85ae3a0ad7602bb2'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:12.786879 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1099/2213] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:50:12 2022] DELETE /identity/v3/users/154d8ba69dce42fe85ae3a0ad7602bb2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:50:13.103378 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d834e12-74db-4c54-9c24-2a1279ba9c7d service swift] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:13.197721 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d834e12-74db-4c54-9c24-2a1279ba9c7d service swift] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:13.287766 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211b1a9-cf7c-4ff3-8a17-a8148d193fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:13.288903 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211b1a9-cf7c-4ff3-8a17-a8148d193fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:13.289428 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211b1a9-cf7c-4ff3-8a17-a8148d193fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:13.290165 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c211b1a9-cf7c-4ff3-8a17-a8148d193fc1 admin admin] PATH_INFO: `/v3/projects/9c74d48e1e934088addee3d78ddbe485` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:13.294493 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211b1a9-cf7c-4ff3-8a17-a8148d193fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c74d48e1e934088addee3d78ddbe485)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:13.297624 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c211b1a9-cf7c-4ff3-8a17-a8148d193fc1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:13.431017 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c211b1a9-cf7c-4ff3-8a17-a8148d193fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c74d48e1e934088addee3d78ddbe485', 'request_id': 'req-c211b1a9-cf7c-4ff3-8a17-a8148d193fc1'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:13.451004 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c211b1a9-cf7c-4ff3-8a17-a8148d193fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c74d48e1e934088addee3d78ddbe485', 'request_id': 'req-c211b1a9-cf7c-4ff3-8a17-a8148d193fc1'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:13.467364 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c211b1a9-cf7c-4ff3-8a17-a8148d193fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c74d48e1e934088addee3d78ddbe485', 'request_id': 'req-c211b1a9-cf7c-4ff3-8a17-a8148d193fc1'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:13.519379 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c211b1a9-cf7c-4ff3-8a17-a8148d193fc1 admin admin] The token cache is being invalidate because project 9c74d48e1e934088addee3d78ddbe485 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:50:13.519753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c211b1a9-cf7c-4ff3-8a17-a8148d193fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:13.520485 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c211b1a9-cf7c-4ff3-8a17-a8148d193fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:13.532232 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1115/2214] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:50:13 2022] DELETE /identity/v3/projects/9c74d48e1e934088addee3d78ddbe485 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:50:13.912710 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff26d1-84fc-4dbc-8455-c504e5e382ba None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:13.913628 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff26d1-84fc-4dbc-8455-c504e5e382ba None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:13.914106 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff26d1-84fc-4dbc-8455-c504e5e382ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:13.983641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-3bff26d1-84fc-4dbc-8455-c504e5e382ba None None] MFA Rules not processed for user `ffd65d5f1d484d48a3ed84cf1592956c`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:50:13.985380 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-3bff26d1-84fc-4dbc-8455-c504e5e382ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:14.113624 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1100/2215] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:50:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:50:14.114794 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211b1a9-cf7c-4ff3-8a17-a8148d193fc1 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:14.116582 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c211b1a9-cf7c-4ff3-8a17-a8148d193fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:14.232902 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c211b1a9-cf7c-4ff3-8a17-a8148d193fc1 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:14.245332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005883c0-e460-4e76-8f49-a397f23081fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:14.246364 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005883c0-e460-4e76-8f49-a397f23081fe admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:14.246821 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005883c0-e460-4e76-8f49-a397f23081fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:14.247272 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005883c0-e460-4e76-8f49-a397f23081fe admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:14.248211 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005883c0-e460-4e76-8f49-a397f23081fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:14.250392 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005883c0-e460-4e76-8f49-a397f23081fe admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:14.303498 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1116/2216] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:50:14 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:50:14.309144 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff26d1-84fc-4dbc-8455-c504e5e382ba None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:14.323232 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff26d1-84fc-4dbc-8455-c504e5e382ba None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:14.462263 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f0154-271d-4ae5-ac97-d2156151c771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:14.462963 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f0154-271d-4ae5-ac97-d2156151c771 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:14.463241 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f0154-271d-4ae5-ac97-d2156151c771 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:14.463710 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f0154-271d-4ae5-ac97-d2156151c771 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:14.465001 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f0154-271d-4ae5-ac97-d2156151c771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:14.466503 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f0154-271d-4ae5-ac97-d2156151c771 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:14.516239 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1101/2217] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:50:14 2022] POST /identity/v3/users => generated 296 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:50:14.517742 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005883c0-e460-4e76-8f49-a397f23081fe admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:14.532006 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005883c0-e460-4e76-8f49-a397f23081fe admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:14.537787 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e35af7-1816-48f9-b513-577b6b77c747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:14.538738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e35af7-1816-48f9-b513-577b6b77c747 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:14.539211 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e35af7-1816-48f9-b513-577b6b77c747 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:14.539775 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e35af7-1816-48f9-b513-577b6b77c747 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:14.541134 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e35af7-1816-48f9-b513-577b6b77c747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:14.544774 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e35af7-1816-48f9-b513-577b6b77c747 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:14.571471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1117/2218] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:50:14.575633 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f0154-271d-4ae5-ac97-d2156151c771 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:14.604729 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f0154-271d-4ae5-ac97-d2156151c771 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:14.618296 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f30cd7-f755-4bc8-8339-ff705ab9957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:14.619336 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f30cd7-f755-4bc8-8339-ff705ab9957b admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:14.619686 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f30cd7-f755-4bc8-8339-ff705ab9957b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:14.619959 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f30cd7-f755-4bc8-8339-ff705ab9957b admin admin] PATH_INFO: `/v3/projects/d31e2102c0ef4793873359fc55376f90/users/6db2daf42ddb4a1e8f6ae24f1796abd0/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:14.672591 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f30cd7-f755-4bc8-8339-ff705ab9957b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31e2102c0ef4793873359fc55376f90, user_id=6db2daf42ddb4a1e8f6ae24f1796abd0, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:14.677439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f30cd7-f755-4bc8-8339-ff705ab9957b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:14.701646 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1102/2219] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:50:14 2022] PUT /identity/v3/projects/d31e2102c0ef4793873359fc55376f90/users/6db2daf42ddb4a1e8f6ae24f1796abd0/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:50:14.705978 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e35af7-1816-48f9-b513-577b6b77c747 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:14.718128 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e35af7-1816-48f9-b513-577b6b77c747 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:14.807162 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606a55b-7f84-4f99-98e6-1707e3ffadc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:14.808079 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606a55b-7f84-4f99-98e6-1707e3ffadc6 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:14.808284 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606a55b-7f84-4f99-98e6-1707e3ffadc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:14.809521 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606a55b-7f84-4f99-98e6-1707e3ffadc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:14.812099 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606a55b-7f84-4f99-98e6-1707e3ffadc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:14.814447 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606a55b-7f84-4f99-98e6-1707e3ffadc6 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:14.853887 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1118/2220] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:50:14.858303 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f30cd7-f755-4bc8-8339-ff705ab9957b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:14.870686 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f30cd7-f755-4bc8-8339-ff705ab9957b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:14.881871 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fff077-79b7-4b7f-8492-cfb1b5bff589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:14.884312 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fff077-79b7-4b7f-8492-cfb1b5bff589 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:14.885073 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fff077-79b7-4b7f-8492-cfb1b5bff589 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:14.885374 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fff077-79b7-4b7f-8492-cfb1b5bff589 admin admin] PATH_INFO: `/v3/projects/d31e2102c0ef4793873359fc55376f90/users/6db2daf42ddb4a1e8f6ae24f1796abd0/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:14.888597 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fff077-79b7-4b7f-8492-cfb1b5bff589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31e2102c0ef4793873359fc55376f90, user_id=6db2daf42ddb4a1e8f6ae24f1796abd0, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:14.892691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fff077-79b7-4b7f-8492-cfb1b5bff589 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:14.910134 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1103/2221] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:50:14 2022] PUT /identity/v3/projects/d31e2102c0ef4793873359fc55376f90/users/6db2daf42ddb4a1e8f6ae24f1796abd0/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:50:21.256354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56184430-2ef3-4d81-a6fd-6c9ffc89c2f8 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:21.258280 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56184430-2ef3-4d81-a6fd-6c9ffc89c2f8 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:21.258785 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56184430-2ef3-4d81-a6fd-6c9ffc89c2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:21.292632 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-56184430-2ef3-4d81-a6fd-6c9ffc89c2f8 None None] MFA Rules not processed for user `6db2daf42ddb4a1e8f6ae24f1796abd0`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:50:21.293978 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-56184430-2ef3-4d81-a6fd-6c9ffc89c2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:21.385639 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1119/2222] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:50:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:50:21.397162 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fff077-79b7-4b7f-8492-cfb1b5bff589 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:21.398905 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-21fff077-79b7-4b7f-8492-cfb1b5bff589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:21.492199 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fff077-79b7-4b7f-8492-cfb1b5bff589 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:21.498670 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731bcc9-cb5c-430d-99d6-a6558d9b5f5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:21.499417 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731bcc9-cb5c-430d-99d6-a6558d9b5f5c service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:21.499722 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731bcc9-cb5c-430d-99d6-a6558d9b5f5c service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:21.499989 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731bcc9-cb5c-430d-99d6-a6558d9b5f5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:21.560870 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731bcc9-cb5c-430d-99d6-a6558d9b5f5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:21.562453 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731bcc9-cb5c-430d-99d6-a6558d9b5f5c service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:21.571980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1104/2223] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:50:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:50:23.758901 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9da3a2-3804-43a0-9958-988a37c00ec6 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:23.760141 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9da3a2-3804-43a0-9958-988a37c00ec6 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:23.760895 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9da3a2-3804-43a0-9958-988a37c00ec6 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:23.764257 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1120/2224] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jan 10 12:50:23 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:50:23.773512 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f845-aa5b-4ec1-883a-88a5f7f3c2df None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:23.774058 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f845-aa5b-4ec1-883a-88a5f7f3c2df None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:23.774166 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f845-aa5b-4ec1-883a-88a5f7f3c2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:23.808599 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-ee35f845-aa5b-4ec1-883a-88a5f7f3c2df None None] MFA Rules not processed for user `d68fa8e4f3a341a5b74ee32c85e59869`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:50:23.810222 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-ee35f845-aa5b-4ec1-883a-88a5f7f3c2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:23.845344 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1105/2225] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jan 10 12:50:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:50:23.846343 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9da3a2-3804-43a0-9958-988a37c00ec6 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:23.849281 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-1d9da3a2-3804-43a0-9958-988a37c00ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:23.968169 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9da3a2-3804-43a0-9958-988a37c00ec6 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:23.977885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839856d-2dce-432d-ab05-2410e8f78020 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f812f38c242d4530b3fc73013f66c9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:23.978780 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839856d-2dce-432d-ab05-2410e8f78020 service glance] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:23.979155 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839856d-2dce-432d-ab05-2410e8f78020 service glance] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:23.979541 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839856d-2dce-432d-ab05-2410e8f78020 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:24.019497 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839856d-2dce-432d-ab05-2410e8f78020 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:24.022464 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839856d-2dce-432d-ab05-2410e8f78020 service glance] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:24.047442 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1121/2226] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:50:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:50:24.198098 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f96f1-7ed0-4673-9eac-ffa193f01319 None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:24.198389 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f96f1-7ed0-4673-9eac-ffa193f01319 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:24.198686 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f96f1-7ed0-4673-9eac-ffa193f01319 None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:24.200522 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1106/2227] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jan 10 12:50:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:50:24.211738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdff4f-0983-43ac-8350-bf6310ed634e None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:24.212055 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdff4f-0983-43ac-8350-bf6310ed634e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:24.212330 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdff4f-0983-43ac-8350-bf6310ed634e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:24.257510 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-facdff4f-0983-43ac-8350-bf6310ed634e None None] MFA Rules not processed for user `fa3a96ff9ab74aeb88465b14de3038eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:50:24.269931 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-facdff4f-0983-43ac-8350-bf6310ed634e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:24.351207 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1122/2228] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jan 10 12:50:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:50:24.364234 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f96f1-7ed0-4673-9eac-ffa193f01319 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:24.365906 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e49f96f1-7ed0-4673-9eac-ffa193f01319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:24.379804 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f96f1-7ed0-4673-9eac-ffa193f01319 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:24.383476 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718282ad-913f-4d02-b935-05e62bc061b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:24.384171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718282ad-913f-4d02-b935-05e62bc061b2 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:24.384451 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718282ad-913f-4d02-b935-05e62bc061b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:24.384722 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718282ad-913f-4d02-b935-05e62bc061b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:24.393084 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718282ad-913f-4d02-b935-05e62bc061b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:24.394563 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718282ad-913f-4d02-b935-05e62bc061b2 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:24.404958 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1107/2229] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:50:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:50:30.646298 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c35eb-d332-426f-a62e-66dbe9ba0efb None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:30.646812 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c35eb-d332-426f-a62e-66dbe9ba0efb None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:30.646812 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c35eb-d332-426f-a62e-66dbe9ba0efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:30.665930 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-e68c35eb-d332-426f-a62e-66dbe9ba0efb None None] MFA Rules not processed for user `44e5602fd019411aa8f0e091ed533ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:50:30.667191 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-e68c35eb-d332-426f-a62e-66dbe9ba0efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:30.726415 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1123/2230] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jan 10 12:50:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:50:30.739428 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718282ad-913f-4d02-b935-05e62bc061b2 service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:30.740933 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-718282ad-913f-4d02-b935-05e62bc061b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:30.814932 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718282ad-913f-4d02-b935-05e62bc061b2 service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:30.821691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e497d8d-d860-4699-bb03-533d53b3d1cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd898c7c2974bb38998ebad22fd5a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:30.822484 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e497d8d-d860-4699-bb03-533d53b3d1cd service swift] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:30.822647 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e497d8d-d860-4699-bb03-533d53b3d1cd service swift] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:30.822984 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e497d8d-d860-4699-bb03-533d53b3d1cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:30.833354 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e497d8d-d860-4699-bb03-533d53b3d1cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:30.835348 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e497d8d-d860-4699-bb03-533d53b3d1cd service swift] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:30.849406 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1108/2231] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jan 10 12:50:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:50:46.440199 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5136d64-a7c5-4860-bcb3-d6869d7394d9 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:46.440759 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5136d64-a7c5-4860-bcb3-d6869d7394d9 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:46.440759 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5136d64-a7c5-4860-bcb3-d6869d7394d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:46.461217 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-a5136d64-a7c5-4860-bcb3-d6869d7394d9 None None] MFA Rules not processed for user `ffd65d5f1d484d48a3ed84cf1592956c`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:50:46.462414 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-a5136d64-a7c5-4860-bcb3-d6869d7394d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:46.470175 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1124/2232] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:50:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:50:46.738448 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e497d8d-d860-4699-bb03-533d53b3d1cd service swift] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:46.740114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-1e497d8d-d860-4699-bb03-533d53b3d1cd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:46.847944 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e497d8d-d860-4699-bb03-533d53b3d1cd service swift] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:46.853781 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df17d2-551c-4d7c-99a1-35c1a0e1680a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6aa01ebd7314f30a1c729ff2b50c975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:46.854735 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df17d2-551c-4d7c-99a1-35c1a0e1680a service placement] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:46.854735 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df17d2-551c-4d7c-99a1-35c1a0e1680a service placement] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:46.855036 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df17d2-551c-4d7c-99a1-35c1a0e1680a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:46.856827 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-c9df17d2-551c-4d7c-99a1-35c1a0e1680a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:46.869173 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df17d2-551c-4d7c-99a1-35c1a0e1680a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:46.870927 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df17d2-551c-4d7c-99a1-35c1a0e1680a service placement] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:46.881702 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1109/2233] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:50:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:50:56.686315 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5136d64-a7c5-4860-bcb3-d6869d7394d9 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:56.688084 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-a5136d64-a7c5-4860-bcb3-d6869d7394d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:56.754077 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5136d64-a7c5-4860-bcb3-d6869d7394d9 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:56.759126 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98133c2-7062-4b1b-b0d6-9b826a85e87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:56.760409 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98133c2-7062-4b1b-b0d6-9b826a85e87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:56.760684 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98133c2-7062-4b1b-b0d6-9b826a85e87e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:56.760950 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98133c2-7062-4b1b-b0d6-9b826a85e87e admin admin] PATH_INFO: `/v3/users/0513eaec53d241f398508dec85f017d7` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:56.762244 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98133c2-7062-4b1b-b0d6-9b826a85e87e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0513eaec53d241f398508dec85f017d7)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:56.764218 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98133c2-7062-4b1b-b0d6-9b826a85e87e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:56.816487 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c98133c2-7062-4b1b-b0d6-9b826a85e87e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0513eaec53d241f398508dec85f017d7'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:56.824209 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c98133c2-7062-4b1b-b0d6-9b826a85e87e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0513eaec53d241f398508dec85f017d7'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:56.833096 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c98133c2-7062-4b1b-b0d6-9b826a85e87e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0513eaec53d241f398508dec85f017d7'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:56.833944 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c98133c2-7062-4b1b-b0d6-9b826a85e87e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0513eaec53d241f398508dec85f017d7'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:56.834593 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c98133c2-7062-4b1b-b0d6-9b826a85e87e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0513eaec53d241f398508dec85f017d7'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:56.852048 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1125/2234] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:50:56 2022] DELETE /identity/v3/users/0513eaec53d241f398508dec85f017d7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:50:57.035420 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df17d2-551c-4d7c-99a1-35c1a0e1680a service placement] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:57.048885 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df17d2-551c-4d7c-99a1-35c1a0e1680a service placement] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:57.105792 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132655c-d958-4ceb-84a2-f722e1072139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:57.106657 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132655c-d958-4ceb-84a2-f722e1072139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:57.106934 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132655c-d958-4ceb-84a2-f722e1072139 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:57.107191 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132655c-d958-4ceb-84a2-f722e1072139 admin admin] PATH_INFO: `/v3/projects/cc2f029676f249c681ad86a3f68525e4` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:57.108443 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132655c-d958-4ceb-84a2-f722e1072139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc2f029676f249c681ad86a3f68525e4)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:57.110340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132655c-d958-4ceb-84a2-f722e1072139 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:57.161382 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5132655c-d958-4ceb-84a2-f722e1072139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc2f029676f249c681ad86a3f68525e4', 'request_id': 'req-5132655c-d958-4ceb-84a2-f722e1072139'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:57.170631 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5132655c-d958-4ceb-84a2-f722e1072139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc2f029676f249c681ad86a3f68525e4', 'request_id': 'req-5132655c-d958-4ceb-84a2-f722e1072139'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:57.176076 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5132655c-d958-4ceb-84a2-f722e1072139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc2f029676f249c681ad86a3f68525e4', 'request_id': 'req-5132655c-d958-4ceb-84a2-f722e1072139'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:57.187733 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5132655c-d958-4ceb-84a2-f722e1072139 admin admin] The token cache is being invalidate because project cc2f029676f249c681ad86a3f68525e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:50:57.188021 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5132655c-d958-4ceb-84a2-f722e1072139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:57.188769 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5132655c-d958-4ceb-84a2-f722e1072139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:57.190450 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1110/2235] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:50:57 2022] DELETE /identity/v3/projects/cc2f029676f249c681ad86a3f68525e4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:50:57.196497 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dc954-63eb-4375-9d06-c1c199d462e2 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:57.196788 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dc954-63eb-4375-9d06-c1c199d462e2 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:57.197062 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dc954-63eb-4375-9d06-c1c199d462e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:57.254450 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-831dc954-63eb-4375-9d06-c1c199d462e2 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:50:57.255805 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-831dc954-63eb-4375-9d06-c1c199d462e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:57.317271 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1126/2236] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:50:57.325863 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6276296-85f5-4116-948c-6acdb39f380f None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:57.326114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6276296-85f5-4116-948c-6acdb39f380f None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:57.326410 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6276296-85f5-4116-948c-6acdb39f380f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:57.346700 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-c6276296-85f5-4116-948c-6acdb39f380f None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:50:57.347984 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-c6276296-85f5-4116-948c-6acdb39f380f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:57.358009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1111/2237] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:50:57.362210 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dc954-63eb-4375-9d06-c1c199d462e2 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:57.373711 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dc954-63eb-4375-9d06-c1c199d462e2 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:57.378277 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b61365-c553-44a3-9b4b-0785581bbd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:57.378940 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b61365-c553-44a3-9b4b-0785581bbd4f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:57.379212 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b61365-c553-44a3-9b4b-0785581bbd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:57.379473 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b61365-c553-44a3-9b4b-0785581bbd4f admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:57.380294 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b61365-c553-44a3-9b4b-0785581bbd4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:50:57.380835 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b61365-c553-44a3-9b4b-0785581bbd4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:57.382198 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b61365-c553-44a3-9b4b-0785581bbd4f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:57.395175 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1127/2238] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:50:57.399771 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6276296-85f5-4116-948c-6acdb39f380f None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:57.409046 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6276296-85f5-4116-948c-6acdb39f380f None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:57.414566 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f480ce-7678-44a9-a286-78a3a47078e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:57.415220 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f480ce-7678-44a9-a286-78a3a47078e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:57.415500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f480ce-7678-44a9-a286-78a3a47078e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:57.415774 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f480ce-7678-44a9-a286-78a3a47078e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:57.416505 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f480ce-7678-44a9-a286-78a3a47078e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:57.418466 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f480ce-7678-44a9-a286-78a3a47078e8 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:57.445771 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1112/2239] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:50:57 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:50:57.449759 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b61365-c553-44a3-9b4b-0785581bbd4f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:57.459399 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b61365-c553-44a3-9b4b-0785581bbd4f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:57.522927 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d609e-43d0-4be0-be0c-1e096aeb09f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:57.523626 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d609e-43d0-4be0-be0c-1e096aeb09f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:57.523902 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d609e-43d0-4be0-be0c-1e096aeb09f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:57.524164 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d609e-43d0-4be0-be0c-1e096aeb09f9 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:57.524846 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d609e-43d0-4be0-be0c-1e096aeb09f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:57.526831 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d609e-43d0-4be0-be0c-1e096aeb09f9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:57.547296 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1128/2240] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:50:57 2022] POST /identity/v3/users => generated 302 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:50:57.553200 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f480ce-7678-44a9-a286-78a3a47078e8 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:57.563725 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f480ce-7678-44a9-a286-78a3a47078e8 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:57.568840 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77db99-220d-420d-bfb6-5a2d0115dda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:57.569507 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77db99-220d-420d-bfb6-5a2d0115dda7 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:57.569778 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77db99-220d-420d-bfb6-5a2d0115dda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:57.570041 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77db99-220d-420d-bfb6-5a2d0115dda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:57.570786 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77db99-220d-420d-bfb6-5a2d0115dda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:57.572406 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77db99-220d-420d-bfb6-5a2d0115dda7 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:57.582786 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1113/2241] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:50:57.586913 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d609e-43d0-4be0-be0c-1e096aeb09f9 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:57.596651 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d609e-43d0-4be0-be0c-1e096aeb09f9 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:57.602163 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc1b42-6bc7-4e1a-aa55-3259a9bfbcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:57.602814 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc1b42-6bc7-4e1a-aa55-3259a9bfbcb4 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:57.603092 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc1b42-6bc7-4e1a-aa55-3259a9bfbcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:57.603360 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc1b42-6bc7-4e1a-aa55-3259a9bfbcb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:57.604158 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc1b42-6bc7-4e1a-aa55-3259a9bfbcb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:57.605754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc1b42-6bc7-4e1a-aa55-3259a9bfbcb4 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:57.615736 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1129/2242] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:50:57.619797 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77db99-220d-420d-bfb6-5a2d0115dda7 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:57.629866 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77db99-220d-420d-bfb6-5a2d0115dda7 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:57.635260 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca2a60-5aef-461b-a7ba-fdee07c74938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:57.636152 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca2a60-5aef-461b-a7ba-fdee07c74938 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:57.636445 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca2a60-5aef-461b-a7ba-fdee07c74938 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:57.636702 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca2a60-5aef-461b-a7ba-fdee07c74938 admin admin] PATH_INFO: `/v3/projects/fcea38334db7411286bf8be5056ae9b9/users/f6ca5f73cbf74683ae6010bca77687b4/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:57.652155 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca2a60-5aef-461b-a7ba-fdee07c74938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcea38334db7411286bf8be5056ae9b9, user_id=f6ca5f73cbf74683ae6010bca77687b4, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:57.654781 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca2a60-5aef-461b-a7ba-fdee07c74938 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:57.670301 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1114/2243] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:50:57 2022] PUT /identity/v3/projects/fcea38334db7411286bf8be5056ae9b9/users/f6ca5f73cbf74683ae6010bca77687b4/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:50:57.680919 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227754b-6b37-4f5e-9415-c836cd774e8a None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:57.681209 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227754b-6b37-4f5e-9415-c836cd774e8a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:57.681481 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227754b-6b37-4f5e-9415-c836cd774e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:57.709728 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-d227754b-6b37-4f5e-9415-c836cd774e8a None None] MFA Rules not processed for user `f6ca5f73cbf74683ae6010bca77687b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:50:57.711002 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d227754b-6b37-4f5e-9415-c836cd774e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:57.784076 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1130/2244] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:50:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:50:57.788616 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca2a60-5aef-461b-a7ba-fdee07c74938 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:57.852489 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca2a60-5aef-461b-a7ba-fdee07c74938 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:57.858267 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a56be9-8672-4a77-8676-7b4131ad8804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:57.858930 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a56be9-8672-4a77-8676-7b4131ad8804 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:57.859188 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a56be9-8672-4a77-8676-7b4131ad8804 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:57.859451 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a56be9-8672-4a77-8676-7b4131ad8804 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:57.860195 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a56be9-8672-4a77-8676-7b4131ad8804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:57.862073 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a56be9-8672-4a77-8676-7b4131ad8804 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:57.888830 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1115/2245] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:50:57 2022] POST /identity/v3/projects => generated 405 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:50:57.892920 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227754b-6b37-4f5e-9415-c836cd774e8a None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:57.904819 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227754b-6b37-4f5e-9415-c836cd774e8a None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:57.972999 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4db65-0be0-4bc7-83ee-a9abdcc9ccb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:57.973580 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4db65-0be0-4bc7-83ee-a9abdcc9ccb1 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:57.973878 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4db65-0be0-4bc7-83ee-a9abdcc9ccb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:57.974231 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4db65-0be0-4bc7-83ee-a9abdcc9ccb1 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:57.974936 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4db65-0be0-4bc7-83ee-a9abdcc9ccb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:57.976888 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4db65-0be0-4bc7-83ee-a9abdcc9ccb1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:57.997738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1131/2246] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:50:57 2022] POST /identity/v3/users => generated 309 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:50:58.003321 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a56be9-8672-4a77-8676-7b4131ad8804 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:58.014182 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a56be9-8672-4a77-8676-7b4131ad8804 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:58.020404 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ba3af-d3c6-4834-adee-21ee3e302b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:58.021505 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ba3af-d3c6-4834-adee-21ee3e302b73 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:58.021786 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ba3af-d3c6-4834-adee-21ee3e302b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:58.022055 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ba3af-d3c6-4834-adee-21ee3e302b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:58.022795 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ba3af-d3c6-4834-adee-21ee3e302b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:58.024425 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ba3af-d3c6-4834-adee-21ee3e302b73 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:58.035321 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1116/2247] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:50:58.040201 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4db65-0be0-4bc7-83ee-a9abdcc9ccb1 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:58.052859 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4db65-0be0-4bc7-83ee-a9abdcc9ccb1 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:58.057949 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8a2fa-1316-4929-8dda-948256c43ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:58.058845 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8a2fa-1316-4929-8dda-948256c43ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:58.059145 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8a2fa-1316-4929-8dda-948256c43ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:58.059874 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8a2fa-1316-4929-8dda-948256c43ab9 admin admin] PATH_INFO: `/v3/projects/874c1c6d57bd43a2a2430c5f11c5adc0/users/a381864db98b43b2af40c5babfc09523/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:58.075307 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8a2fa-1316-4929-8dda-948256c43ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=874c1c6d57bd43a2a2430c5f11c5adc0, user_id=a381864db98b43b2af40c5babfc09523, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:58.078020 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8a2fa-1316-4929-8dda-948256c43ab9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:58.092887 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1132/2248] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:50:58 2022] PUT /identity/v3/projects/874c1c6d57bd43a2a2430c5f11c5adc0/users/a381864db98b43b2af40c5babfc09523/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:50:58.097236 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ba3af-d3c6-4834-adee-21ee3e302b73 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:58.108047 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ba3af-d3c6-4834-adee-21ee3e302b73 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:58.168222 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356f048-6060-4da2-9e76-ff85d33c8f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:58.168898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356f048-6060-4da2-9e76-ff85d33c8f02 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:58.169176 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356f048-6060-4da2-9e76-ff85d33c8f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:58.169472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356f048-6060-4da2-9e76-ff85d33c8f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:58.170216 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356f048-6060-4da2-9e76-ff85d33c8f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:58.171881 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356f048-6060-4da2-9e76-ff85d33c8f02 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:58.182836 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1117/2249] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:50:58.187658 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8a2fa-1316-4929-8dda-948256c43ab9 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:58.199252 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8a2fa-1316-4929-8dda-948256c43ab9 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:58.205129 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d369e6-89d5-484c-a460-60bd308745fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:58.205986 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d369e6-89d5-484c-a460-60bd308745fd admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:58.206265 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d369e6-89d5-484c-a460-60bd308745fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:58.206536 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d369e6-89d5-484c-a460-60bd308745fd admin admin] PATH_INFO: `/v3/projects/874c1c6d57bd43a2a2430c5f11c5adc0/users/a381864db98b43b2af40c5babfc09523/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:58.208728 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d369e6-89d5-484c-a460-60bd308745fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=874c1c6d57bd43a2a2430c5f11c5adc0, user_id=a381864db98b43b2af40c5babfc09523, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:58.211388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d369e6-89d5-484c-a460-60bd308745fd admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:58.222031 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1133/2250] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:50:58 2022] PUT /identity/v3/projects/874c1c6d57bd43a2a2430c5f11c5adc0/users/a381864db98b43b2af40c5babfc09523/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:50:58.233791 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ca2b9-3353-4b25-80b4-3ea29a0cbd42 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:58.234015 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ca2b9-3353-4b25-80b4-3ea29a0cbd42 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:58.234284 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ca2b9-3353-4b25-80b4-3ea29a0cbd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:58.264373 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-369ca2b9-3353-4b25-80b4-3ea29a0cbd42 None None] MFA Rules not processed for user `a381864db98b43b2af40c5babfc09523`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:50:58.265704 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-369ca2b9-3353-4b25-80b4-3ea29a0cbd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:58.342576 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1118/2251] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:50:58 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:50:58.356871 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d369e6-89d5-484c-a460-60bd308745fd admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:58.360103 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-a2d369e6-89d5-484c-a460-60bd308745fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:58.450390 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d369e6-89d5-484c-a460-60bd308745fd admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:58.454738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c9e59-d063-4e61-aa38-fa748336203f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:58.456063 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c9e59-d063-4e61-aa38-fa748336203f service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:58.456508 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c9e59-d063-4e61-aa38-fa748336203f service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:58.456918 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c9e59-d063-4e61-aa38-fa748336203f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:58.468508 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c9e59-d063-4e61-aa38-fa748336203f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:58.470188 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c9e59-d063-4e61-aa38-fa748336203f service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:58.480925 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1134/2252] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:50:58 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:50:59.398683 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ca2b9-3353-4b25-80b4-3ea29a0cbd42 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:59.480326 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ca2b9-3353-4b25-80b4-3ea29a0cbd42 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:59.485431 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e78599-df17-47f4-be49-e03a4ade1c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:59.486325 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e78599-df17-47f4-be49-e03a4ade1c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:59.486756 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e78599-df17-47f4-be49-e03a4ade1c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:59.486888 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e78599-df17-47f4-be49-e03a4ade1c65 admin admin] PATH_INFO: `/v3/users/f6ca5f73cbf74683ae6010bca77687b4` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:59.488716 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e78599-df17-47f4-be49-e03a4ade1c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ca5f73cbf74683ae6010bca77687b4)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:59.490301 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e78599-df17-47f4-be49-e03a4ade1c65 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:59.538642 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-91e78599-df17-47f4-be49-e03a4ade1c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ca5f73cbf74683ae6010bca77687b4'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:59.539297 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-91e78599-df17-47f4-be49-e03a4ade1c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ca5f73cbf74683ae6010bca77687b4'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:59.539923 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-91e78599-df17-47f4-be49-e03a4ade1c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ca5f73cbf74683ae6010bca77687b4'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:59.550982 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-91e78599-df17-47f4-be49-e03a4ade1c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ca5f73cbf74683ae6010bca77687b4'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:59.558107 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-91e78599-df17-47f4-be49-e03a4ade1c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ca5f73cbf74683ae6010bca77687b4'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:50:59.572231 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1119/2253] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:50:59 2022] DELETE /identity/v3/users/f6ca5f73cbf74683ae6010bca77687b4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:50:59.576828 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b0738-8a02-4741-ab7d-9b41bbdb87b0 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:59.577303 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b0738-8a02-4741-ab7d-9b41bbdb87b0 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:59.577494 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b0738-8a02-4741-ab7d-9b41bbdb87b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:59.595379 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-772b0738-8a02-4741-ab7d-9b41bbdb87b0 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:50:59.596881 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-772b0738-8a02-4741-ab7d-9b41bbdb87b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:59.662236 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1135/2254] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:50:59.672277 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e78599-df17-47f4-be49-e03a4ade1c65 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:50:59.673689 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-91e78599-df17-47f4-be49-e03a4ade1c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:50:59.734092 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e78599-df17-47f4-be49-e03a4ade1c65 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:50:59.738370 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc917f34-7831-437b-9fac-ef1a81be566e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:50:59.738961 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc917f34-7831-437b-9fac-ef1a81be566e service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:50:59.739238 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc917f34-7831-437b-9fac-ef1a81be566e service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:50:59.739506 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc917f34-7831-437b-9fac-ef1a81be566e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:50:59.752195 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc917f34-7831-437b-9fac-ef1a81be566e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:50:59.753657 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc917f34-7831-437b-9fac-ef1a81be566e service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:50:59.764784 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1120/2255] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:51:00.046681 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b0738-8a02-4741-ab7d-9b41bbdb87b0 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:00.048378 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-772b0738-8a02-4741-ab7d-9b41bbdb87b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:00.071605 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b0738-8a02-4741-ab7d-9b41bbdb87b0 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:00.076816 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f455fb-9597-4e93-ae8b-7614643420ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:00.077818 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f455fb-9597-4e93-ae8b-7614643420ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:00.078103 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f455fb-9597-4e93-ae8b-7614643420ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:00.078375 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f455fb-9597-4e93-ae8b-7614643420ff admin admin] PATH_INFO: `/v3/projects/fcea38334db7411286bf8be5056ae9b9` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:00.079716 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f455fb-9597-4e93-ae8b-7614643420ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcea38334db7411286bf8be5056ae9b9)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:00.081664 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f455fb-9597-4e93-ae8b-7614643420ff admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:00.130425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c5f455fb-9597-4e93-ae8b-7614643420ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcea38334db7411286bf8be5056ae9b9', 'request_id': 'req-c5f455fb-9597-4e93-ae8b-7614643420ff'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:00.137049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c5f455fb-9597-4e93-ae8b-7614643420ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcea38334db7411286bf8be5056ae9b9', 'request_id': 'req-c5f455fb-9597-4e93-ae8b-7614643420ff'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:00.146640 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c5f455fb-9597-4e93-ae8b-7614643420ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcea38334db7411286bf8be5056ae9b9', 'request_id': 'req-c5f455fb-9597-4e93-ae8b-7614643420ff'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:00.157484 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c5f455fb-9597-4e93-ae8b-7614643420ff admin admin] The token cache is being invalidate because project fcea38334db7411286bf8be5056ae9b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:51:00.157873 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c5f455fb-9597-4e93-ae8b-7614643420ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:00.158502 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c5f455fb-9597-4e93-ae8b-7614643420ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:00.160395 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1136/2256] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:51:00 2022] DELETE /identity/v3/projects/fcea38334db7411286bf8be5056ae9b9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:00.165095 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc917f34-7831-437b-9fac-ef1a81be566e service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:00.175175 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc917f34-7831-437b-9fac-ef1a81be566e service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:00.235234 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ea36b-6ed9-4406-8e96-cea9dd4bf984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:00.236142 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ea36b-6ed9-4406-8e96-cea9dd4bf984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:00.236422 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ea36b-6ed9-4406-8e96-cea9dd4bf984 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:00.236693 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ea36b-6ed9-4406-8e96-cea9dd4bf984 admin admin] PATH_INFO: `/v3/users/a381864db98b43b2af40c5babfc09523` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:00.237887 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ea36b-6ed9-4406-8e96-cea9dd4bf984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a381864db98b43b2af40c5babfc09523)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:00.239860 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ea36b-6ed9-4406-8e96-cea9dd4bf984 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:00.291066 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-472ea36b-6ed9-4406-8e96-cea9dd4bf984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a381864db98b43b2af40c5babfc09523'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:00.291743 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-472ea36b-6ed9-4406-8e96-cea9dd4bf984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a381864db98b43b2af40c5babfc09523'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:00.292334 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-472ea36b-6ed9-4406-8e96-cea9dd4bf984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a381864db98b43b2af40c5babfc09523'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:00.303610 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-472ea36b-6ed9-4406-8e96-cea9dd4bf984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a381864db98b43b2af40c5babfc09523'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:00.310563 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-472ea36b-6ed9-4406-8e96-cea9dd4bf984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a381864db98b43b2af40c5babfc09523'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:00.324857 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1121/2257] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:51:00 2022] DELETE /identity/v3/users/a381864db98b43b2af40c5babfc09523 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:00.618712 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f455fb-9597-4e93-ae8b-7614643420ff admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:00.620889 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c5f455fb-9597-4e93-ae8b-7614643420ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:00.639648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f455fb-9597-4e93-ae8b-7614643420ff admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:00.712836 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db41a8-e4ce-4fac-8863-5f2943fe61dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:00.713889 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db41a8-e4ce-4fac-8863-5f2943fe61dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:00.714069 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db41a8-e4ce-4fac-8863-5f2943fe61dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:00.714361 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db41a8-e4ce-4fac-8863-5f2943fe61dd admin admin] PATH_INFO: `/v3/projects/874c1c6d57bd43a2a2430c5f11c5adc0` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:00.715652 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db41a8-e4ce-4fac-8863-5f2943fe61dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=874c1c6d57bd43a2a2430c5f11c5adc0)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:00.717586 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db41a8-e4ce-4fac-8863-5f2943fe61dd admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:00.764658 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c6db41a8-e4ce-4fac-8863-5f2943fe61dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '874c1c6d57bd43a2a2430c5f11c5adc0', 'request_id': 'req-c6db41a8-e4ce-4fac-8863-5f2943fe61dd'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:00.771409 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c6db41a8-e4ce-4fac-8863-5f2943fe61dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '874c1c6d57bd43a2a2430c5f11c5adc0', 'request_id': 'req-c6db41a8-e4ce-4fac-8863-5f2943fe61dd'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:00.781193 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c6db41a8-e4ce-4fac-8863-5f2943fe61dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '874c1c6d57bd43a2a2430c5f11c5adc0', 'request_id': 'req-c6db41a8-e4ce-4fac-8863-5f2943fe61dd'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:00.795703 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c6db41a8-e4ce-4fac-8863-5f2943fe61dd admin admin] The token cache is being invalidate because project 874c1c6d57bd43a2a2430c5f11c5adc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:51:00.796024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c6db41a8-e4ce-4fac-8863-5f2943fe61dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:00.796677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c6db41a8-e4ce-4fac-8863-5f2943fe61dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:00.798239 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1137/2258] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:51:00 2022] DELETE /identity/v3/projects/874c1c6d57bd43a2a2430c5f11c5adc0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:00.804301 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cba36-a07f-45dd-89dd-ffb80d839119 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:00.804803 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cba36-a07f-45dd-89dd-ffb80d839119 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:00.804915 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cba36-a07f-45dd-89dd-ffb80d839119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:00.823225 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-e10cba36-a07f-45dd-89dd-ffb80d839119 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:00.824468 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e10cba36-a07f-45dd-89dd-ffb80d839119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:00.882420 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1122/2259] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:00.890195 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ea0d1-113d-4edc-be75-f082c19f1766 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:00.890482 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ea0d1-113d-4edc-be75-f082c19f1766 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:00.890762 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ea0d1-113d-4edc-be75-f082c19f1766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:00.921903 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-778ea0d1-113d-4edc-be75-f082c19f1766 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:00.923063 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-778ea0d1-113d-4edc-be75-f082c19f1766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:00.932740 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1138/2260] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:00.937447 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cba36-a07f-45dd-89dd-ffb80d839119 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:00.945224 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580cfa1-609b-42b7-83be-d0f1e48ea67b None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:00.945582 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580cfa1-609b-42b7-83be-d0f1e48ea67b None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:00.945753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580cfa1-609b-42b7-83be-d0f1e48ea67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:00.947940 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cba36-a07f-45dd-89dd-ffb80d839119 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:00.954691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25321a48-89b5-419c-9fa2-535ef692e22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:00.955356 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321a48-89b5-419c-9fa2-535ef692e22c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:00.955680 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321a48-89b5-419c-9fa2-535ef692e22c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:00.955987 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321a48-89b5-419c-9fa2-535ef692e22c admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:00.956701 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25321a48-89b5-419c-9fa2-535ef692e22c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:51:00.958136 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25321a48-89b5-419c-9fa2-535ef692e22c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:00.958639 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25321a48-89b5-419c-9fa2-535ef692e22c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:00.970809 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1123/2261] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:51:00.974785 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25321a48-89b5-419c-9fa2-535ef692e22c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:00.977916 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-c580cfa1-609b-42b7-83be-d0f1e48ea67b None None] MFA Rules not processed for user `44e5602fd019411aa8f0e091ed533ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:00.979337 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c580cfa1-609b-42b7-83be-d0f1e48ea67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:00.984630 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25321a48-89b5-419c-9fa2-535ef692e22c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:00.989450 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62e6aa-7a30-4ba9-bbfd-2ba7f6d7a97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:00.990205 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62e6aa-7a30-4ba9-bbfd-2ba7f6d7a97f admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:00.990532 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62e6aa-7a30-4ba9-bbfd-2ba7f6d7a97f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:00.990811 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62e6aa-7a30-4ba9-bbfd-2ba7f6d7a97f admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:00.991579 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62e6aa-7a30-4ba9-bbfd-2ba7f6d7a97f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:00.993488 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62e6aa-7a30-4ba9-bbfd-2ba7f6d7a97f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:01.023084 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1124/2262] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:51:00 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:51:01.027054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62e6aa-7a30-4ba9-bbfd-2ba7f6d7a97f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:01.055385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1139/2263] 10.222.0.13 () {58 vars in 967 bytes} [Mon Jan 10 12:51:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:51:01.081276 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580cfa1-609b-42b7-83be-d0f1e48ea67b None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:01.082673 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c580cfa1-609b-42b7-83be-d0f1e48ea67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:01.092079 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62e6aa-7a30-4ba9-bbfd-2ba7f6d7a97f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:01.097257 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a496c-68a7-4b3d-a0ea-32cd3ecf5f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:01.097913 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a496c-68a7-4b3d-a0ea-32cd3ecf5f7c admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:01.098212 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a496c-68a7-4b3d-a0ea-32cd3ecf5f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:01.098495 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a496c-68a7-4b3d-a0ea-32cd3ecf5f7c admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:01.099401 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a496c-68a7-4b3d-a0ea-32cd3ecf5f7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:01.101953 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a496c-68a7-4b3d-a0ea-32cd3ecf5f7c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:01.126508 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1125/2264] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:51:01 2022] POST /identity/v3/users => generated 302 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:51:01.130478 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a496c-68a7-4b3d-a0ea-32cd3ecf5f7c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:01.141331 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a496c-68a7-4b3d-a0ea-32cd3ecf5f7c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:01.148860 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d155c-52d5-42ae-a7a2-48d9b17e4ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:01.149543 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d155c-52d5-42ae-a7a2-48d9b17e4ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:01.149849 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d155c-52d5-42ae-a7a2-48d9b17e4ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:01.150091 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d155c-52d5-42ae-a7a2-48d9b17e4ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:01.150837 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d155c-52d5-42ae-a7a2-48d9b17e4ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:01.152628 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d155c-52d5-42ae-a7a2-48d9b17e4ac2 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:01.162078 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c580cfa1-609b-42b7-83be-d0f1e48ea67b None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:01.163966 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1126/2265] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:01.167700 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d155c-52d5-42ae-a7a2-48d9b17e4ac2 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:01.177580 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d155c-52d5-42ae-a7a2-48d9b17e4ac2 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:01.182218 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10d440-db75-4c14-8d60-46a577ba9e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:01.182879 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10d440-db75-4c14-8d60-46a577ba9e59 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:01.183158 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10d440-db75-4c14-8d60-46a577ba9e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:01.183428 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10d440-db75-4c14-8d60-46a577ba9e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:01.184614 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10d440-db75-4c14-8d60-46a577ba9e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:01.186206 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10d440-db75-4c14-8d60-46a577ba9e59 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:01.197020 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1127/2266] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:51:01.201012 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10d440-db75-4c14-8d60-46a577ba9e59 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:01.210968 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10d440-db75-4c14-8d60-46a577ba9e59 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:01.216029 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c868fda-e8de-4055-9f62-d35d57036de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:01.216919 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c868fda-e8de-4055-9f62-d35d57036de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:01.217859 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c868fda-e8de-4055-9f62-d35d57036de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:01.218207 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c868fda-e8de-4055-9f62-d35d57036de7 admin admin] PATH_INFO: `/v3/projects/758d960404ad471a9fe52ab515d7729a/users/7a94b35991334195ad293a966b82f3ee/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:01.236530 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563e910-f76d-4799-816b-1e4b4922eb69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd898c7c2974bb38998ebad22fd5a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:01.237716 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563e910-f76d-4799-816b-1e4b4922eb69 service swift] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:01.238215 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563e910-f76d-4799-816b-1e4b4922eb69 service swift] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:01.238771 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563e910-f76d-4799-816b-1e4b4922eb69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:01.239889 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c868fda-e8de-4055-9f62-d35d57036de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758d960404ad471a9fe52ab515d7729a, user_id=7a94b35991334195ad293a966b82f3ee, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:01.242880 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c868fda-e8de-4055-9f62-d35d57036de7 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:01.280544 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1128/2267] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:01 2022] PUT /identity/v3/projects/758d960404ad471a9fe52ab515d7729a/users/7a94b35991334195ad293a966b82f3ee/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:51:01.281954 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea2bc0-d19f-4d74-a333-3d39d7f40566 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:01.282240 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea2bc0-d19f-4d74-a333-3d39d7f40566 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:01.282506 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea2bc0-d19f-4d74-a333-3d39d7f40566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:01.300727 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-bfea2bc0-d19f-4d74-a333-3d39d7f40566 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:01.301931 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-bfea2bc0-d19f-4d74-a333-3d39d7f40566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:01.305881 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563e910-f76d-4799-816b-1e4b4922eb69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:01.307507 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563e910-f76d-4799-816b-1e4b4922eb69 service swift] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:01.316536 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1140/2268] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jan 10 12:51:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 10 12:51:01.367371 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1129/2269] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:51:01.377025 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563e910-f76d-4799-816b-1e4b4922eb69 service swift] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:01.378415 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-4563e910-f76d-4799-816b-1e4b4922eb69 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:01.445469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563e910-f76d-4799-816b-1e4b4922eb69 service swift] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:01.501858 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dbae4-43b4-4c68-89ec-f42f238ef215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:01.502629 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dbae4-43b4-4c68-89ec-f42f238ef215 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:01.502923 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dbae4-43b4-4c68-89ec-f42f238ef215 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:01.503086 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dbae4-43b4-4c68-89ec-f42f238ef215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:01.512989 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dbae4-43b4-4c68-89ec-f42f238ef215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:01.514455 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dbae4-43b4-4c68-89ec-f42f238ef215 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:01.524184 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1141/2270] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:51:02.215502 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8474a-d188-4cb3-bb78-c54eababf554 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:02.216029 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8474a-d188-4cb3-bb78-c54eababf554 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:02.216154 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8474a-d188-4cb3-bb78-c54eababf554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:02.243996 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-8bd8474a-d188-4cb3-bb78-c54eababf554 None None] MFA Rules not processed for user `7a94b35991334195ad293a966b82f3ee`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:02.245228 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-8bd8474a-d188-4cb3-bb78-c54eababf554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:02.315064 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1130/2271] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:02.319725 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dbae4-43b4-4c68-89ec-f42f238ef215 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:02.329378 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dbae4-43b4-4c68-89ec-f42f238ef215 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:02.343899 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfaf729-5040-4fa7-8e74-67f1eaef8ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:02.344573 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaf729-5040-4fa7-8e74-67f1eaef8ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:02.344849 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaf729-5040-4fa7-8e74-67f1eaef8ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:02.345117 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaf729-5040-4fa7-8e74-67f1eaef8ab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:02.345934 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfaf729-5040-4fa7-8e74-67f1eaef8ab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:02.347773 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfaf729-5040-4fa7-8e74-67f1eaef8ab3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:02.375346 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1142/2272] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:51:02 2022] POST /identity/v3/projects => generated 405 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:51:02.379420 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8474a-d188-4cb3-bb78-c54eababf554 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:02.393962 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8474a-d188-4cb3-bb78-c54eababf554 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:02.453822 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd279e70-4228-4ec3-8d76-36c8b230502c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:02.454498 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd279e70-4228-4ec3-8d76-36c8b230502c admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:02.454774 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd279e70-4228-4ec3-8d76-36c8b230502c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:02.455045 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd279e70-4228-4ec3-8d76-36c8b230502c admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:02.455775 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd279e70-4228-4ec3-8d76-36c8b230502c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:02.457675 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd279e70-4228-4ec3-8d76-36c8b230502c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:02.482039 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1131/2273] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:51:02 2022] POST /identity/v3/users => generated 309 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:51:02.486087 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfaf729-5040-4fa7-8e74-67f1eaef8ab3 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:02.496250 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfaf729-5040-4fa7-8e74-67f1eaef8ab3 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:02.503372 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf93a92-b980-4a79-a997-17fe54f9951e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:02.504272 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf93a92-b980-4a79-a997-17fe54f9951e admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:02.504554 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf93a92-b980-4a79-a997-17fe54f9951e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:02.504814 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf93a92-b980-4a79-a997-17fe54f9951e admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:02.505784 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf93a92-b980-4a79-a997-17fe54f9951e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:02.507500 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf93a92-b980-4a79-a997-17fe54f9951e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:02.519249 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1143/2274] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:02.523127 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd279e70-4228-4ec3-8d76-36c8b230502c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:02.533634 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd279e70-4228-4ec3-8d76-36c8b230502c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:02.539713 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d28e12-d083-46e5-8cc5-761b9ec7637c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:02.540723 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d28e12-d083-46e5-8cc5-761b9ec7637c admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:02.540944 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d28e12-d083-46e5-8cc5-761b9ec7637c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:02.541213 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d28e12-d083-46e5-8cc5-761b9ec7637c admin admin] PATH_INFO: `/v3/projects/d302931a4de94270948fe2e83133fe5b/users/428f8e42141e454b966d68ef8673bbfd/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:02.557553 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d28e12-d083-46e5-8cc5-761b9ec7637c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d302931a4de94270948fe2e83133fe5b, user_id=428f8e42141e454b966d68ef8673bbfd, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:02.560716 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d28e12-d083-46e5-8cc5-761b9ec7637c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:02.577042 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1132/2275] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:02 2022] PUT /identity/v3/projects/d302931a4de94270948fe2e83133fe5b/users/428f8e42141e454b966d68ef8673bbfd/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:51:02.581332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf93a92-b980-4a79-a997-17fe54f9951e admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:02.591180 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf93a92-b980-4a79-a997-17fe54f9951e admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:02.647300 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16457881-0bdd-4038-aad1-88209072cd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:02.648036 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16457881-0bdd-4038-aad1-88209072cd83 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:02.648315 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16457881-0bdd-4038-aad1-88209072cd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:02.648586 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16457881-0bdd-4038-aad1-88209072cd83 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:02.649327 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16457881-0bdd-4038-aad1-88209072cd83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:02.650929 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16457881-0bdd-4038-aad1-88209072cd83 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:02.660722 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1144/2276] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:02.664932 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d28e12-d083-46e5-8cc5-761b9ec7637c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:02.674874 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d28e12-d083-46e5-8cc5-761b9ec7637c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:02.679789 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d05395-07d4-4460-91b6-ee2c1529e631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:02.680676 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d05395-07d4-4460-91b6-ee2c1529e631 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:02.680959 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d05395-07d4-4460-91b6-ee2c1529e631 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:02.681228 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d05395-07d4-4460-91b6-ee2c1529e631 admin admin] PATH_INFO: `/v3/projects/d302931a4de94270948fe2e83133fe5b/users/428f8e42141e454b966d68ef8673bbfd/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:02.683162 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d05395-07d4-4460-91b6-ee2c1529e631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d302931a4de94270948fe2e83133fe5b, user_id=428f8e42141e454b966d68ef8673bbfd, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:02.686236 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d05395-07d4-4460-91b6-ee2c1529e631 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:02.696434 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1133/2277] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:02 2022] PUT /identity/v3/projects/d302931a4de94270948fe2e83133fe5b/users/428f8e42141e454b966d68ef8673bbfd/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:03.296189 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b154-e693-4052-b215-0413bdbf5f32 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:03.296586 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b154-e693-4052-b215-0413bdbf5f32 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:03.297391 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3b154-e693-4052-b215-0413bdbf5f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:03.331128 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-1aa3b154-e693-4052-b215-0413bdbf5f32 None None] MFA Rules not processed for user `428f8e42141e454b966d68ef8673bbfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:03.332626 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-1aa3b154-e693-4052-b215-0413bdbf5f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:03.408903 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1145/2278] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:03 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:04.441845 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d05395-07d4-4460-91b6-ee2c1529e631 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:04.516949 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d05395-07d4-4460-91b6-ee2c1529e631 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:04.521810 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda33235-41a4-499f-9678-84990d635bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:04.522695 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda33235-41a4-499f-9678-84990d635bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:04.522970 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda33235-41a4-499f-9678-84990d635bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:04.523241 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda33235-41a4-499f-9678-84990d635bf3 admin admin] PATH_INFO: `/v3/users/7a94b35991334195ad293a966b82f3ee` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:04.524840 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda33235-41a4-499f-9678-84990d635bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a94b35991334195ad293a966b82f3ee)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:04.526895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda33235-41a4-499f-9678-84990d635bf3 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:04.574941 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bda33235-41a4-499f-9678-84990d635bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a94b35991334195ad293a966b82f3ee'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:04.575679 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bda33235-41a4-499f-9678-84990d635bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a94b35991334195ad293a966b82f3ee'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:04.576270 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bda33235-41a4-499f-9678-84990d635bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a94b35991334195ad293a966b82f3ee'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:04.587756 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bda33235-41a4-499f-9678-84990d635bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a94b35991334195ad293a966b82f3ee'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:04.594551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bda33235-41a4-499f-9678-84990d635bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a94b35991334195ad293a966b82f3ee'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:04.608005 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1134/2279] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:51:04 2022] DELETE /identity/v3/users/7a94b35991334195ad293a966b82f3ee => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:04.806956 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3b154-e693-4052-b215-0413bdbf5f32 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:04.848825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3b154-e693-4052-b215-0413bdbf5f32 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:04.916563 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331b17f-0fcb-4626-96e0-834586ec43b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:04.917686 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b17f-0fcb-4626-96e0-834586ec43b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:04.918211 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b17f-0fcb-4626-96e0-834586ec43b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:04.918375 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b17f-0fcb-4626-96e0-834586ec43b5 admin admin] PATH_INFO: `/v3/projects/758d960404ad471a9fe52ab515d7729a` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:04.920292 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331b17f-0fcb-4626-96e0-834586ec43b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=758d960404ad471a9fe52ab515d7729a)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:04.923018 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331b17f-0fcb-4626-96e0-834586ec43b5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:04.978545 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0331b17f-0fcb-4626-96e0-834586ec43b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758d960404ad471a9fe52ab515d7729a', 'request_id': 'req-0331b17f-0fcb-4626-96e0-834586ec43b5'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:04.984786 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0331b17f-0fcb-4626-96e0-834586ec43b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758d960404ad471a9fe52ab515d7729a', 'request_id': 'req-0331b17f-0fcb-4626-96e0-834586ec43b5'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:04.992891 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0331b17f-0fcb-4626-96e0-834586ec43b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758d960404ad471a9fe52ab515d7729a', 'request_id': 'req-0331b17f-0fcb-4626-96e0-834586ec43b5'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:05.003354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0331b17f-0fcb-4626-96e0-834586ec43b5 admin admin] The token cache is being invalidate because project 758d960404ad471a9fe52ab515d7729a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:51:05.003685 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0331b17f-0fcb-4626-96e0-834586ec43b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:05.004313 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0331b17f-0fcb-4626-96e0-834586ec43b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:05.005952 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1146/2280] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:51:04 2022] DELETE /identity/v3/projects/758d960404ad471a9fe52ab515d7729a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:05.010003 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda33235-41a4-499f-9678-84990d635bf3 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:05.011386 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-bda33235-41a4-499f-9678-84990d635bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:05.024873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda33235-41a4-499f-9678-84990d635bf3 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:05.086820 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b6911-1eae-4283-a7d7-6777595264b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:05.087670 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b6911-1eae-4283-a7d7-6777595264b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:05.087993 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b6911-1eae-4283-a7d7-6777595264b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:05.088294 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b6911-1eae-4283-a7d7-6777595264b5 admin admin] PATH_INFO: `/v3/users/428f8e42141e454b966d68ef8673bbfd` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:05.089627 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b6911-1eae-4283-a7d7-6777595264b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=428f8e42141e454b966d68ef8673bbfd)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:05.091634 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b6911-1eae-4283-a7d7-6777595264b5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:05.146097 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6a6b6911-1eae-4283-a7d7-6777595264b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '428f8e42141e454b966d68ef8673bbfd'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:05.148339 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6a6b6911-1eae-4283-a7d7-6777595264b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '428f8e42141e454b966d68ef8673bbfd'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:05.148832 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6a6b6911-1eae-4283-a7d7-6777595264b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '428f8e42141e454b966d68ef8673bbfd'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:05.162470 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6a6b6911-1eae-4283-a7d7-6777595264b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '428f8e42141e454b966d68ef8673bbfd'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:05.170626 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6a6b6911-1eae-4283-a7d7-6777595264b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '428f8e42141e454b966d68ef8673bbfd'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:05.183676 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1135/2281] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:51:05 2022] DELETE /identity/v3/users/428f8e42141e454b966d68ef8673bbfd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:05.370262 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331b17f-0fcb-4626-96e0-834586ec43b5 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:05.373534 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-0331b17f-0fcb-4626-96e0-834586ec43b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:05.386251 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331b17f-0fcb-4626-96e0-834586ec43b5 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:05.445163 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda9f04-d657-4d02-8a31-43109fac1bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:05.446054 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda9f04-d657-4d02-8a31-43109fac1bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:05.446342 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda9f04-d657-4d02-8a31-43109fac1bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:05.446604 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda9f04-d657-4d02-8a31-43109fac1bb7 admin admin] PATH_INFO: `/v3/projects/d302931a4de94270948fe2e83133fe5b` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:05.447825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda9f04-d657-4d02-8a31-43109fac1bb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d302931a4de94270948fe2e83133fe5b)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:05.449736 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda9f04-d657-4d02-8a31-43109fac1bb7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:05.495575 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ebda9f04-d657-4d02-8a31-43109fac1bb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd302931a4de94270948fe2e83133fe5b', 'request_id': 'req-ebda9f04-d657-4d02-8a31-43109fac1bb7'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:05.501799 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ebda9f04-d657-4d02-8a31-43109fac1bb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd302931a4de94270948fe2e83133fe5b', 'request_id': 'req-ebda9f04-d657-4d02-8a31-43109fac1bb7'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:05.510537 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ebda9f04-d657-4d02-8a31-43109fac1bb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd302931a4de94270948fe2e83133fe5b', 'request_id': 'req-ebda9f04-d657-4d02-8a31-43109fac1bb7'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:05.521365 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ebda9f04-d657-4d02-8a31-43109fac1bb7 admin admin] The token cache is being invalidate because project d302931a4de94270948fe2e83133fe5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:51:05.521664 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ebda9f04-d657-4d02-8a31-43109fac1bb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:05.522286 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ebda9f04-d657-4d02-8a31-43109fac1bb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:05.524530 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1147/2282] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:51:05 2022] DELETE /identity/v3/projects/d302931a4de94270948fe2e83133fe5b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:05.529914 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee82439-810e-4f57-89d0-2f7db3af7b3d None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:05.530408 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee82439-810e-4f57-89d0-2f7db3af7b3d None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:05.530584 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee82439-810e-4f57-89d0-2f7db3af7b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:05.550500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-3ee82439-810e-4f57-89d0-2f7db3af7b3d None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:05.551802 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-3ee82439-810e-4f57-89d0-2f7db3af7b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:05.614937 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1136/2283] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:05.624532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bcd50-c37f-4cb0-a73d-1deda40f97cd None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:05.624811 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bcd50-c37f-4cb0-a73d-1deda40f97cd None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:05.625162 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bcd50-c37f-4cb0-a73d-1deda40f97cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:05.650121 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-aa0bcd50-c37f-4cb0-a73d-1deda40f97cd None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:05.651317 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-aa0bcd50-c37f-4cb0-a73d-1deda40f97cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:05.663343 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1148/2284] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:05.665462 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee82439-810e-4f57-89d0-2f7db3af7b3d None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:05.683258 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee82439-810e-4f57-89d0-2f7db3af7b3d None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:05.688892 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c93bbe-1fdf-4747-b780-e6f25c643cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:05.689721 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c93bbe-1fdf-4747-b780-e6f25c643cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:05.690090 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c93bbe-1fdf-4747-b780-e6f25c643cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:05.690444 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c93bbe-1fdf-4747-b780-e6f25c643cf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:05.691279 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c93bbe-1fdf-4747-b780-e6f25c643cf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:51:05.691721 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c93bbe-1fdf-4747-b780-e6f25c643cf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:05.694458 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c93bbe-1fdf-4747-b780-e6f25c643cf5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:05.706755 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1137/2285] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:51:05.711273 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bcd50-c37f-4cb0-a73d-1deda40f97cd None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:05.722547 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bcd50-c37f-4cb0-a73d-1deda40f97cd None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:05.734654 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5d7cb-1f8c-418f-a28f-9464259cba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:05.736711 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5d7cb-1f8c-418f-a28f-9464259cba8d admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:05.737017 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5d7cb-1f8c-418f-a28f-9464259cba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:05.737287 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5d7cb-1f8c-418f-a28f-9464259cba8d admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:05.738156 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5d7cb-1f8c-418f-a28f-9464259cba8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:05.741404 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5d7cb-1f8c-418f-a28f-9464259cba8d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:05.777823 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1149/2286] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:51:05 2022] POST /identity/v3/projects => generated 393 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:51:05.782054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c93bbe-1fdf-4747-b780-e6f25c643cf5 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:05.792319 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c93bbe-1fdf-4747-b780-e6f25c643cf5 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:05.849721 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f4c11-8a3a-402e-9dba-ac5063ebb02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:05.850405 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f4c11-8a3a-402e-9dba-ac5063ebb02d admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:05.850685 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f4c11-8a3a-402e-9dba-ac5063ebb02d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:05.850956 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f4c11-8a3a-402e-9dba-ac5063ebb02d admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:05.851775 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f4c11-8a3a-402e-9dba-ac5063ebb02d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:05.853697 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f4c11-8a3a-402e-9dba-ac5063ebb02d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:05.878431 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1138/2287] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:51:05 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:51:05.879623 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5d7cb-1f8c-418f-a28f-9464259cba8d admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:05.891181 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5d7cb-1f8c-418f-a28f-9464259cba8d admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:05.896067 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3974e55-9023-418c-b5a1-c43e58611593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:05.897397 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3974e55-9023-418c-b5a1-c43e58611593 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:05.897846 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3974e55-9023-418c-b5a1-c43e58611593 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:05.898126 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3974e55-9023-418c-b5a1-c43e58611593 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:05.898897 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3974e55-9023-418c-b5a1-c43e58611593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:05.900518 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3974e55-9023-418c-b5a1-c43e58611593 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:05.912708 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1150/2288] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:51:05.917190 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f4c11-8a3a-402e-9dba-ac5063ebb02d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:05.928541 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f4c11-8a3a-402e-9dba-ac5063ebb02d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:05.933740 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b82862-0c32-4689-a7d4-c356f8d2c32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:05.934780 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b82862-0c32-4689-a7d4-c356f8d2c32c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:05.935086 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b82862-0c32-4689-a7d4-c356f8d2c32c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:05.935324 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b82862-0c32-4689-a7d4-c356f8d2c32c admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:05.936159 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b82862-0c32-4689-a7d4-c356f8d2c32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:05.937897 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b82862-0c32-4689-a7d4-c356f8d2c32c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:05.953755 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1139/2289] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:05.954530 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3974e55-9023-418c-b5a1-c43e58611593 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:05.965040 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3974e55-9023-418c-b5a1-c43e58611593 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:05.970673 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13a062-c556-4253-afa6-c85feb75123b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:05.971688 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13a062-c556-4253-afa6-c85feb75123b admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:05.972033 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13a062-c556-4253-afa6-c85feb75123b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:05.972371 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13a062-c556-4253-afa6-c85feb75123b admin admin] PATH_INFO: `/v3/projects/46114f1b7b3e4639a80ee72df075d1d0/users/d4fc0e2a9a27449883f9558e4533b8dc/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:05.992313 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13a062-c556-4253-afa6-c85feb75123b admin admin] RBAC: Authorizing `identity:create_grant(project_id=46114f1b7b3e4639a80ee72df075d1d0, user_id=d4fc0e2a9a27449883f9558e4533b8dc, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:05.995333 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13a062-c556-4253-afa6-c85feb75123b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:06.012364 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1151/2290] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:05 2022] PUT /identity/v3/projects/46114f1b7b3e4639a80ee72df075d1d0/users/d4fc0e2a9a27449883f9558e4533b8dc/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:06.024033 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e756dfc-502f-4605-b496-a6efed2ea56c None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:06.024364 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e756dfc-502f-4605-b496-a6efed2ea56c None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:06.024645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e756dfc-502f-4605-b496-a6efed2ea56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:06.052903 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-6e756dfc-502f-4605-b496-a6efed2ea56c None None] MFA Rules not processed for user `d4fc0e2a9a27449883f9558e4533b8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:06.054137 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-6e756dfc-502f-4605-b496-a6efed2ea56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:06.122241 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1140/2291] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:06.126961 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13a062-c556-4253-afa6-c85feb75123b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:06.192513 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13a062-c556-4253-afa6-c85feb75123b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:06.198321 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02c6d6-557f-4332-b79a-5f825056059c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:06.199144 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c6d6-557f-4332-b79a-5f825056059c admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:06.199552 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c6d6-557f-4332-b79a-5f825056059c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:06.199822 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c6d6-557f-4332-b79a-5f825056059c admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:06.200532 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02c6d6-557f-4332-b79a-5f825056059c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:06.202441 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02c6d6-557f-4332-b79a-5f825056059c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:06.228891 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1152/2292] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:51:06 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:51:06.233161 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e756dfc-502f-4605-b496-a6efed2ea56c None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:06.251872 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e756dfc-502f-4605-b496-a6efed2ea56c None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:06.314342 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d315a-c3fb-4b69-a2dc-c19673ce4379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:06.315027 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d315a-c3fb-4b69-a2dc-c19673ce4379 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:06.315308 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d315a-c3fb-4b69-a2dc-c19673ce4379 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:06.315574 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d315a-c3fb-4b69-a2dc-c19673ce4379 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:06.316327 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d315a-c3fb-4b69-a2dc-c19673ce4379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:06.318474 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d315a-c3fb-4b69-a2dc-c19673ce4379 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:06.340811 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1141/2293] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:51:06 2022] POST /identity/v3/users => generated 303 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:51:06.344987 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02c6d6-557f-4332-b79a-5f825056059c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:06.356256 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02c6d6-557f-4332-b79a-5f825056059c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:06.361735 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cea00-c3d8-4728-90b5-aa29beb32a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:06.362397 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cea00-c3d8-4728-90b5-aa29beb32a81 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:06.362677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cea00-c3d8-4728-90b5-aa29beb32a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:06.362943 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cea00-c3d8-4728-90b5-aa29beb32a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:06.363750 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cea00-c3d8-4728-90b5-aa29beb32a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:06.366367 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cea00-c3d8-4728-90b5-aa29beb32a81 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:06.381538 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1153/2294] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:51:06.386349 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d315a-c3fb-4b69-a2dc-c19673ce4379 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:06.398551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d315a-c3fb-4b69-a2dc-c19673ce4379 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:06.404932 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfe9e1-840e-4138-8aec-8578590118f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:06.405819 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfe9e1-840e-4138-8aec-8578590118f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:06.406097 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfe9e1-840e-4138-8aec-8578590118f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:06.406365 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfe9e1-840e-4138-8aec-8578590118f5 admin admin] PATH_INFO: `/v3/projects/38b6f30947a245d0a925e2985be9f54b/users/7aa995dc158e471485c7ecd73f035e74/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:06.423318 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfe9e1-840e-4138-8aec-8578590118f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b6f30947a245d0a925e2985be9f54b, user_id=7aa995dc158e471485c7ecd73f035e74, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:06.425994 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfe9e1-840e-4138-8aec-8578590118f5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:06.441583 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1142/2295] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:06 2022] PUT /identity/v3/projects/38b6f30947a245d0a925e2985be9f54b/users/7aa995dc158e471485c7ecd73f035e74/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:06.445935 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cea00-c3d8-4728-90b5-aa29beb32a81 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:06.456304 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cea00-c3d8-4728-90b5-aa29beb32a81 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:06.520663 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68b403-4501-49a2-bb59-b44a7fa4658b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:06.521374 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68b403-4501-49a2-bb59-b44a7fa4658b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:06.521661 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68b403-4501-49a2-bb59-b44a7fa4658b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:06.521932 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68b403-4501-49a2-bb59-b44a7fa4658b admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:06.522677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68b403-4501-49a2-bb59-b44a7fa4658b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:06.524333 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68b403-4501-49a2-bb59-b44a7fa4658b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:06.535905 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1154/2296] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:06.539122 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfe9e1-840e-4138-8aec-8578590118f5 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:06.553260 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfe9e1-840e-4138-8aec-8578590118f5 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:06.558373 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a7059-994e-41fd-801d-256ab2a09c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:06.559633 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a7059-994e-41fd-801d-256ab2a09c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:06.559910 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a7059-994e-41fd-801d-256ab2a09c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:06.560171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a7059-994e-41fd-801d-256ab2a09c94 admin admin] PATH_INFO: `/v3/projects/38b6f30947a245d0a925e2985be9f54b/users/7aa995dc158e471485c7ecd73f035e74/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:06.562264 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a7059-994e-41fd-801d-256ab2a09c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b6f30947a245d0a925e2985be9f54b, user_id=7aa995dc158e471485c7ecd73f035e74, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:06.564963 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a7059-994e-41fd-801d-256ab2a09c94 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:06.575998 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1143/2297] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:06 2022] PUT /identity/v3/projects/38b6f30947a245d0a925e2985be9f54b/users/7aa995dc158e471485c7ecd73f035e74/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:06.586374 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82732c0b-2622-4f1e-8deb-7e1e0c54923d None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:06.586656 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82732c0b-2622-4f1e-8deb-7e1e0c54923d None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:06.586895 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82732c0b-2622-4f1e-8deb-7e1e0c54923d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:06.618437 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-82732c0b-2622-4f1e-8deb-7e1e0c54923d None None] MFA Rules not processed for user `7aa995dc158e471485c7ecd73f035e74`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:06.619805 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-82732c0b-2622-4f1e-8deb-7e1e0c54923d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:06.692983 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1155/2298] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:06.703219 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a7059-994e-41fd-801d-256ab2a09c94 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:06.705036 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e91a7059-994e-41fd-801d-256ab2a09c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:06.767357 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a7059-994e-41fd-801d-256ab2a09c94 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:06.771476 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79556713-eb75-4adf-a639-977d656d419c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:06.773009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79556713-eb75-4adf-a639-977d656d419c service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:06.773009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79556713-eb75-4adf-a639-977d656d419c service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:06.773009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79556713-eb75-4adf-a639-977d656d419c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:06.785708 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79556713-eb75-4adf-a639-977d656d419c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:06.787556 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79556713-eb75-4adf-a639-977d656d419c service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:06.797357 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1144/2299] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:51:06.842991 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82732c0b-2622-4f1e-8deb-7e1e0c54923d None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:06.844514 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-82732c0b-2622-4f1e-8deb-7e1e0c54923d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:06.856916 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82732c0b-2622-4f1e-8deb-7e1e0c54923d None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:06.860863 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28565798-d945-4516-a377-be5719bd5f40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:06.861533 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28565798-d945-4516-a377-be5719bd5f40 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:06.861806 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28565798-d945-4516-a377-be5719bd5f40 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:06.862070 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28565798-d945-4516-a377-be5719bd5f40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:06.921314 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28565798-d945-4516-a377-be5719bd5f40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:06.922779 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28565798-d945-4516-a377-be5719bd5f40 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:06.933439 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1156/2300] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:51:10.326658 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79556713-eb75-4adf-a639-977d656d419c service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:10.396571 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79556713-eb75-4adf-a639-977d656d419c service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:10.401970 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be1f5f-c74a-439a-9077-b1e0017b29fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:10.402837 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be1f5f-c74a-439a-9077-b1e0017b29fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:10.403108 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be1f5f-c74a-439a-9077-b1e0017b29fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:10.403527 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be1f5f-c74a-439a-9077-b1e0017b29fe admin admin] PATH_INFO: `/v3/users/d4fc0e2a9a27449883f9558e4533b8dc` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:10.404821 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be1f5f-c74a-439a-9077-b1e0017b29fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4fc0e2a9a27449883f9558e4533b8dc)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:10.406761 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be1f5f-c74a-439a-9077-b1e0017b29fe admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:10.455160 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a8be1f5f-c74a-439a-9077-b1e0017b29fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4fc0e2a9a27449883f9558e4533b8dc'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:10.455891 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a8be1f5f-c74a-439a-9077-b1e0017b29fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4fc0e2a9a27449883f9558e4533b8dc'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:10.456525 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a8be1f5f-c74a-439a-9077-b1e0017b29fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4fc0e2a9a27449883f9558e4533b8dc'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:10.469092 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a8be1f5f-c74a-439a-9077-b1e0017b29fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4fc0e2a9a27449883f9558e4533b8dc'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:10.476384 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a8be1f5f-c74a-439a-9077-b1e0017b29fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4fc0e2a9a27449883f9558e4533b8dc'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:10.489449 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1145/2301] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:51:10 2022] DELETE /identity/v3/users/d4fc0e2a9a27449883f9558e4533b8dc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:10.494478 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33299655-53c2-4b5f-ab89-3b7c3a33e005 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:10.494992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33299655-53c2-4b5f-ab89-3b7c3a33e005 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:10.495444 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33299655-53c2-4b5f-ab89-3b7c3a33e005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:10.513990 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-33299655-53c2-4b5f-ab89-3b7c3a33e005 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:10.515186 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-33299655-53c2-4b5f-ab89-3b7c3a33e005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:10.582821 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1157/2302] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:10.592928 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be1f5f-c74a-439a-9077-b1e0017b29fe admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:10.594522 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-a8be1f5f-c74a-439a-9077-b1e0017b29fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:10.651041 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be1f5f-c74a-439a-9077-b1e0017b29fe admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:10.654922 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4734498-f452-4aca-8bd5-b8ef477eb46a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:10.655529 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4734498-f452-4aca-8bd5-b8ef477eb46a service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:10.655808 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4734498-f452-4aca-8bd5-b8ef477eb46a service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:10.656686 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4734498-f452-4aca-8bd5-b8ef477eb46a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:10.666126 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4734498-f452-4aca-8bd5-b8ef477eb46a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:10.667597 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4734498-f452-4aca-8bd5-b8ef477eb46a service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:10.676864 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1146/2303] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:51:10.972594 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33299655-53c2-4b5f-ab89-3b7c3a33e005 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:10.974113 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-33299655-53c2-4b5f-ab89-3b7c3a33e005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:10.986239 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33299655-53c2-4b5f-ab89-3b7c3a33e005 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:10.999826 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06800653-7efb-42bc-a412-74deba0970a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:11.000745 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06800653-7efb-42bc-a412-74deba0970a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:11.001231 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06800653-7efb-42bc-a412-74deba0970a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:11.001503 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06800653-7efb-42bc-a412-74deba0970a0 admin admin] PATH_INFO: `/v3/projects/46114f1b7b3e4639a80ee72df075d1d0` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:11.002756 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06800653-7efb-42bc-a412-74deba0970a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46114f1b7b3e4639a80ee72df075d1d0)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:11.004971 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06800653-7efb-42bc-a412-74deba0970a0 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:11.056820 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-06800653-7efb-42bc-a412-74deba0970a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46114f1b7b3e4639a80ee72df075d1d0', 'request_id': 'req-06800653-7efb-42bc-a412-74deba0970a0'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:11.063645 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-06800653-7efb-42bc-a412-74deba0970a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46114f1b7b3e4639a80ee72df075d1d0', 'request_id': 'req-06800653-7efb-42bc-a412-74deba0970a0'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:11.071633 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-06800653-7efb-42bc-a412-74deba0970a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46114f1b7b3e4639a80ee72df075d1d0', 'request_id': 'req-06800653-7efb-42bc-a412-74deba0970a0'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:11.081372 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-06800653-7efb-42bc-a412-74deba0970a0 admin admin] The token cache is being invalidate because project 46114f1b7b3e4639a80ee72df075d1d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:51:11.081649 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-06800653-7efb-42bc-a412-74deba0970a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:11.082242 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-06800653-7efb-42bc-a412-74deba0970a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:11.083814 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1158/2304] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:51:10 2022] DELETE /identity/v3/projects/46114f1b7b3e4639a80ee72df075d1d0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:11.088600 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4734498-f452-4aca-8bd5-b8ef477eb46a service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:11.098078 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4734498-f452-4aca-8bd5-b8ef477eb46a service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:11.155092 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49b0fa-5cd0-4ebb-8673-972dda1ed219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:11.155997 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49b0fa-5cd0-4ebb-8673-972dda1ed219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:11.156274 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49b0fa-5cd0-4ebb-8673-972dda1ed219 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:11.156545 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49b0fa-5cd0-4ebb-8673-972dda1ed219 admin admin] PATH_INFO: `/v3/users/7aa995dc158e471485c7ecd73f035e74` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:11.157826 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49b0fa-5cd0-4ebb-8673-972dda1ed219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa995dc158e471485c7ecd73f035e74)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:11.159835 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49b0fa-5cd0-4ebb-8673-972dda1ed219 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:11.223017 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6a49b0fa-5cd0-4ebb-8673-972dda1ed219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa995dc158e471485c7ecd73f035e74'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:11.223988 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6a49b0fa-5cd0-4ebb-8673-972dda1ed219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa995dc158e471485c7ecd73f035e74'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:11.225030 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6a49b0fa-5cd0-4ebb-8673-972dda1ed219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa995dc158e471485c7ecd73f035e74'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:11.243297 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6a49b0fa-5cd0-4ebb-8673-972dda1ed219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa995dc158e471485c7ecd73f035e74'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:11.250129 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6a49b0fa-5cd0-4ebb-8673-972dda1ed219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa995dc158e471485c7ecd73f035e74'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:11.266182 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1147/2305] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:51:11 2022] DELETE /identity/v3/users/7aa995dc158e471485c7ecd73f035e74 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:11.542761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06800653-7efb-42bc-a412-74deba0970a0 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:11.544233 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-06800653-7efb-42bc-a412-74deba0970a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:11.557573 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06800653-7efb-42bc-a412-74deba0970a0 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:11.615091 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71994a-10bd-454f-8a73-69c995fb466c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:11.616038 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71994a-10bd-454f-8a73-69c995fb466c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:11.616320 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71994a-10bd-454f-8a73-69c995fb466c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:11.616593 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71994a-10bd-454f-8a73-69c995fb466c admin admin] PATH_INFO: `/v3/projects/38b6f30947a245d0a925e2985be9f54b` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:11.618085 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71994a-10bd-454f-8a73-69c995fb466c admin admin] RBAC: Authorizing `identity:delete_project(project_id=38b6f30947a245d0a925e2985be9f54b)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:11.620064 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71994a-10bd-454f-8a73-69c995fb466c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:11.677370 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ee71994a-10bd-454f-8a73-69c995fb466c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38b6f30947a245d0a925e2985be9f54b', 'request_id': 'req-ee71994a-10bd-454f-8a73-69c995fb466c'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:11.684565 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ee71994a-10bd-454f-8a73-69c995fb466c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38b6f30947a245d0a925e2985be9f54b', 'request_id': 'req-ee71994a-10bd-454f-8a73-69c995fb466c'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:11.692344 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ee71994a-10bd-454f-8a73-69c995fb466c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38b6f30947a245d0a925e2985be9f54b', 'request_id': 'req-ee71994a-10bd-454f-8a73-69c995fb466c'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:11.704831 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ee71994a-10bd-454f-8a73-69c995fb466c admin admin] The token cache is being invalidate because project 38b6f30947a245d0a925e2985be9f54b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:51:11.705124 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ee71994a-10bd-454f-8a73-69c995fb466c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:11.705788 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ee71994a-10bd-454f-8a73-69c995fb466c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:11.707346 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1159/2306] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:51:11 2022] DELETE /identity/v3/projects/38b6f30947a245d0a925e2985be9f54b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:11.713615 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87332de-5813-4557-b3dd-ac9d0b3ae0db None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:11.714107 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87332de-5813-4557-b3dd-ac9d0b3ae0db None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:11.714193 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87332de-5813-4557-b3dd-ac9d0b3ae0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:11.747223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-f87332de-5813-4557-b3dd-ac9d0b3ae0db None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:11.748453 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-f87332de-5813-4557-b3dd-ac9d0b3ae0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:11.847923 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1148/2307] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:11.855430 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952acd79-32b7-44c7-bcfc-a195298541d3 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:11.858372 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952acd79-32b7-44c7-bcfc-a195298541d3 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:11.858728 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952acd79-32b7-44c7-bcfc-a195298541d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:11.894272 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-952acd79-32b7-44c7-bcfc-a195298541d3 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:11.895503 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-952acd79-32b7-44c7-bcfc-a195298541d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:11.906383 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1160/2308] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:51:11.911287 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87332de-5813-4557-b3dd-ac9d0b3ae0db None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:11.921466 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87332de-5813-4557-b3dd-ac9d0b3ae0db None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:11.926499 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf3d21-b74c-4172-a3fd-5bc273be501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:11.927248 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf3d21-b74c-4172-a3fd-5bc273be501f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:11.927627 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf3d21-b74c-4172-a3fd-5bc273be501f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:11.928011 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf3d21-b74c-4172-a3fd-5bc273be501f admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:11.928891 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf3d21-b74c-4172-a3fd-5bc273be501f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:51:11.929266 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf3d21-b74c-4172-a3fd-5bc273be501f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:11.931033 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf3d21-b74c-4172-a3fd-5bc273be501f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:11.943507 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1149/2309] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:51:11.948127 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952acd79-32b7-44c7-bcfc-a195298541d3 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:11.958929 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952acd79-32b7-44c7-bcfc-a195298541d3 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:11.963804 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3414068-086e-45b9-b795-76e125592f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:11.964472 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3414068-086e-45b9-b795-76e125592f82 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:11.964748 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3414068-086e-45b9-b795-76e125592f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:11.965015 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3414068-086e-45b9-b795-76e125592f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:11.965723 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3414068-086e-45b9-b795-76e125592f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:11.967670 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3414068-086e-45b9-b795-76e125592f82 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:11.996870 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1161/2310] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:51:11 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:51:12.001190 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf3d21-b74c-4172-a3fd-5bc273be501f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:12.019540 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf3d21-b74c-4172-a3fd-5bc273be501f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:12.089320 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939a9b3-5d9f-493c-9662-24523da57a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:12.090113 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939a9b3-5d9f-493c-9662-24523da57a78 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:12.091176 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939a9b3-5d9f-493c-9662-24523da57a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:12.091774 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939a9b3-5d9f-493c-9662-24523da57a78 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:12.092591 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939a9b3-5d9f-493c-9662-24523da57a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:12.094895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939a9b3-5d9f-493c-9662-24523da57a78 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:12.124448 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1150/2311] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:51:12 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:51:12.128312 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3414068-086e-45b9-b795-76e125592f82 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:12.139606 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3414068-086e-45b9-b795-76e125592f82 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:12.144750 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f362d-0a86-40e0-91af-e1d3778c5e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:12.145641 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f362d-0a86-40e0-91af-e1d3778c5e32 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:12.145915 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f362d-0a86-40e0-91af-e1d3778c5e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:12.146345 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f362d-0a86-40e0-91af-e1d3778c5e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:12.147426 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f362d-0a86-40e0-91af-e1d3778c5e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:12.149115 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f362d-0a86-40e0-91af-e1d3778c5e32 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:12.164435 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1162/2312] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:12.165674 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939a9b3-5d9f-493c-9662-24523da57a78 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:12.179917 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939a9b3-5d9f-493c-9662-24523da57a78 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:12.186702 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63520531-b99a-4682-8ccb-889aa034ea52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:12.187470 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63520531-b99a-4682-8ccb-889aa034ea52 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:12.187884 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63520531-b99a-4682-8ccb-889aa034ea52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:12.188256 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63520531-b99a-4682-8ccb-889aa034ea52 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:12.189106 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63520531-b99a-4682-8ccb-889aa034ea52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:12.190900 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63520531-b99a-4682-8ccb-889aa034ea52 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:12.206607 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1151/2313] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:12.211535 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f362d-0a86-40e0-91af-e1d3778c5e32 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:12.223214 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f362d-0a86-40e0-91af-e1d3778c5e32 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:12.229007 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bf79b-8235-4b48-b737-7d83a17061a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:12.230208 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bf79b-8235-4b48-b737-7d83a17061a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:12.230578 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bf79b-8235-4b48-b737-7d83a17061a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:12.231255 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bf79b-8235-4b48-b737-7d83a17061a6 admin admin] PATH_INFO: `/v3/projects/b74f300afe6c4b5c8629b4520358155e/users/75676dc5beb4436fa11d1b14642d51ed/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:12.253080 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6bf79b-8235-4b48-b737-7d83a17061a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74f300afe6c4b5c8629b4520358155e, user_id=75676dc5beb4436fa11d1b14642d51ed, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:12.256243 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6bf79b-8235-4b48-b737-7d83a17061a6 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:12.272827 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1163/2314] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:12 2022] PUT /identity/v3/projects/b74f300afe6c4b5c8629b4520358155e/users/75676dc5beb4436fa11d1b14642d51ed/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:12.283926 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9bf3d-920f-484c-8370-0f2976c00a58 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:12.284338 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9bf3d-920f-484c-8370-0f2976c00a58 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:12.285156 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9bf3d-920f-484c-8370-0f2976c00a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:12.316316 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-f9c9bf3d-920f-484c-8370-0f2976c00a58 None None] MFA Rules not processed for user `75676dc5beb4436fa11d1b14642d51ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:12.317687 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-f9c9bf3d-920f-484c-8370-0f2976c00a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:12.394749 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1152/2315] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:51:12.399679 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bf79b-8235-4b48-b737-7d83a17061a6 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:12.464922 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bf79b-8235-4b48-b737-7d83a17061a6 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:12.469957 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd491d0-8e99-4c91-9048-b6c06926117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:12.470648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd491d0-8e99-4c91-9048-b6c06926117f admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:12.470926 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd491d0-8e99-4c91-9048-b6c06926117f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:12.471196 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd491d0-8e99-4c91-9048-b6c06926117f admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:12.471979 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd491d0-8e99-4c91-9048-b6c06926117f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:12.473917 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd491d0-8e99-4c91-9048-b6c06926117f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:12.505222 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1164/2316] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:51:12 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:51:12.510135 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9bf3d-920f-484c-8370-0f2976c00a58 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:12.521881 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9bf3d-920f-484c-8370-0f2976c00a58 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:12.582251 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb53de8-5314-41d2-8e82-e7f7ef6da566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:12.582949 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb53de8-5314-41d2-8e82-e7f7ef6da566 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:12.583223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb53de8-5314-41d2-8e82-e7f7ef6da566 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:12.583485 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb53de8-5314-41d2-8e82-e7f7ef6da566 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:12.584651 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb53de8-5314-41d2-8e82-e7f7ef6da566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:12.587102 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb53de8-5314-41d2-8e82-e7f7ef6da566 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:12.610325 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1153/2317] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:51:12 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:51:12.614048 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd491d0-8e99-4c91-9048-b6c06926117f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:12.624733 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd491d0-8e99-4c91-9048-b6c06926117f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:12.629754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651844e2-4480-4764-ae28-bbe591348de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:12.630655 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651844e2-4480-4764-ae28-bbe591348de8 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:12.630934 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651844e2-4480-4764-ae28-bbe591348de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:12.631364 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651844e2-4480-4764-ae28-bbe591348de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:12.632151 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651844e2-4480-4764-ae28-bbe591348de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:12.633811 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651844e2-4480-4764-ae28-bbe591348de8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:12.645650 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1165/2318] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:12.650216 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb53de8-5314-41d2-8e82-e7f7ef6da566 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:12.660877 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb53de8-5314-41d2-8e82-e7f7ef6da566 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:12.665879 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c6ec4-48e1-4e51-9673-f342f937ddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:12.666771 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c6ec4-48e1-4e51-9673-f342f937ddad admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:12.667047 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c6ec4-48e1-4e51-9673-f342f937ddad admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:12.667312 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c6ec4-48e1-4e51-9673-f342f937ddad admin admin] PATH_INFO: `/v3/projects/4ce95a7ac0a64304af3a0ffea68370f8/users/f25feff3105641ecad4eca8c2a7f5697/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:12.684601 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c6ec4-48e1-4e51-9673-f342f937ddad admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce95a7ac0a64304af3a0ffea68370f8, user_id=f25feff3105641ecad4eca8c2a7f5697, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:12.687323 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c6ec4-48e1-4e51-9673-f342f937ddad admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:12.702618 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1154/2319] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:12 2022] PUT /identity/v3/projects/4ce95a7ac0a64304af3a0ffea68370f8/users/f25feff3105641ecad4eca8c2a7f5697/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:51:12.706714 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651844e2-4480-4764-ae28-bbe591348de8 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:12.717383 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651844e2-4480-4764-ae28-bbe591348de8 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:12.783830 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb1fe6-6fad-4395-af40-72b2cd2ab428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:12.784294 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb1fe6-6fad-4395-af40-72b2cd2ab428 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:12.784645 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb1fe6-6fad-4395-af40-72b2cd2ab428 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:12.784984 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb1fe6-6fad-4395-af40-72b2cd2ab428 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:12.785797 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb1fe6-6fad-4395-af40-72b2cd2ab428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:12.787656 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb1fe6-6fad-4395-af40-72b2cd2ab428 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:12.799465 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1166/2320] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:12.803262 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c6ec4-48e1-4e51-9673-f342f937ddad admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:12.814770 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c6ec4-48e1-4e51-9673-f342f937ddad admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:12.819452 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d67fc9-3304-4f63-bdbb-658c57443a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:12.820427 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d67fc9-3304-4f63-bdbb-658c57443a04 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:12.820693 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d67fc9-3304-4f63-bdbb-658c57443a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:12.820963 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d67fc9-3304-4f63-bdbb-658c57443a04 admin admin] PATH_INFO: `/v3/projects/4ce95a7ac0a64304af3a0ffea68370f8/users/f25feff3105641ecad4eca8c2a7f5697/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:12.822928 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d67fc9-3304-4f63-bdbb-658c57443a04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce95a7ac0a64304af3a0ffea68370f8, user_id=f25feff3105641ecad4eca8c2a7f5697, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:12.825734 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d67fc9-3304-4f63-bdbb-658c57443a04 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:12.836233 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1155/2321] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:12 2022] PUT /identity/v3/projects/4ce95a7ac0a64304af3a0ffea68370f8/users/f25feff3105641ecad4eca8c2a7f5697/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:12.846877 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e930ce3-0d57-435e-a0e4-94a8bfc31c9b None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:12.847560 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e930ce3-0d57-435e-a0e4-94a8bfc31c9b None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:12.847560 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e930ce3-0d57-435e-a0e4-94a8bfc31c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:12.876578 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-8e930ce3-0d57-435e-a0e4-94a8bfc31c9b None None] MFA Rules not processed for user `f25feff3105641ecad4eca8c2a7f5697`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:12.877919 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-8e930ce3-0d57-435e-a0e4-94a8bfc31c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:12.958150 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1167/2322] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:12.964663 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d67fc9-3304-4f63-bdbb-658c57443a04 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:12.966569 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-c4d67fc9-3304-4f63-bdbb-658c57443a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:13.024257 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d67fc9-3304-4f63-bdbb-658c57443a04 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:13.028385 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c3c41-a09f-4331-81e5-f514b1eb9745 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:13.029044 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c3c41-a09f-4331-81e5-f514b1eb9745 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:13.029317 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c3c41-a09f-4331-81e5-f514b1eb9745 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:13.029583 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c3c41-a09f-4331-81e5-f514b1eb9745 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:13.039774 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c3c41-a09f-4331-81e5-f514b1eb9745 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:13.041234 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c3c41-a09f-4331-81e5-f514b1eb9745 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:13.051050 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1156/2323] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:51:13.145994 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e930ce3-0d57-435e-a0e4-94a8bfc31c9b None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:13.158070 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e930ce3-0d57-435e-a0e4-94a8bfc31c9b None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:13.162775 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b8923-8d9b-4d36-b97b-63788d9d87a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:13.163226 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b8923-8d9b-4d36-b97b-63788d9d87a0 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:13.163473 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b8923-8d9b-4d36-b97b-63788d9d87a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:13.163803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b8923-8d9b-4d36-b97b-63788d9d87a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:13.222076 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b8923-8d9b-4d36-b97b-63788d9d87a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:13.223710 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b8923-8d9b-4d36-b97b-63788d9d87a0 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:13.233122 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1168/2324] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:51:18.159505 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c3c41-a09f-4331-81e5-f514b1eb9745 service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:18.231148 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c3c41-a09f-4331-81e5-f514b1eb9745 service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:18.235992 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6978f-98f5-4e40-ab28-b9ca687f0da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:18.236871 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6978f-98f5-4e40-ab28-b9ca687f0da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:18.237149 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6978f-98f5-4e40-ab28-b9ca687f0da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:18.237422 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6978f-98f5-4e40-ab28-b9ca687f0da2 admin admin] PATH_INFO: `/v3/users/75676dc5beb4436fa11d1b14642d51ed` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:18.238659 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6978f-98f5-4e40-ab28-b9ca687f0da2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75676dc5beb4436fa11d1b14642d51ed)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:18.240621 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6978f-98f5-4e40-ab28-b9ca687f0da2 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:18.290241 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-cab6978f-98f5-4e40-ab28-b9ca687f0da2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75676dc5beb4436fa11d1b14642d51ed'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:18.290897 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-cab6978f-98f5-4e40-ab28-b9ca687f0da2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75676dc5beb4436fa11d1b14642d51ed'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:18.291507 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-cab6978f-98f5-4e40-ab28-b9ca687f0da2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75676dc5beb4436fa11d1b14642d51ed'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:18.302964 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-cab6978f-98f5-4e40-ab28-b9ca687f0da2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75676dc5beb4436fa11d1b14642d51ed'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:18.310110 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-cab6978f-98f5-4e40-ab28-b9ca687f0da2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75676dc5beb4436fa11d1b14642d51ed'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:18.324125 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1157/2325] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:51:18 2022] DELETE /identity/v3/users/75676dc5beb4436fa11d1b14642d51ed => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:18.328882 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35329f99-5d19-4aeb-ae73-f228d79cc6cc None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:18.329409 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35329f99-5d19-4aeb-ae73-f228d79cc6cc None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:18.329409 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35329f99-5d19-4aeb-ae73-f228d79cc6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:18.347146 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-35329f99-5d19-4aeb-ae73-f228d79cc6cc None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:18.348379 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-35329f99-5d19-4aeb-ae73-f228d79cc6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:18.413281 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1169/2326] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:18.423392 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6978f-98f5-4e40-ab28-b9ca687f0da2 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:18.425109 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-cab6978f-98f5-4e40-ab28-b9ca687f0da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:18.486380 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6978f-98f5-4e40-ab28-b9ca687f0da2 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:18.490638 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0fe17-09cc-48b2-b596-2f384a22ecf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:18.491277 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0fe17-09cc-48b2-b596-2f384a22ecf4 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:18.491558 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0fe17-09cc-48b2-b596-2f384a22ecf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:18.493774 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0fe17-09cc-48b2-b596-2f384a22ecf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:18.503498 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0fe17-09cc-48b2-b596-2f384a22ecf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:18.504949 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0fe17-09cc-48b2-b596-2f384a22ecf4 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:18.514804 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1158/2327] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:51:18.800602 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35329f99-5d19-4aeb-ae73-f228d79cc6cc None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:18.802119 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-35329f99-5d19-4aeb-ae73-f228d79cc6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:18.815163 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35329f99-5d19-4aeb-ae73-f228d79cc6cc None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:18.821106 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7755e87-17eb-4c00-b169-ed4947a89f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:18.822078 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7755e87-17eb-4c00-b169-ed4947a89f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:18.822420 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7755e87-17eb-4c00-b169-ed4947a89f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:18.822793 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7755e87-17eb-4c00-b169-ed4947a89f58 admin admin] PATH_INFO: `/v3/projects/b74f300afe6c4b5c8629b4520358155e` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:18.824213 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7755e87-17eb-4c00-b169-ed4947a89f58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b74f300afe6c4b5c8629b4520358155e)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:18.826198 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7755e87-17eb-4c00-b169-ed4947a89f58 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:18.879398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f7755e87-17eb-4c00-b169-ed4947a89f58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74f300afe6c4b5c8629b4520358155e', 'request_id': 'req-f7755e87-17eb-4c00-b169-ed4947a89f58'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:18.886805 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f7755e87-17eb-4c00-b169-ed4947a89f58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74f300afe6c4b5c8629b4520358155e', 'request_id': 'req-f7755e87-17eb-4c00-b169-ed4947a89f58'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:18.896888 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f7755e87-17eb-4c00-b169-ed4947a89f58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74f300afe6c4b5c8629b4520358155e', 'request_id': 'req-f7755e87-17eb-4c00-b169-ed4947a89f58'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:18.910508 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f7755e87-17eb-4c00-b169-ed4947a89f58 admin admin] The token cache is being invalidate because project b74f300afe6c4b5c8629b4520358155e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:51:18.910905 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f7755e87-17eb-4c00-b169-ed4947a89f58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:18.911919 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f7755e87-17eb-4c00-b169-ed4947a89f58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:18.914419 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1170/2328] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:51:18 2022] DELETE /identity/v3/projects/b74f300afe6c4b5c8629b4520358155e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:18.919494 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0fe17-09cc-48b2-b596-2f384a22ecf4 service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:18.932792 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0fe17-09cc-48b2-b596-2f384a22ecf4 service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:19.010387 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfc0de-55c9-4621-86bd-f0abea949033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:19.011266 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfc0de-55c9-4621-86bd-f0abea949033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:19.011605 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfc0de-55c9-4621-86bd-f0abea949033 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:19.011871 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfc0de-55c9-4621-86bd-f0abea949033 admin admin] PATH_INFO: `/v3/users/f25feff3105641ecad4eca8c2a7f5697` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:19.013280 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfc0de-55c9-4621-86bd-f0abea949033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f25feff3105641ecad4eca8c2a7f5697)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:19.015214 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfc0de-55c9-4621-86bd-f0abea949033 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:19.067691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-aadfc0de-55c9-4621-86bd-f0abea949033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f25feff3105641ecad4eca8c2a7f5697'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:19.068357 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-aadfc0de-55c9-4621-86bd-f0abea949033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f25feff3105641ecad4eca8c2a7f5697'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:19.068971 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-aadfc0de-55c9-4621-86bd-f0abea949033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f25feff3105641ecad4eca8c2a7f5697'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:19.081156 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-aadfc0de-55c9-4621-86bd-f0abea949033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f25feff3105641ecad4eca8c2a7f5697'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:19.088027 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-aadfc0de-55c9-4621-86bd-f0abea949033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f25feff3105641ecad4eca8c2a7f5697'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:19.102667 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1159/2329] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:51:18 2022] DELETE /identity/v3/users/f25feff3105641ecad4eca8c2a7f5697 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:19.420583 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7755e87-17eb-4c00-b169-ed4947a89f58 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:19.422950 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f7755e87-17eb-4c00-b169-ed4947a89f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:19.447855 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7755e87-17eb-4c00-b169-ed4947a89f58 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:19.512420 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad737df-852a-420e-bc0f-590ae349d3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:19.513295 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad737df-852a-420e-bc0f-590ae349d3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:19.513566 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad737df-852a-420e-bc0f-590ae349d3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:19.513831 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad737df-852a-420e-bc0f-590ae349d3c9 admin admin] PATH_INFO: `/v3/projects/4ce95a7ac0a64304af3a0ffea68370f8` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:19.515034 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad737df-852a-420e-bc0f-590ae349d3c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce95a7ac0a64304af3a0ffea68370f8)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:19.517002 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad737df-852a-420e-bc0f-590ae349d3c9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:19.564470 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-2ad737df-852a-420e-bc0f-590ae349d3c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce95a7ac0a64304af3a0ffea68370f8', 'request_id': 'req-2ad737df-852a-420e-bc0f-590ae349d3c9'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:19.570384 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-2ad737df-852a-420e-bc0f-590ae349d3c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce95a7ac0a64304af3a0ffea68370f8', 'request_id': 'req-2ad737df-852a-420e-bc0f-590ae349d3c9'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:19.578935 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-2ad737df-852a-420e-bc0f-590ae349d3c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce95a7ac0a64304af3a0ffea68370f8', 'request_id': 'req-2ad737df-852a-420e-bc0f-590ae349d3c9'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:19.589869 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-2ad737df-852a-420e-bc0f-590ae349d3c9 admin admin] The token cache is being invalidate because project 4ce95a7ac0a64304af3a0ffea68370f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:51:19.590154 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-2ad737df-852a-420e-bc0f-590ae349d3c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:19.590811 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-2ad737df-852a-420e-bc0f-590ae349d3c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:19.592405 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1171/2330] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:51:19 2022] DELETE /identity/v3/projects/4ce95a7ac0a64304af3a0ffea68370f8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:19.598364 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3eab6-4645-42bc-a789-7360ea003d49 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:19.598836 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3eab6-4645-42bc-a789-7360ea003d49 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:19.598945 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3eab6-4645-42bc-a789-7360ea003d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:19.618297 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-06d3eab6-4645-42bc-a789-7360ea003d49 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:19.619502 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-06d3eab6-4645-42bc-a789-7360ea003d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:19.685534 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1160/2331] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:19.694633 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3ade2-76ad-44bd-81e1-cd2f8b275ad5 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:19.694986 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3ade2-76ad-44bd-81e1-cd2f8b275ad5 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:19.695333 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3ade2-76ad-44bd-81e1-cd2f8b275ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:19.714693 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-e7e3ade2-76ad-44bd-81e1-cd2f8b275ad5 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:19.715852 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-e7e3ade2-76ad-44bd-81e1-cd2f8b275ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:19.724171 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1172/2332] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:19.729131 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3eab6-4645-42bc-a789-7360ea003d49 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:19.739051 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3eab6-4645-42bc-a789-7360ea003d49 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:19.744490 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426962d-5883-40a6-a60a-27dcca7dea80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:19.745148 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426962d-5883-40a6-a60a-27dcca7dea80 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:19.745423 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426962d-5883-40a6-a60a-27dcca7dea80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:19.745685 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426962d-5883-40a6-a60a-27dcca7dea80 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:19.746422 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426962d-5883-40a6-a60a-27dcca7dea80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:51:19.746724 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426962d-5883-40a6-a60a-27dcca7dea80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:19.748364 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426962d-5883-40a6-a60a-27dcca7dea80 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:19.761326 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1161/2333] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:51:19.769035 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3ade2-76ad-44bd-81e1-cd2f8b275ad5 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:19.785339 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3ade2-76ad-44bd-81e1-cd2f8b275ad5 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:19.792878 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cbd06-f0b6-4868-9dcc-1eb158cbab0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:19.793531 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cbd06-f0b6-4868-9dcc-1eb158cbab0c admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:19.793803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cbd06-f0b6-4868-9dcc-1eb158cbab0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:19.794036 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cbd06-f0b6-4868-9dcc-1eb158cbab0c admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:19.794752 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cbd06-f0b6-4868-9dcc-1eb158cbab0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:19.796885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cbd06-f0b6-4868-9dcc-1eb158cbab0c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:19.826864 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1173/2334] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:51:19 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:51:19.831198 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426962d-5883-40a6-a60a-27dcca7dea80 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:19.842000 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426962d-5883-40a6-a60a-27dcca7dea80 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:19.897785 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df385af-3b4f-4fd2-999e-ee25238d8d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:19.898445 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df385af-3b4f-4fd2-999e-ee25238d8d13 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:19.898718 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df385af-3b4f-4fd2-999e-ee25238d8d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:19.899004 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df385af-3b4f-4fd2-999e-ee25238d8d13 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:19.899832 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df385af-3b4f-4fd2-999e-ee25238d8d13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:19.901767 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df385af-3b4f-4fd2-999e-ee25238d8d13 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:19.922354 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1162/2335] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:51:19 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:51:19.926626 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cbd06-f0b6-4868-9dcc-1eb158cbab0c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:19.937768 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cbd06-f0b6-4868-9dcc-1eb158cbab0c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:19.943544 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e285e3e-d726-4305-b741-fdd9781ec06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:19.944235 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e285e3e-d726-4305-b741-fdd9781ec06d admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:19.944511 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e285e3e-d726-4305-b741-fdd9781ec06d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:19.944777 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e285e3e-d726-4305-b741-fdd9781ec06d admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:19.945520 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e285e3e-d726-4305-b741-fdd9781ec06d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:19.947128 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e285e3e-d726-4305-b741-fdd9781ec06d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:19.958255 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1174/2336] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:19.962488 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df385af-3b4f-4fd2-999e-ee25238d8d13 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:19.972872 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df385af-3b4f-4fd2-999e-ee25238d8d13 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:19.978245 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fe7b9-1228-44ba-8642-7a9e8f49e4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:19.979243 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fe7b9-1228-44ba-8642-7a9e8f49e4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:19.979825 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fe7b9-1228-44ba-8642-7a9e8f49e4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:19.980139 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fe7b9-1228-44ba-8642-7a9e8f49e4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:19.981256 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fe7b9-1228-44ba-8642-7a9e8f49e4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:19.983610 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fe7b9-1228-44ba-8642-7a9e8f49e4c8 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:19.996114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1163/2337] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:51:20.000548 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e285e3e-d726-4305-b741-fdd9781ec06d admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:20.011488 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e285e3e-d726-4305-b741-fdd9781ec06d admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:20.016707 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ea977-7307-4bf9-8f2e-25ea316120a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:20.017604 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ea977-7307-4bf9-8f2e-25ea316120a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:20.017887 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ea977-7307-4bf9-8f2e-25ea316120a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:20.018165 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ea977-7307-4bf9-8f2e-25ea316120a7 admin admin] PATH_INFO: `/v3/projects/8d7cfdc991f14f1099b9631ba50b6181/users/01e72d837d3142d38b869409bcd203ea/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:20.033569 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ea977-7307-4bf9-8f2e-25ea316120a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7cfdc991f14f1099b9631ba50b6181, user_id=01e72d837d3142d38b869409bcd203ea, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:20.036316 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ea977-7307-4bf9-8f2e-25ea316120a7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:20.052246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1175/2338] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:19 2022] PUT /identity/v3/projects/8d7cfdc991f14f1099b9631ba50b6181/users/01e72d837d3142d38b869409bcd203ea/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:20.064315 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983afe33-9ca3-4298-b6f2-023d56ead955 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:20.064623 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983afe33-9ca3-4298-b6f2-023d56ead955 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:20.064909 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983afe33-9ca3-4298-b6f2-023d56ead955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:20.093733 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-983afe33-9ca3-4298-b6f2-023d56ead955 None None] MFA Rules not processed for user `01e72d837d3142d38b869409bcd203ea`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:20.094955 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-983afe33-9ca3-4298-b6f2-023d56ead955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:20.162049 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1164/2339] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:20.166927 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ea977-7307-4bf9-8f2e-25ea316120a7 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:20.245648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ea977-7307-4bf9-8f2e-25ea316120a7 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:20.251764 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb2c6d-8894-478b-9361-335314aff275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:20.252444 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb2c6d-8894-478b-9361-335314aff275 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:20.252729 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb2c6d-8894-478b-9361-335314aff275 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:20.253000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb2c6d-8894-478b-9361-335314aff275 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:20.253706 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb2c6d-8894-478b-9361-335314aff275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:20.255697 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb2c6d-8894-478b-9361-335314aff275 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:20.290954 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1176/2340] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:51:20 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:51:20.295365 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983afe33-9ca3-4298-b6f2-023d56ead955 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:20.306208 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983afe33-9ca3-4298-b6f2-023d56ead955 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:20.371410 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3b606-6fd6-48ad-9ea5-fbb779462568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:20.372112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3b606-6fd6-48ad-9ea5-fbb779462568 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:20.372386 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3b606-6fd6-48ad-9ea5-fbb779462568 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:20.372654 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3b606-6fd6-48ad-9ea5-fbb779462568 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:20.373358 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3b606-6fd6-48ad-9ea5-fbb779462568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:20.375290 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3b606-6fd6-48ad-9ea5-fbb779462568 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:20.395197 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1165/2341] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:51:20 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:51:20.399470 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb2c6d-8894-478b-9361-335314aff275 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:20.410295 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb2c6d-8894-478b-9361-335314aff275 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:20.415770 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c656452-662d-471d-9a24-f7c1aaadb7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:20.416430 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c656452-662d-471d-9a24-f7c1aaadb7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:20.416703 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c656452-662d-471d-9a24-f7c1aaadb7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:20.416950 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c656452-662d-471d-9a24-f7c1aaadb7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:20.417693 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c656452-662d-471d-9a24-f7c1aaadb7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:20.419334 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c656452-662d-471d-9a24-f7c1aaadb7c0 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:20.431363 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1177/2342] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:20.435970 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3b606-6fd6-48ad-9ea5-fbb779462568 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:20.445865 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3b606-6fd6-48ad-9ea5-fbb779462568 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:20.452700 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4c0ff-d71d-4a95-ad8b-75a3a28900a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:20.453577 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4c0ff-d71d-4a95-ad8b-75a3a28900a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:20.453870 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4c0ff-d71d-4a95-ad8b-75a3a28900a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:20.454138 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4c0ff-d71d-4a95-ad8b-75a3a28900a2 admin admin] PATH_INFO: `/v3/projects/69f75174e8314c5a91fe4b5573cd1ac2/users/e0550e14ca704794993d751c2dd08e1f/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:20.470380 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4c0ff-d71d-4a95-ad8b-75a3a28900a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f75174e8314c5a91fe4b5573cd1ac2, user_id=e0550e14ca704794993d751c2dd08e1f, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:20.473344 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4c0ff-d71d-4a95-ad8b-75a3a28900a2 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:20.489316 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1166/2343] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:20 2022] PUT /identity/v3/projects/69f75174e8314c5a91fe4b5573cd1ac2/users/e0550e14ca704794993d751c2dd08e1f/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:51:20.493583 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c656452-662d-471d-9a24-f7c1aaadb7c0 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:20.503923 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c656452-662d-471d-9a24-f7c1aaadb7c0 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:20.565185 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e64ac-df4f-4a75-abf2-4d6df34a11b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:20.565901 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e64ac-df4f-4a75-abf2-4d6df34a11b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:20.566178 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e64ac-df4f-4a75-abf2-4d6df34a11b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:20.566448 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e64ac-df4f-4a75-abf2-4d6df34a11b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:20.567200 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e64ac-df4f-4a75-abf2-4d6df34a11b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:20.568876 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e64ac-df4f-4a75-abf2-4d6df34a11b1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:20.583041 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1178/2344] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:20.584284 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4c0ff-d71d-4a95-ad8b-75a3a28900a2 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:20.595272 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4c0ff-d71d-4a95-ad8b-75a3a28900a2 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:20.600031 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799109c0-5036-482c-a515-17a337ae7c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:20.600962 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799109c0-5036-482c-a515-17a337ae7c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:20.601235 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799109c0-5036-482c-a515-17a337ae7c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:20.601502 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799109c0-5036-482c-a515-17a337ae7c93 admin admin] PATH_INFO: `/v3/projects/69f75174e8314c5a91fe4b5573cd1ac2/users/e0550e14ca704794993d751c2dd08e1f/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:20.604463 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799109c0-5036-482c-a515-17a337ae7c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f75174e8314c5a91fe4b5573cd1ac2, user_id=e0550e14ca704794993d751c2dd08e1f, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:20.607084 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799109c0-5036-482c-a515-17a337ae7c93 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:20.617934 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1167/2345] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:20 2022] PUT /identity/v3/projects/69f75174e8314c5a91fe4b5573cd1ac2/users/e0550e14ca704794993d751c2dd08e1f/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:51:20.628432 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248362f1-0471-44bc-8e79-ebbc22e42ee0 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:20.628711 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248362f1-0471-44bc-8e79-ebbc22e42ee0 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:20.628975 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248362f1-0471-44bc-8e79-ebbc22e42ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:20.661200 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-248362f1-0471-44bc-8e79-ebbc22e42ee0 None None] MFA Rules not processed for user `e0550e14ca704794993d751c2dd08e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:20.662458 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-248362f1-0471-44bc-8e79-ebbc22e42ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:20.735428 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1179/2346] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:20 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:20.745512 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799109c0-5036-482c-a515-17a337ae7c93 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:20.747623 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-799109c0-5036-482c-a515-17a337ae7c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:20.807085 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799109c0-5036-482c-a515-17a337ae7c93 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:20.811289 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caea13-7d2c-4351-a3d0-3f021bf05510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:20.812004 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caea13-7d2c-4351-a3d0-3f021bf05510 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:20.812276 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caea13-7d2c-4351-a3d0-3f021bf05510 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:20.812540 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caea13-7d2c-4351-a3d0-3f021bf05510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:20.823141 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44caea13-7d2c-4351-a3d0-3f021bf05510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:20.824828 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44caea13-7d2c-4351-a3d0-3f021bf05510 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:20.834702 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1168/2347] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:20 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:51:20.916184 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248362f1-0471-44bc-8e79-ebbc22e42ee0 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:20.925765 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248362f1-0471-44bc-8e79-ebbc22e42ee0 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:20.930001 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0d9ae-d210-418b-82b9-75715cda729d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:20.930870 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0d9ae-d210-418b-82b9-75715cda729d service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:20.931336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0d9ae-d210-418b-82b9-75715cda729d service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:20.931846 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0d9ae-d210-418b-82b9-75715cda729d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:21.006168 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0d9ae-d210-418b-82b9-75715cda729d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:21.008766 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0d9ae-d210-418b-82b9-75715cda729d service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:21.018686 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1180/2348] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:51:21.128133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7203d2e-95a7-4de7-a73d-0e08797d31c5 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:21.128413 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7203d2e-95a7-4de7-a73d-0e08797d31c5 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:21.128688 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7203d2e-95a7-4de7-a73d-0e08797d31c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:21.146878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-a7203d2e-95a7-4de7-a73d-0e08797d31c5 None None] MFA Rules not processed for user `90f35219a70d4e0596a6c28bd9ef9acc`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:21.148105 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-a7203d2e-95a7-4de7-a73d-0e08797d31c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:21.204126 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1169/2349] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:22.224596 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0d9ae-d210-418b-82b9-75715cda729d service cinder] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:22.226067 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-acc0d9ae-d210-418b-82b9-75715cda729d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:22.285370 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0d9ae-d210-418b-82b9-75715cda729d service cinder] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:22.289978 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3069950-965c-492e-883b-c7c30ed645be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:22.290933 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3069950-965c-492e-883b-c7c30ed645be service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:22.291230 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3069950-965c-492e-883b-c7c30ed645be service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:22.291443 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3069950-965c-492e-883b-c7c30ed645be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:22.293265 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b3069950-965c-492e-883b-c7c30ed645be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:22.368966 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3069950-965c-492e-883b-c7c30ed645be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:22.370660 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3069950-965c-492e-883b-c7c30ed645be service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:22.381803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1181/2350] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:51:25.930119 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7203d2e-95a7-4de7-a73d-0e08797d31c5 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:26.000128 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7203d2e-95a7-4de7-a73d-0e08797d31c5 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:26.005030 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c4ddd-92d0-445f-afaa-deb9a35ab3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:26.005906 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c4ddd-92d0-445f-afaa-deb9a35ab3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:26.006355 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c4ddd-92d0-445f-afaa-deb9a35ab3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:26.006619 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c4ddd-92d0-445f-afaa-deb9a35ab3e8 admin admin] PATH_INFO: `/v3/users/01e72d837d3142d38b869409bcd203ea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:26.008019 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c4ddd-92d0-445f-afaa-deb9a35ab3e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e72d837d3142d38b869409bcd203ea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:26.010501 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c4ddd-92d0-445f-afaa-deb9a35ab3e8 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:26.070182 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3a3c4ddd-92d0-445f-afaa-deb9a35ab3e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e72d837d3142d38b869409bcd203ea'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:26.071087 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3a3c4ddd-92d0-445f-afaa-deb9a35ab3e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e72d837d3142d38b869409bcd203ea'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:26.071924 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3a3c4ddd-92d0-445f-afaa-deb9a35ab3e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e72d837d3142d38b869409bcd203ea'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:26.084697 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3a3c4ddd-92d0-445f-afaa-deb9a35ab3e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e72d837d3142d38b869409bcd203ea'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:26.091653 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3a3c4ddd-92d0-445f-afaa-deb9a35ab3e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e72d837d3142d38b869409bcd203ea'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:26.110705 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1170/2351] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:51:25 2022] DELETE /identity/v3/users/01e72d837d3142d38b869409bcd203ea => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:26.115308 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6096e-c848-457f-a12d-9b3796eaaabd None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:26.115866 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6096e-c848-457f-a12d-9b3796eaaabd None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:26.116161 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6096e-c848-457f-a12d-9b3796eaaabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:26.136851 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-33c6096e-c848-457f-a12d-9b3796eaaabd None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:26.138271 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-33c6096e-c848-457f-a12d-9b3796eaaabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:26.206826 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1182/2352] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:51:26.227949 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c4ddd-92d0-445f-afaa-deb9a35ab3e8 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:26.232457 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-3a3c4ddd-92d0-445f-afaa-deb9a35ab3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:26.314604 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c4ddd-92d0-445f-afaa-deb9a35ab3e8 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:26.318342 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccedaee-58dd-49c5-aa90-c7125fe34e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:26.319008 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccedaee-58dd-49c5-aa90-c7125fe34e64 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:26.319288 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccedaee-58dd-49c5-aa90-c7125fe34e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:26.319594 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccedaee-58dd-49c5-aa90-c7125fe34e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:26.330809 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccedaee-58dd-49c5-aa90-c7125fe34e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:26.332442 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccedaee-58dd-49c5-aa90-c7125fe34e64 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:26.359217 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1171/2353] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:51:26.724201 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6096e-c848-457f-a12d-9b3796eaaabd None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:26.725766 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-33c6096e-c848-457f-a12d-9b3796eaaabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:26.750481 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6096e-c848-457f-a12d-9b3796eaaabd None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:26.766019 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897dc4f5-d356-4a42-94b5-b68e834a350a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:26.768106 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dc4f5-d356-4a42-94b5-b68e834a350a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:26.768823 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dc4f5-d356-4a42-94b5-b68e834a350a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:26.769189 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897dc4f5-d356-4a42-94b5-b68e834a350a admin admin] PATH_INFO: `/v3/projects/8d7cfdc991f14f1099b9631ba50b6181` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:26.771228 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897dc4f5-d356-4a42-94b5-b68e834a350a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d7cfdc991f14f1099b9631ba50b6181)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:26.774064 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897dc4f5-d356-4a42-94b5-b68e834a350a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:26.854068 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-897dc4f5-d356-4a42-94b5-b68e834a350a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d7cfdc991f14f1099b9631ba50b6181', 'request_id': 'req-897dc4f5-d356-4a42-94b5-b68e834a350a'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:26.870473 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-897dc4f5-d356-4a42-94b5-b68e834a350a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d7cfdc991f14f1099b9631ba50b6181', 'request_id': 'req-897dc4f5-d356-4a42-94b5-b68e834a350a'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:26.883211 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-897dc4f5-d356-4a42-94b5-b68e834a350a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d7cfdc991f14f1099b9631ba50b6181', 'request_id': 'req-897dc4f5-d356-4a42-94b5-b68e834a350a'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:26.898466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-897dc4f5-d356-4a42-94b5-b68e834a350a admin admin] The token cache is being invalidate because project 8d7cfdc991f14f1099b9631ba50b6181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:51:26.898750 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-897dc4f5-d356-4a42-94b5-b68e834a350a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:26.900189 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-897dc4f5-d356-4a42-94b5-b68e834a350a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:26.903430 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1183/2354] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:51:26 2022] DELETE /identity/v3/projects/8d7cfdc991f14f1099b9631ba50b6181 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:51:26.908133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccedaee-58dd-49c5-aa90-c7125fe34e64 service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:26.920195 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccedaee-58dd-49c5-aa90-c7125fe34e64 service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:27.018085 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf872675-4f48-4111-8782-0bb2ed12a97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:27.020031 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf872675-4f48-4111-8782-0bb2ed12a97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:27.020319 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf872675-4f48-4111-8782-0bb2ed12a97d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:27.020595 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf872675-4f48-4111-8782-0bb2ed12a97d admin admin] PATH_INFO: `/v3/users/e0550e14ca704794993d751c2dd08e1f` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:27.022111 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf872675-4f48-4111-8782-0bb2ed12a97d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0550e14ca704794993d751c2dd08e1f)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:27.031668 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf872675-4f48-4111-8782-0bb2ed12a97d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:27.082518 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-cf872675-4f48-4111-8782-0bb2ed12a97d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0550e14ca704794993d751c2dd08e1f'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:27.083199 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-cf872675-4f48-4111-8782-0bb2ed12a97d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0550e14ca704794993d751c2dd08e1f'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:27.083929 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-cf872675-4f48-4111-8782-0bb2ed12a97d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0550e14ca704794993d751c2dd08e1f'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:27.098603 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-cf872675-4f48-4111-8782-0bb2ed12a97d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0550e14ca704794993d751c2dd08e1f'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:27.106858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-cf872675-4f48-4111-8782-0bb2ed12a97d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0550e14ca704794993d751c2dd08e1f'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:27.121277 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1172/2355] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:51:26 2022] DELETE /identity/v3/users/e0550e14ca704794993d751c2dd08e1f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:27.427325 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897dc4f5-d356-4a42-94b5-b68e834a350a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:27.428982 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-897dc4f5-d356-4a42-94b5-b68e834a350a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:27.448205 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897dc4f5-d356-4a42-94b5-b68e834a350a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:27.527860 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3ee67-71f8-4f88-82de-6f4113de9ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:27.528757 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3ee67-71f8-4f88-82de-6f4113de9ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:27.529099 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3ee67-71f8-4f88-82de-6f4113de9ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:27.529434 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3ee67-71f8-4f88-82de-6f4113de9ad4 admin admin] PATH_INFO: `/v3/projects/69f75174e8314c5a91fe4b5573cd1ac2` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:27.530707 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3ee67-71f8-4f88-82de-6f4113de9ad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69f75174e8314c5a91fe4b5573cd1ac2)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:27.532723 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3ee67-71f8-4f88-82de-6f4113de9ad4 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:27.588772 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f8b3ee67-71f8-4f88-82de-6f4113de9ad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69f75174e8314c5a91fe4b5573cd1ac2', 'request_id': 'req-f8b3ee67-71f8-4f88-82de-6f4113de9ad4'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:27.600521 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f8b3ee67-71f8-4f88-82de-6f4113de9ad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69f75174e8314c5a91fe4b5573cd1ac2', 'request_id': 'req-f8b3ee67-71f8-4f88-82de-6f4113de9ad4'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:27.614631 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f8b3ee67-71f8-4f88-82de-6f4113de9ad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69f75174e8314c5a91fe4b5573cd1ac2', 'request_id': 'req-f8b3ee67-71f8-4f88-82de-6f4113de9ad4'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:27.627936 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f8b3ee67-71f8-4f88-82de-6f4113de9ad4 admin admin] The token cache is being invalidate because project 69f75174e8314c5a91fe4b5573cd1ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:51:27.628714 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f8b3ee67-71f8-4f88-82de-6f4113de9ad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:27.630034 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f8b3ee67-71f8-4f88-82de-6f4113de9ad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:27.631938 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1184/2356] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:51:27 2022] DELETE /identity/v3/projects/69f75174e8314c5a91fe4b5573cd1ac2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:27.638422 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b649451-4fba-4d96-b9cb-d1c0ee4610f9 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:27.638699 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b649451-4fba-4d96-b9cb-d1c0ee4610f9 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:27.639161 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b649451-4fba-4d96-b9cb-d1c0ee4610f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:27.667332 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-7b649451-4fba-4d96-b9cb-d1c0ee4610f9 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:27.669038 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-7b649451-4fba-4d96-b9cb-d1c0ee4610f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:27.788395 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1173/2357] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:51:27.795899 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b7f30-0dd6-4519-860c-f8d26227b006 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:27.795899 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b7f30-0dd6-4519-860c-f8d26227b006 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:27.795899 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b7f30-0dd6-4519-860c-f8d26227b006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:27.815016 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-794b7f30-0dd6-4519-860c-f8d26227b006 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:27.816529 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-794b7f30-0dd6-4519-860c-f8d26227b006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:27.825374 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1185/2358] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:27.829905 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b649451-4fba-4d96-b9cb-d1c0ee4610f9 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:27.842594 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b649451-4fba-4d96-b9cb-d1c0ee4610f9 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:27.847295 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa482ff-a1c5-4e1d-b03d-4454d27d0d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:27.848237 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa482ff-a1c5-4e1d-b03d-4454d27d0d1b admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:27.848582 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa482ff-a1c5-4e1d-b03d-4454d27d0d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:27.848915 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa482ff-a1c5-4e1d-b03d-4454d27d0d1b admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:27.849740 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa482ff-a1c5-4e1d-b03d-4454d27d0d1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:51:27.850042 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa482ff-a1c5-4e1d-b03d-4454d27d0d1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:27.851691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa482ff-a1c5-4e1d-b03d-4454d27d0d1b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:27.870318 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1174/2359] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:51:27.874677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b7f30-0dd6-4519-860c-f8d26227b006 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:27.884174 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b7f30-0dd6-4519-860c-f8d26227b006 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:27.889132 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9e4cd-d2e5-4713-9e1d-945b61d2c24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:27.890015 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9e4cd-d2e5-4713-9e1d-945b61d2c24b admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:27.890387 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9e4cd-d2e5-4713-9e1d-945b61d2c24b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:27.890778 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9e4cd-d2e5-4713-9e1d-945b61d2c24b admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:27.891898 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9e4cd-d2e5-4713-9e1d-945b61d2c24b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:27.893915 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9e4cd-d2e5-4713-9e1d-945b61d2c24b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:27.923696 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1186/2360] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:51:27 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:51:27.926181 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa482ff-a1c5-4e1d-b03d-4454d27d0d1b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:27.939465 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa482ff-a1c5-4e1d-b03d-4454d27d0d1b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:28.013783 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b4173-9cc9-4464-a0af-bdffd0170b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:28.014588 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b4173-9cc9-4464-a0af-bdffd0170b0d admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:28.014952 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b4173-9cc9-4464-a0af-bdffd0170b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:28.015291 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b4173-9cc9-4464-a0af-bdffd0170b0d admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:28.016649 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b4173-9cc9-4464-a0af-bdffd0170b0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:28.019598 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b4173-9cc9-4464-a0af-bdffd0170b0d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:28.043428 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1175/2361] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:51:27 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:51:28.047304 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9e4cd-d2e5-4713-9e1d-945b61d2c24b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:28.058887 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9e4cd-d2e5-4713-9e1d-945b61d2c24b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:28.065230 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989db5a9-f455-4639-9f1f-7a43ce4e5f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:28.066121 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989db5a9-f455-4639-9f1f-7a43ce4e5f50 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:28.066553 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989db5a9-f455-4639-9f1f-7a43ce4e5f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:28.066905 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989db5a9-f455-4639-9f1f-7a43ce4e5f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:28.067921 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989db5a9-f455-4639-9f1f-7a43ce4e5f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:28.070232 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989db5a9-f455-4639-9f1f-7a43ce4e5f50 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:28.083113 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1187/2362] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:51:28.087613 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b4173-9cc9-4464-a0af-bdffd0170b0d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:28.104649 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b4173-9cc9-4464-a0af-bdffd0170b0d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:28.112364 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb39ee6-eda4-4437-88c1-63cfe367f225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:28.113172 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb39ee6-eda4-4437-88c1-63cfe367f225 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:28.113451 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb39ee6-eda4-4437-88c1-63cfe367f225 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:28.113727 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb39ee6-eda4-4437-88c1-63cfe367f225 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:28.114730 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb39ee6-eda4-4437-88c1-63cfe367f225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:28.116380 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb39ee6-eda4-4437-88c1-63cfe367f225 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:28.131556 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1176/2363] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:28.134458 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989db5a9-f455-4639-9f1f-7a43ce4e5f50 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:28.145085 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989db5a9-f455-4639-9f1f-7a43ce4e5f50 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:28.150817 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6256ea-3b31-4209-9f5d-d3ccbdddf53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:28.151860 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6256ea-3b31-4209-9f5d-d3ccbdddf53f admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:28.152527 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6256ea-3b31-4209-9f5d-d3ccbdddf53f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:28.152527 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6256ea-3b31-4209-9f5d-d3ccbdddf53f admin admin] PATH_INFO: `/v3/projects/c96a6ffb39d642aca44c304743affde5/users/a2ebdd2e891345ca843acd1f256da4db/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:28.169387 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6256ea-3b31-4209-9f5d-d3ccbdddf53f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96a6ffb39d642aca44c304743affde5, user_id=a2ebdd2e891345ca843acd1f256da4db, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:28.172170 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6256ea-3b31-4209-9f5d-d3ccbdddf53f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:28.189054 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1188/2364] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:28 2022] PUT /identity/v3/projects/c96a6ffb39d642aca44c304743affde5/users/a2ebdd2e891345ca843acd1f256da4db/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:28.201730 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62e446-afef-4865-89cd-c5ac452bdf36 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:28.202022 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62e446-afef-4865-89cd-c5ac452bdf36 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:28.202303 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62e446-afef-4865-89cd-c5ac452bdf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:28.228949 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-ef62e446-afef-4865-89cd-c5ac452bdf36 None None] MFA Rules not processed for user `a2ebdd2e891345ca843acd1f256da4db`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:28.230248 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-ef62e446-afef-4865-89cd-c5ac452bdf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:28.252474 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6256ea-3b31-4209-9f5d-d3ccbdddf53f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:28.254342 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ed6256ea-3b31-4209-9f5d-d3ccbdddf53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:28.300959 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1177/2365] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:51:28.310877 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62e446-afef-4865-89cd-c5ac452bdf36 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:28.312297 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-ef62e446-afef-4865-89cd-c5ac452bdf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:28.322213 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6256ea-3b31-4209-9f5d-d3ccbdddf53f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:28.324561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96750729-a9e1-4a6e-9244-5f0e31ce803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:28.325450 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96750729-a9e1-4a6e-9244-5f0e31ce803e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:28.325734 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96750729-a9e1-4a6e-9244-5f0e31ce803e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:28.326008 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96750729-a9e1-4a6e-9244-5f0e31ce803e admin admin] PATH_INFO: `/v3/users/c7c2b5d01a124f3e94bc557b641f77a1` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:28.327238 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96750729-a9e1-4a6e-9244-5f0e31ce803e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7c2b5d01a124f3e94bc557b641f77a1)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:28.329231 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96750729-a9e1-4a6e-9244-5f0e31ce803e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:28.370165 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62e446-afef-4865-89cd-c5ac452bdf36 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:28.374441 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b278c-792d-40a0-b51f-31173410fe08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:28.375130 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b278c-792d-40a0-b51f-31173410fe08 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:28.375408 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b278c-792d-40a0-b51f-31173410fe08 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:28.375831 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b278c-792d-40a0-b51f-31173410fe08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:28.379491 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-96750729-a9e1-4a6e-9244-5f0e31ce803e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7c2b5d01a124f3e94bc557b641f77a1'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:28.384179 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b278c-792d-40a0-b51f-31173410fe08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:28.385676 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b278c-792d-40a0-b51f-31173410fe08 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:28.386241 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-96750729-a9e1-4a6e-9244-5f0e31ce803e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7c2b5d01a124f3e94bc557b641f77a1'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:28.393763 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-96750729-a9e1-4a6e-9244-5f0e31ce803e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7c2b5d01a124f3e94bc557b641f77a1'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:28.394400 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-96750729-a9e1-4a6e-9244-5f0e31ce803e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7c2b5d01a124f3e94bc557b641f77a1'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:28.394987 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-96750729-a9e1-4a6e-9244-5f0e31ce803e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7c2b5d01a124f3e94bc557b641f77a1'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:28.395603 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1178/2366] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:51:28.413098 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1189/2367] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:51:28 2022] DELETE /identity/v3/users/c7c2b5d01a124f3e94bc557b641f77a1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:51:28.618035 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b278c-792d-40a0-b51f-31173410fe08 service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:28.630484 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b278c-792d-40a0-b51f-31173410fe08 service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:28.698394 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9e5e1-6208-4e64-9993-02b8cdf4c116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:28.699277 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9e5e1-6208-4e64-9993-02b8cdf4c116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:28.699648 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9e5e1-6208-4e64-9993-02b8cdf4c116 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:28.699923 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9e5e1-6208-4e64-9993-02b8cdf4c116 admin admin] PATH_INFO: `/v3/projects/de46aa3bf673456885b6c388c16c901b` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:28.701147 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9e5e1-6208-4e64-9993-02b8cdf4c116 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de46aa3bf673456885b6c388c16c901b)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:28.703119 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9e5e1-6208-4e64-9993-02b8cdf4c116 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:28.762161 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c2d9e5e1-6208-4e64-9993-02b8cdf4c116 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de46aa3bf673456885b6c388c16c901b', 'request_id': 'req-c2d9e5e1-6208-4e64-9993-02b8cdf4c116'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:28.769379 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c2d9e5e1-6208-4e64-9993-02b8cdf4c116 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de46aa3bf673456885b6c388c16c901b', 'request_id': 'req-c2d9e5e1-6208-4e64-9993-02b8cdf4c116'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:28.774861 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c2d9e5e1-6208-4e64-9993-02b8cdf4c116 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de46aa3bf673456885b6c388c16c901b', 'request_id': 'req-c2d9e5e1-6208-4e64-9993-02b8cdf4c116'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:28.786426 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c2d9e5e1-6208-4e64-9993-02b8cdf4c116 admin admin] The token cache is being invalidate because project de46aa3bf673456885b6c388c16c901b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:51:28.786710 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c2d9e5e1-6208-4e64-9993-02b8cdf4c116 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:28.787450 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c2d9e5e1-6208-4e64-9993-02b8cdf4c116 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:28.789034 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1179/2368] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:51:28 2022] DELETE /identity/v3/projects/de46aa3bf673456885b6c388c16c901b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:28.797628 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bbdd5-4d98-4362-86e5-fce852d12e6c None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:28.798116 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bbdd5-4d98-4362-86e5-fce852d12e6c None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:28.798255 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109bbdd5-4d98-4362-86e5-fce852d12e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:28.818295 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-109bbdd5-4d98-4362-86e5-fce852d12e6c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:28.819534 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-109bbdd5-4d98-4362-86e5-fce852d12e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:28.886377 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1190/2369] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:28.894227 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6077221-eb7b-46df-8d34-b9f5bb71df88 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:28.894728 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6077221-eb7b-46df-8d34-b9f5bb71df88 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:28.895004 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6077221-eb7b-46df-8d34-b9f5bb71df88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:28.914232 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-c6077221-eb7b-46df-8d34-b9f5bb71df88 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:28.916185 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-c6077221-eb7b-46df-8d34-b9f5bb71df88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:28.924114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1180/2370] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:51:28.928428 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109bbdd5-4d98-4362-86e5-fce852d12e6c None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:28.938720 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109bbdd5-4d98-4362-86e5-fce852d12e6c None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:28.943389 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a60944-12fd-43b6-acfd-ad3f924937f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:28.944081 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a60944-12fd-43b6-acfd-ad3f924937f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:28.944359 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a60944-12fd-43b6-acfd-ad3f924937f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:28.944658 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a60944-12fd-43b6-acfd-ad3f924937f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:28.945401 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a60944-12fd-43b6-acfd-ad3f924937f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:51:28.945702 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a60944-12fd-43b6-acfd-ad3f924937f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:28.947415 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a60944-12fd-43b6-acfd-ad3f924937f6 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:28.962633 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1191/2371] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:51:28.963994 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6077221-eb7b-46df-8d34-b9f5bb71df88 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:28.973239 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6077221-eb7b-46df-8d34-b9f5bb71df88 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:28.977974 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fc50b-6c79-4c5e-9f64-db19511902f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:28.978632 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fc50b-6c79-4c5e-9f64-db19511902f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:28.978905 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fc50b-6c79-4c5e-9f64-db19511902f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:28.979175 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65fc50b-6c79-4c5e-9f64-db19511902f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:28.979931 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fc50b-6c79-4c5e-9f64-db19511902f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:28.981844 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65fc50b-6c79-4c5e-9f64-db19511902f9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:29.006490 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1181/2372] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:51:28 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:51:29.012272 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a60944-12fd-43b6-acfd-ad3f924937f6 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:29.024920 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a60944-12fd-43b6-acfd-ad3f924937f6 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:29.083456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc091e9a-bc81-4b2c-9233-56d68e18d912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:29.084058 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc091e9a-bc81-4b2c-9233-56d68e18d912 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:29.084334 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc091e9a-bc81-4b2c-9233-56d68e18d912 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:29.084605 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc091e9a-bc81-4b2c-9233-56d68e18d912 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:29.085325 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc091e9a-bc81-4b2c-9233-56d68e18d912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:29.087397 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc091e9a-bc81-4b2c-9233-56d68e18d912 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:29.109455 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1192/2373] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:51:29 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:51:29.113678 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fc50b-6c79-4c5e-9f64-db19511902f9 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:29.123986 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65fc50b-6c79-4c5e-9f64-db19511902f9 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:29.128827 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f31cb-2e22-4828-b3a4-0bb67005187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:29.129488 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f31cb-2e22-4828-b3a4-0bb67005187b admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:29.129767 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f31cb-2e22-4828-b3a4-0bb67005187b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:29.130043 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f31cb-2e22-4828-b3a4-0bb67005187b admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:29.130823 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f31cb-2e22-4828-b3a4-0bb67005187b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:29.132451 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f31cb-2e22-4828-b3a4-0bb67005187b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:29.143592 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1182/2374] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:29.148403 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc091e9a-bc81-4b2c-9233-56d68e18d912 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:29.159091 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc091e9a-bc81-4b2c-9233-56d68e18d912 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:29.164404 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecf184-93fc-4a6f-868b-6b353a298e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:29.165103 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecf184-93fc-4a6f-868b-6b353a298e82 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:29.165385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecf184-93fc-4a6f-868b-6b353a298e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:29.165752 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecf184-93fc-4a6f-868b-6b353a298e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:29.166605 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecf184-93fc-4a6f-868b-6b353a298e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:29.168244 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecf184-93fc-4a6f-868b-6b353a298e82 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:29.178357 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1193/2375] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:51:29.183344 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f31cb-2e22-4828-b3a4-0bb67005187b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:29.194553 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f31cb-2e22-4828-b3a4-0bb67005187b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:29.200044 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e84e0-1445-40ca-81f0-42140b248a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:29.200960 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e84e0-1445-40ca-81f0-42140b248a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:29.201240 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e84e0-1445-40ca-81f0-42140b248a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:29.201534 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e84e0-1445-40ca-81f0-42140b248a2c admin admin] PATH_INFO: `/v3/projects/89ece5eaa16b4d73a21ef1dda9ab1b62/users/4a523ae144ef44ee92fb7317d0d4968d/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:29.217365 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e84e0-1445-40ca-81f0-42140b248a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ece5eaa16b4d73a21ef1dda9ab1b62, user_id=4a523ae144ef44ee92fb7317d0d4968d, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:29.220065 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e84e0-1445-40ca-81f0-42140b248a2c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:29.238790 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1183/2376] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:29 2022] PUT /identity/v3/projects/89ece5eaa16b4d73a21ef1dda9ab1b62/users/4a523ae144ef44ee92fb7317d0d4968d/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:29.249529 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e07f9-aa9d-4f0e-95fc-26f5ff00da8a None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:29.249816 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e07f9-aa9d-4f0e-95fc-26f5ff00da8a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:29.250090 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e07f9-aa9d-4f0e-95fc-26f5ff00da8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:29.277091 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-be6e07f9-aa9d-4f0e-95fc-26f5ff00da8a None None] MFA Rules not processed for user `4a523ae144ef44ee92fb7317d0d4968d`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:29.278294 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-be6e07f9-aa9d-4f0e-95fc-26f5ff00da8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:29.344397 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1194/2377] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:29.355804 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e84e0-1445-40ca-81f0-42140b248a2c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:29.357832 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5e8e84e0-1445-40ca-81f0-42140b248a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:29.457558 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e84e0-1445-40ca-81f0-42140b248a2c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:29.464229 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f9208-d0a2-4c74-99bc-ce2b434c0bd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:29.464850 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f9208-d0a2-4c74-99bc-ce2b434c0bd2 service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:29.465147 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f9208-d0a2-4c74-99bc-ce2b434c0bd2 service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:29.465420 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f9208-d0a2-4c74-99bc-ce2b434c0bd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:29.473538 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f9208-d0a2-4c74-99bc-ce2b434c0bd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:29.475131 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f9208-d0a2-4c74-99bc-ce2b434c0bd2 service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:29.484047 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1184/2378] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:51:37.944492 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e07f9-aa9d-4f0e-95fc-26f5ff00da8a None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:37.946025 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-be6e07f9-aa9d-4f0e-95fc-26f5ff00da8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:38.026174 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e07f9-aa9d-4f0e-95fc-26f5ff00da8a None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:38.031918 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5d3a3-1202-486d-9e38-0269fa0182e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:38.032764 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5d3a3-1202-486d-9e38-0269fa0182e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:38.033048 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5d3a3-1202-486d-9e38-0269fa0182e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:38.033308 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5d3a3-1202-486d-9e38-0269fa0182e3 admin admin] PATH_INFO: `/v3/users/a2ebdd2e891345ca843acd1f256da4db` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:38.034606 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5d3a3-1202-486d-9e38-0269fa0182e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ebdd2e891345ca843acd1f256da4db)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:38.036569 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5d3a3-1202-486d-9e38-0269fa0182e3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:38.084600 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-b0e5d3a3-1202-486d-9e38-0269fa0182e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ebdd2e891345ca843acd1f256da4db'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:38.091125 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-b0e5d3a3-1202-486d-9e38-0269fa0182e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ebdd2e891345ca843acd1f256da4db'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:38.099430 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-b0e5d3a3-1202-486d-9e38-0269fa0182e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ebdd2e891345ca843acd1f256da4db'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:38.100049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-b0e5d3a3-1202-486d-9e38-0269fa0182e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ebdd2e891345ca843acd1f256da4db'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:38.100632 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-b0e5d3a3-1202-486d-9e38-0269fa0182e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ebdd2e891345ca843acd1f256da4db'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:38.117057 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1195/2379] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:51:37 2022] DELETE /identity/v3/users/a2ebdd2e891345ca843acd1f256da4db => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:38.121852 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f57179-1ad0-453c-bf78-1776d275392e None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:38.122346 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f57179-1ad0-453c-bf78-1776d275392e None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:38.122439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f57179-1ad0-453c-bf78-1776d275392e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:38.140478 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-98f57179-1ad0-453c-bf78-1776d275392e None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:38.141695 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-98f57179-1ad0-453c-bf78-1776d275392e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:38.206507 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1185/2380] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:38.217082 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5d3a3-1202-486d-9e38-0269fa0182e3 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:38.218585 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b0e5d3a3-1202-486d-9e38-0269fa0182e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:38.277542 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5d3a3-1202-486d-9e38-0269fa0182e3 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:38.281824 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98c093-32ff-47ac-9f19-21b6c391a41d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:38.282470 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98c093-32ff-47ac-9f19-21b6c391a41d service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:38.282746 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98c093-32ff-47ac-9f19-21b6c391a41d service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:38.283047 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98c093-32ff-47ac-9f19-21b6c391a41d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:38.292336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98c093-32ff-47ac-9f19-21b6c391a41d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:38.294075 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98c093-32ff-47ac-9f19-21b6c391a41d service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:38.303413 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1196/2381] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:51:38.823312 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f57179-1ad0-453c-bf78-1776d275392e None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:38.824862 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-98f57179-1ad0-453c-bf78-1776d275392e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:38.841034 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f57179-1ad0-453c-bf78-1776d275392e None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:38.846640 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373de700-eb4f-40e8-9cd1-921f7f15aad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:38.847441 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373de700-eb4f-40e8-9cd1-921f7f15aad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:38.847802 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373de700-eb4f-40e8-9cd1-921f7f15aad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:38.848138 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373de700-eb4f-40e8-9cd1-921f7f15aad3 admin admin] PATH_INFO: `/v3/projects/c96a6ffb39d642aca44c304743affde5` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:38.849593 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373de700-eb4f-40e8-9cd1-921f7f15aad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96a6ffb39d642aca44c304743affde5)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:38.852567 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373de700-eb4f-40e8-9cd1-921f7f15aad3 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:38.893204 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98c093-32ff-47ac-9f19-21b6c391a41d service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:38.894577 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-fe98c093-32ff-47ac-9f19-21b6c391a41d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:38.902487 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-373de700-eb4f-40e8-9cd1-921f7f15aad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96a6ffb39d642aca44c304743affde5', 'request_id': 'req-373de700-eb4f-40e8-9cd1-921f7f15aad3'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:38.907253 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98c093-32ff-47ac-9f19-21b6c391a41d service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:38.910770 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-373de700-eb4f-40e8-9cd1-921f7f15aad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96a6ffb39d642aca44c304743affde5', 'request_id': 'req-373de700-eb4f-40e8-9cd1-921f7f15aad3'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:38.916392 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-373de700-eb4f-40e8-9cd1-921f7f15aad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96a6ffb39d642aca44c304743affde5', 'request_id': 'req-373de700-eb4f-40e8-9cd1-921f7f15aad3'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:38.927250 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-373de700-eb4f-40e8-9cd1-921f7f15aad3 admin admin] The token cache is being invalidate because project c96a6ffb39d642aca44c304743affde5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:51:38.927569 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-373de700-eb4f-40e8-9cd1-921f7f15aad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:38.928200 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-373de700-eb4f-40e8-9cd1-921f7f15aad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:38.929730 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1186/2382] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:51:38 2022] DELETE /identity/v3/projects/c96a6ffb39d642aca44c304743affde5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:38.936309 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7489e79-5963-49e4-8dea-cef2b6ab28c1 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:38.936595 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7489e79-5963-49e4-8dea-cef2b6ab28c1 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:38.936871 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7489e79-5963-49e4-8dea-cef2b6ab28c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:38.954889 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-d7489e79-5963-49e4-8dea-cef2b6ab28c1 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:38.956064 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-d7489e79-5963-49e4-8dea-cef2b6ab28c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:38.962733 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e00ef-eb38-4037-acb5-5bb1ae8d3508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:38.963639 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e00ef-eb38-4037-acb5-5bb1ae8d3508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:38.963915 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e00ef-eb38-4037-acb5-5bb1ae8d3508 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:38.964178 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e00ef-eb38-4037-acb5-5bb1ae8d3508 admin admin] PATH_INFO: `/v3/users/4a523ae144ef44ee92fb7317d0d4968d` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:38.966205 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e00ef-eb38-4037-acb5-5bb1ae8d3508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a523ae144ef44ee92fb7317d0d4968d)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:38.968184 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e00ef-eb38-4037-acb5-5bb1ae8d3508 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:39.013213 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1187/2383] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:51:39.017670 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-286e00ef-eb38-4037-acb5-5bb1ae8d3508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a523ae144ef44ee92fb7317d0d4968d'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:39.020643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947dc00-3652-4c7e-a5fc-159fc7ec5bdf None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:39.021090 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947dc00-3652-4c7e-a5fc-159fc7ec5bdf None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:39.021402 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947dc00-3652-4c7e-a5fc-159fc7ec5bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:39.024257 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-286e00ef-eb38-4037-acb5-5bb1ae8d3508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a523ae144ef44ee92fb7317d0d4968d'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:39.032979 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-286e00ef-eb38-4037-acb5-5bb1ae8d3508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a523ae144ef44ee92fb7317d0d4968d'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:39.033599 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-286e00ef-eb38-4037-acb5-5bb1ae8d3508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a523ae144ef44ee92fb7317d0d4968d'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:39.034189 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-286e00ef-eb38-4037-acb5-5bb1ae8d3508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a523ae144ef44ee92fb7317d0d4968d'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:39.038863 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-9947dc00-3652-4c7e-a5fc-159fc7ec5bdf None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:39.040077 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9947dc00-3652-4c7e-a5fc-159fc7ec5bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:39.048007 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1188/2384] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:51:39.052199 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947dc00-3652-4c7e-a5fc-159fc7ec5bdf None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:39.053107 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1197/2385] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:51:38 2022] DELETE /identity/v3/users/4a523ae144ef44ee92fb7317d0d4968d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:51:39.057445 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace99a3c-c5a1-4999-be0b-e6021199b64a None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:39.057666 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace99a3c-c5a1-4999-be0b-e6021199b64a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:39.057930 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace99a3c-c5a1-4999-be0b-e6021199b64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:39.061851 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947dc00-3652-4c7e-a5fc-159fc7ec5bdf None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:39.078742 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-ace99a3c-c5a1-4999-be0b-e6021199b64a None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:39.079990 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ace99a3c-c5a1-4999-be0b-e6021199b64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:39.117162 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb633987-f877-479b-b182-f0e64c7acf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:39.117836 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb633987-f877-479b-b182-f0e64c7acf6b admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:39.118113 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb633987-f877-479b-b182-f0e64c7acf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:39.118383 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb633987-f877-479b-b182-f0e64c7acf6b admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:39.119128 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb633987-f877-479b-b182-f0e64c7acf6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:51:39.119431 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb633987-f877-479b-b182-f0e64c7acf6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:39.121331 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb633987-f877-479b-b182-f0e64c7acf6b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:39.136084 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1189/2386] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:51:39.137220 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb633987-f877-479b-b182-f0e64c7acf6b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:39.139789 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1198/2387] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:51:39.146930 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb633987-f877-479b-b182-f0e64c7acf6b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:39.149806 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace99a3c-c5a1-4999-be0b-e6021199b64a None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:39.151210 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ace99a3c-c5a1-4999-be0b-e6021199b64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:39.152744 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aac10d-c3e9-4a59-ac10-ab290a9b5bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:39.153480 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aac10d-c3e9-4a59-ac10-ab290a9b5bfb admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:39.153756 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aac10d-c3e9-4a59-ac10-ab290a9b5bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:39.154023 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aac10d-c3e9-4a59-ac10-ab290a9b5bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:39.154716 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aac10d-c3e9-4a59-ac10-ab290a9b5bfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:39.156621 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aac10d-c3e9-4a59-ac10-ab290a9b5bfb admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:39.183417 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1190/2388] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:51:39 2022] POST /identity/v3/projects => generated 359 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:51:39.187988 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aac10d-c3e9-4a59-ac10-ab290a9b5bfb admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:39.211272 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace99a3c-c5a1-4999-be0b-e6021199b64a None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:39.252042 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aac10d-c3e9-4a59-ac10-ab290a9b5bfb admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:39.257101 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7064d-122b-4ba9-8198-de236f624240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:39.257807 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7064d-122b-4ba9-8198-de236f624240 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:39.257922 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635618b-0d86-49fe-8142-a482d29d243d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:39.258074 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7064d-122b-4ba9-8198-de236f624240 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:39.258353 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7064d-122b-4ba9-8198-de236f624240 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:39.258588 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635618b-0d86-49fe-8142-a482d29d243d service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:39.258867 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635618b-0d86-49fe-8142-a482d29d243d service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:39.259057 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7064d-122b-4ba9-8198-de236f624240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:39.259155 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635618b-0d86-49fe-8142-a482d29d243d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:39.261084 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae7064d-122b-4ba9-8198-de236f624240 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:39.268846 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635618b-0d86-49fe-8142-a482d29d243d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:39.270402 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635618b-0d86-49fe-8142-a482d29d243d service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:39.283459 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1199/2389] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:51:39.287558 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1191/2390] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:51:39 2022] POST /identity/v3/users => generated 280 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:51:39.289305 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635618b-0d86-49fe-8142-a482d29d243d service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:39.299971 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635618b-0d86-49fe-8142-a482d29d243d service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:39.305545 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb9bac-8b6c-4f24-a20c-39a645f1f538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:39.306226 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb9bac-8b6c-4f24-a20c-39a645f1f538 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:39.306505 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb9bac-8b6c-4f24-a20c-39a645f1f538 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:39.306770 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb9bac-8b6c-4f24-a20c-39a645f1f538 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:39.307605 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb9bac-8b6c-4f24-a20c-39a645f1f538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:39.310349 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb9bac-8b6c-4f24-a20c-39a645f1f538 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:39.321523 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1200/2391] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:39.326126 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7064d-122b-4ba9-8198-de236f624240 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:39.336085 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7064d-122b-4ba9-8198-de236f624240 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:39.341057 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c9989-ed9e-492b-82de-7727b458a987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:39.341727 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c9989-ed9e-492b-82de-7727b458a987 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:39.342008 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c9989-ed9e-492b-82de-7727b458a987 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:39.342429 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c9989-ed9e-492b-82de-7727b458a987 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:39.343022 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c9989-ed9e-492b-82de-7727b458a987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:39.344654 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c9989-ed9e-492b-82de-7727b458a987 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:39.354739 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1192/2392] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:51:39.359107 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb9bac-8b6c-4f24-a20c-39a645f1f538 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:39.368954 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb9bac-8b6c-4f24-a20c-39a645f1f538 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:39.373913 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1d7ae-5fda-4ed2-865b-d5cd46dce2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:39.374803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1d7ae-5fda-4ed2-865b-d5cd46dce2e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:39.375082 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1d7ae-5fda-4ed2-865b-d5cd46dce2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:39.375353 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1d7ae-5fda-4ed2-865b-d5cd46dce2e1 admin admin] PATH_INFO: `/v3/projects/005aca58f76346ecb31a51ac885ae7b4/users/88303d97e9ea4a429a05d94b81d9bf20/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:39.391587 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1d7ae-5fda-4ed2-865b-d5cd46dce2e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=005aca58f76346ecb31a51ac885ae7b4, user_id=88303d97e9ea4a429a05d94b81d9bf20, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:39.394328 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1d7ae-5fda-4ed2-865b-d5cd46dce2e1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:39.418141 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1201/2393] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:39 2022] PUT /identity/v3/projects/005aca58f76346ecb31a51ac885ae7b4/users/88303d97e9ea4a429a05d94b81d9bf20/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:39.420094 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433af9a-e0ba-4264-9548-b30e0039f29e None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:39.420380 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433af9a-e0ba-4264-9548-b30e0039f29e None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:39.420647 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433af9a-e0ba-4264-9548-b30e0039f29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:39.458907 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-3433af9a-e0ba-4264-9548-b30e0039f29e None None] MFA Rules not processed for user `88303d97e9ea4a429a05d94b81d9bf20`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:39.460147 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-3433af9a-e0ba-4264-9548-b30e0039f29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:39.524603 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1193/2394] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:39 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:39.564252 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1d7ae-5fda-4ed2-865b-d5cd46dce2e1 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:39.565992 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433af9a-e0ba-4264-9548-b30e0039f29e None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:39.566140 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-2cf1d7ae-5fda-4ed2-865b-d5cd46dce2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:39.567761 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-3433af9a-e0ba-4264-9548-b30e0039f29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:39.624122 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433af9a-e0ba-4264-9548-b30e0039f29e None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:39.627877 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7a8c6-7067-4482-88b0-e3ac3b0efe28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:39.628530 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7a8c6-7067-4482-88b0-e3ac3b0efe28 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:39.628806 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7a8c6-7067-4482-88b0-e3ac3b0efe28 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:39.629075 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7a8c6-7067-4482-88b0-e3ac3b0efe28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:39.632689 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1d7ae-5fda-4ed2-865b-d5cd46dce2e1 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:39.637594 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49ee51-ac53-4df2-9f3b-6c9e7380e391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:39.638161 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7a8c6-7067-4482-88b0-e3ac3b0efe28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:39.638456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49ee51-ac53-4df2-9f3b-6c9e7380e391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:39.638780 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49ee51-ac53-4df2-9f3b-6c9e7380e391 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:39.639053 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49ee51-ac53-4df2-9f3b-6c9e7380e391 admin admin] PATH_INFO: `/v3/projects/89ece5eaa16b4d73a21ef1dda9ab1b62` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:39.639645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7a8c6-7067-4482-88b0-e3ac3b0efe28 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:39.640488 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49ee51-ac53-4df2-9f3b-6c9e7380e391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89ece5eaa16b4d73a21ef1dda9ab1b62)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:39.642396 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49ee51-ac53-4df2-9f3b-6c9e7380e391 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:39.648493 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1194/2395] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:39 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:51:39.665004 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7a8c6-7067-4482-88b0-e3ac3b0efe28 service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:39.678075 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7a8c6-7067-4482-88b0-e3ac3b0efe28 service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:39.691392 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-bc49ee51-ac53-4df2-9f3b-6c9e7380e391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ece5eaa16b4d73a21ef1dda9ab1b62', 'request_id': 'req-bc49ee51-ac53-4df2-9f3b-6c9e7380e391'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:39.697380 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-bc49ee51-ac53-4df2-9f3b-6c9e7380e391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ece5eaa16b4d73a21ef1dda9ab1b62', 'request_id': 'req-bc49ee51-ac53-4df2-9f3b-6c9e7380e391'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:39.705347 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-bc49ee51-ac53-4df2-9f3b-6c9e7380e391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ece5eaa16b4d73a21ef1dda9ab1b62', 'request_id': 'req-bc49ee51-ac53-4df2-9f3b-6c9e7380e391'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:39.715351 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-bc49ee51-ac53-4df2-9f3b-6c9e7380e391 admin admin] The token cache is being invalidate because project 89ece5eaa16b4d73a21ef1dda9ab1b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:51:39.715706 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-bc49ee51-ac53-4df2-9f3b-6c9e7380e391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:39.716474 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-bc49ee51-ac53-4df2-9f3b-6c9e7380e391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:39.718316 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1202/2396] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:51:39 2022] DELETE /identity/v3/projects/89ece5eaa16b4d73a21ef1dda9ab1b62 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:39.723918 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519b9f7-0b72-4a26-8379-8b2e290ba3a5 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:39.724234 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519b9f7-0b72-4a26-8379-8b2e290ba3a5 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:39.724539 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519b9f7-0b72-4a26-8379-8b2e290ba3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:39.738325 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047de5c-dc3d-4323-9f37-c67fa01af1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:39.739206 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047de5c-dc3d-4323-9f37-c67fa01af1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:39.739504 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047de5c-dc3d-4323-9f37-c67fa01af1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:39.739794 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047de5c-dc3d-4323-9f37-c67fa01af1bf admin admin] PATH_INFO: `/v3/users/88303d97e9ea4a429a05d94b81d9bf20` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:39.741078 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047de5c-dc3d-4323-9f37-c67fa01af1bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=88303d97e9ea4a429a05d94b81d9bf20)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:39.743156 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047de5c-dc3d-4323-9f37-c67fa01af1bf admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:39.744541 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-a519b9f7-0b72-4a26-8379-8b2e290ba3a5 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:39.745854 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-a519b9f7-0b72-4a26-8379-8b2e290ba3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:39.754255 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1203/2397] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:51:39.762131 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5af90-40a5-46d9-84f9-c90564048be7 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:39.762422 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5af90-40a5-46d9-84f9-c90564048be7 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:39.762818 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5af90-40a5-46d9-84f9-c90564048be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:39.780589 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-4cc5af90-40a5-46d9-84f9-c90564048be7 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:39.781782 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-4cc5af90-40a5-46d9-84f9-c90564048be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:39.789677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1204/2398] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:51:39.790714 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3047de5c-dc3d-4323-9f37-c67fa01af1bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88303d97e9ea4a429a05d94b81d9bf20'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:39.791367 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3047de5c-dc3d-4323-9f37-c67fa01af1bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88303d97e9ea4a429a05d94b81d9bf20'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:39.792214 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3047de5c-dc3d-4323-9f37-c67fa01af1bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88303d97e9ea4a429a05d94b81d9bf20'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:39.793794 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5af90-40a5-46d9-84f9-c90564048be7 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:39.802818 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5af90-40a5-46d9-84f9-c90564048be7 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:39.804387 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3047de5c-dc3d-4323-9f37-c67fa01af1bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88303d97e9ea4a429a05d94b81d9bf20'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:39.807504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b7400-97da-42ef-89ac-4783c13ea8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:39.808227 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b7400-97da-42ef-89ac-4783c13ea8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:39.808665 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b7400-97da-42ef-89ac-4783c13ea8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:39.809465 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b7400-97da-42ef-89ac-4783c13ea8d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:39.810658 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b7400-97da-42ef-89ac-4783c13ea8d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:51:39.811032 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b7400-97da-42ef-89ac-4783c13ea8d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:39.812226 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3047de5c-dc3d-4323-9f37-c67fa01af1bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88303d97e9ea4a429a05d94b81d9bf20'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:39.812809 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b7400-97da-42ef-89ac-4783c13ea8d4 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:39.824310 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1205/2399] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:51:39.825557 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1195/2400] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:51:39 2022] DELETE /identity/v3/users/88303d97e9ea4a429a05d94b81d9bf20 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:39.828778 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b7400-97da-42ef-89ac-4783c13ea8d4 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:39.830129 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a4914-0af7-45d7-9cf7-396f6beb21dc None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:39.830444 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a4914-0af7-45d7-9cf7-396f6beb21dc None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:39.830553 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-601b7400-97da-42ef-89ac-4783c13ea8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:39.830718 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a4914-0af7-45d7-9cf7-396f6beb21dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:39.843235 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b7400-97da-42ef-89ac-4783c13ea8d4 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:39.849826 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-b44a4914-0af7-45d7-9cf7-396f6beb21dc None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:39.851054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-b44a4914-0af7-45d7-9cf7-396f6beb21dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:39.897037 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e50e6-0a61-451d-8db9-9a16d2d29911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:39.897740 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e50e6-0a61-451d-8db9-9a16d2d29911 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:39.898010 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e50e6-0a61-451d-8db9-9a16d2d29911 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:39.898294 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e50e6-0a61-451d-8db9-9a16d2d29911 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:39.899118 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e50e6-0a61-451d-8db9-9a16d2d29911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:39.901191 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e50e6-0a61-451d-8db9-9a16d2d29911 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:39.908495 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1196/2401] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:51:39.919021 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a4914-0af7-45d7-9cf7-396f6beb21dc None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:39.921052 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-b44a4914-0af7-45d7-9cf7-396f6beb21dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:39.939132 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1206/2402] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:51:39 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:51:39.941411 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e50e6-0a61-451d-8db9-9a16d2d29911 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:39.994776 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a4914-0af7-45d7-9cf7-396f6beb21dc None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:40.014180 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e50e6-0a61-451d-8db9-9a16d2d29911 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:40.019820 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4c417-4d51-4f06-8add-c1450031a2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:40.020502 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4c417-4d51-4f06-8add-c1450031a2af admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.020783 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4c417-4d51-4f06-8add-c1450031a2af admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.021050 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4c417-4d51-4f06-8add-c1450031a2af admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.021780 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4c417-4d51-4f06-8add-c1450031a2af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:40.023751 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4c417-4d51-4f06-8add-c1450031a2af admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:40.045631 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1207/2403] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:51:39 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:51:40.049792 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4c417-4d51-4f06-8add-c1450031a2af admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:40.052026 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdfe8d-c5c7-45b7-a6c2-60cab422784e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:40.052700 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdfe8d-c5c7-45b7-a6c2-60cab422784e service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.052980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdfe8d-c5c7-45b7-a6c2-60cab422784e service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.053249 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdfe8d-c5c7-45b7-a6c2-60cab422784e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.060281 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4c417-4d51-4f06-8add-c1450031a2af admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:40.063507 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdfe8d-c5c7-45b7-a6c2-60cab422784e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:40.064915 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdfe8d-c5c7-45b7-a6c2-60cab422784e service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:40.065100 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa9da7-959c-4b1a-9709-8d85f6f766f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:40.065873 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa9da7-959c-4b1a-9709-8d85f6f766f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.066142 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa9da7-959c-4b1a-9709-8d85f6f766f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.066414 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa9da7-959c-4b1a-9709-8d85f6f766f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.067155 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa9da7-959c-4b1a-9709-8d85f6f766f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:40.068781 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa9da7-959c-4b1a-9709-8d85f6f766f7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:40.074309 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1197/2404] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:51:40.078822 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1208/2405] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:40.082856 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdfe8d-c5c7-45b7-a6c2-60cab422784e service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:40.092315 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdfe8d-c5c7-45b7-a6c2-60cab422784e service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:40.096890 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582dbc0-822a-41d6-9c16-69157bcb3b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:40.097542 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582dbc0-822a-41d6-9c16-69157bcb3b0c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.097818 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582dbc0-822a-41d6-9c16-69157bcb3b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.098091 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582dbc0-822a-41d6-9c16-69157bcb3b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.098935 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582dbc0-822a-41d6-9c16-69157bcb3b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:40.100457 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582dbc0-822a-41d6-9c16-69157bcb3b0c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:40.112751 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1198/2406] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:40.116875 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa9da7-959c-4b1a-9709-8d85f6f766f7 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:40.127201 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa9da7-959c-4b1a-9709-8d85f6f766f7 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:40.132133 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bfcf9-b8b4-43d2-94a3-9db4c9bce6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:40.133105 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bfcf9-b8b4-43d2-94a3-9db4c9bce6dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.133380 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bfcf9-b8b4-43d2-94a3-9db4c9bce6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.133647 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bfcf9-b8b4-43d2-94a3-9db4c9bce6dd admin admin] PATH_INFO: `/v3/projects/5ec62cbe827a42fbb57e5722bb53524f/users/33ef103b35e2455fbd2e489caf27ec45/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.151369 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bfcf9-b8b4-43d2-94a3-9db4c9bce6dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec62cbe827a42fbb57e5722bb53524f, user_id=33ef103b35e2455fbd2e489caf27ec45, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:40.154471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bfcf9-b8b4-43d2-94a3-9db4c9bce6dd admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:40.167170 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1209/2407] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:40 2022] PUT /identity/v3/projects/5ec62cbe827a42fbb57e5722bb53524f/users/33ef103b35e2455fbd2e489caf27ec45/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:40.179257 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6532292-0fe0-4f4e-a682-a5a507b3d018 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.179977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6532292-0fe0-4f4e-a682-a5a507b3d018 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.179977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6532292-0fe0-4f4e-a682-a5a507b3d018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.206011 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-a6532292-0fe0-4f4e-a682-a5a507b3d018 None None] MFA Rules not processed for user `33ef103b35e2455fbd2e489caf27ec45`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:40.207254 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-a6532292-0fe0-4f4e-a682-a5a507b3d018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:40.271592 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1199/2408] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:51:40.276093 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bfcf9-b8b4-43d2-94a3-9db4c9bce6dd admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:40.345305 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bfcf9-b8b4-43d2-94a3-9db4c9bce6dd admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:40.351283 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3309bb2-f7e5-4608-a2ae-71c56914f563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:40.351979 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3309bb2-f7e5-4608-a2ae-71c56914f563 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.352571 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3309bb2-f7e5-4608-a2ae-71c56914f563 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.352571 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3309bb2-f7e5-4608-a2ae-71c56914f563 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.353199 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3309bb2-f7e5-4608-a2ae-71c56914f563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:40.355070 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3309bb2-f7e5-4608-a2ae-71c56914f563 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:40.360427 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6532292-0fe0-4f4e-a682-a5a507b3d018 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:40.362563 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-a6532292-0fe0-4f4e-a682-a5a507b3d018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:40.384471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1210/2409] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:51:40 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:51:40.392160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3309bb2-f7e5-4608-a2ae-71c56914f563 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:40.395558 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6532292-0fe0-4f4e-a682-a5a507b3d018 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:40.449269 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40092e62-512e-492a-ad0e-4f2d20529b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:40.450307 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40092e62-512e-492a-ad0e-4f2d20529b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.450588 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40092e62-512e-492a-ad0e-4f2d20529b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.450950 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40092e62-512e-492a-ad0e-4f2d20529b61 admin admin] PATH_INFO: `/v3/projects/005aca58f76346ecb31a51ac885ae7b4` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.452107 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40092e62-512e-492a-ad0e-4f2d20529b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=005aca58f76346ecb31a51ac885ae7b4)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:40.453469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3309bb2-f7e5-4608-a2ae-71c56914f563 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:40.454020 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40092e62-512e-492a-ad0e-4f2d20529b61 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:40.458204 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89ca4c-163d-44b6-bbbb-78b187da03a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:40.458884 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89ca4c-163d-44b6-bbbb-78b187da03a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.459165 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89ca4c-163d-44b6-bbbb-78b187da03a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.459439 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89ca4c-163d-44b6-bbbb-78b187da03a8 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.460176 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89ca4c-163d-44b6-bbbb-78b187da03a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:40.462275 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89ca4c-163d-44b6-bbbb-78b187da03a8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:40.483794 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1211/2410] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:51:40 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:51:40.487728 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89ca4c-163d-44b6-bbbb-78b187da03a8 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:40.497411 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89ca4c-163d-44b6-bbbb-78b187da03a8 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:40.502063 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-40092e62-512e-492a-ad0e-4f2d20529b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '005aca58f76346ecb31a51ac885ae7b4', 'request_id': 'req-40092e62-512e-492a-ad0e-4f2d20529b61'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:40.509977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-40092e62-512e-492a-ad0e-4f2d20529b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '005aca58f76346ecb31a51ac885ae7b4', 'request_id': 'req-40092e62-512e-492a-ad0e-4f2d20529b61'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:40.515753 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-40092e62-512e-492a-ad0e-4f2d20529b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '005aca58f76346ecb31a51ac885ae7b4', 'request_id': 'req-40092e62-512e-492a-ad0e-4f2d20529b61'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:40.526738 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-40092e62-512e-492a-ad0e-4f2d20529b61 admin admin] The token cache is being invalidate because project 005aca58f76346ecb31a51ac885ae7b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:51:40.527050 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-40092e62-512e-492a-ad0e-4f2d20529b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:40.527740 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-40092e62-512e-492a-ad0e-4f2d20529b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:40.529326 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1200/2411] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:51:40 2022] DELETE /identity/v3/projects/005aca58f76346ecb31a51ac885ae7b4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:51:40.534949 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81056457-05f3-42bb-9716-22d50ee94a21 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.535299 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81056457-05f3-42bb-9716-22d50ee94a21 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.535678 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81056457-05f3-42bb-9716-22d50ee94a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.552260 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a9bd0-c4e6-4648-a7cd-e50b3598b94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:40.552934 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a9bd0-c4e6-4648-a7cd-e50b3598b94f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.553211 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a9bd0-c4e6-4648-a7cd-e50b3598b94f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.553482 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a9bd0-c4e6-4648-a7cd-e50b3598b94f admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.553714 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-81056457-05f3-42bb-9716-22d50ee94a21 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:40.554224 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a9bd0-c4e6-4648-a7cd-e50b3598b94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:40.555856 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a9bd0-c4e6-4648-a7cd-e50b3598b94f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:40.556124 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-81056457-05f3-42bb-9716-22d50ee94a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:40.564701 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1201/2412] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:51:40.569829 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1212/2413] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:51:40.570645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81056457-05f3-42bb-9716-22d50ee94a21 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:40.571993 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-81056457-05f3-42bb-9716-22d50ee94a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:40.572921 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de9b71-929b-49d3-a21d-7a9091edb321 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.573206 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de9b71-929b-49d3-a21d-7a9091edb321 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.573466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de9b71-929b-49d3-a21d-7a9091edb321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.584113 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81056457-05f3-42bb-9716-22d50ee94a21 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:40.593543 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18557b84-ba44-4840-adee-85ffd0cbe1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:40.594465 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18557b84-ba44-4840-adee-85ffd0cbe1cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.594743 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18557b84-ba44-4840-adee-85ffd0cbe1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.594869 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-73de9b71-929b-49d3-a21d-7a9091edb321 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:40.595017 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18557b84-ba44-4840-adee-85ffd0cbe1cb admin admin] PATH_INFO: `/v3/projects/1d042f4a2eed474dbbdac8098f09f060/users/2d97f00c6f2743fb8ed186dd1c66c183/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.596024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-73de9b71-929b-49d3-a21d-7a9091edb321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:40.603956 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1213/2414] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:51:40.608467 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de9b71-929b-49d3-a21d-7a9091edb321 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:40.609834 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18557b84-ba44-4840-adee-85ffd0cbe1cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d042f4a2eed474dbbdac8098f09f060, user_id=2d97f00c6f2743fb8ed186dd1c66c183, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:40.612581 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18557b84-ba44-4840-adee-85ffd0cbe1cb admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:40.617599 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de9b71-929b-49d3-a21d-7a9091edb321 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:40.623364 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd266b-83ec-4279-80aa-46dae0445d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:40.624058 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd266b-83ec-4279-80aa-46dae0445d97 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.624362 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd266b-83ec-4279-80aa-46dae0445d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.624635 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd266b-83ec-4279-80aa-46dae0445d97 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.625356 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd266b-83ec-4279-80aa-46dae0445d97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:51:40.625659 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd266b-83ec-4279-80aa-46dae0445d97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:40.627277 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd266b-83ec-4279-80aa-46dae0445d97 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:40.627579 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1202/2415] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:40 2022] PUT /identity/v3/projects/1d042f4a2eed474dbbdac8098f09f060/users/2d97f00c6f2743fb8ed186dd1c66c183/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:51:40.631443 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18557b84-ba44-4840-adee-85ffd0cbe1cb admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:40.641023 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1214/2416] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:51:40.645134 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd266b-83ec-4279-80aa-46dae0445d97 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:40.655242 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd266b-83ec-4279-80aa-46dae0445d97 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:40.698279 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18557b84-ba44-4840-adee-85ffd0cbe1cb admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:40.703381 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda1639-7e2f-4c42-aef9-7cf5a93d79ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:40.704085 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda1639-7e2f-4c42-aef9-7cf5a93d79ea admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.704360 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda1639-7e2f-4c42-aef9-7cf5a93d79ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.704630 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda1639-7e2f-4c42-aef9-7cf5a93d79ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.705380 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda1639-7e2f-4c42-aef9-7cf5a93d79ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:40.706997 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda1639-7e2f-4c42-aef9-7cf5a93d79ea admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:40.711737 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d96c15-2a2f-4127-9fc1-a873148ba402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:40.712405 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d96c15-2a2f-4127-9fc1-a873148ba402 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.712680 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d96c15-2a2f-4127-9fc1-a873148ba402 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.712947 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d96c15-2a2f-4127-9fc1-a873148ba402 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.713643 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d96c15-2a2f-4127-9fc1-a873148ba402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:40.715623 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d96c15-2a2f-4127-9fc1-a873148ba402 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:40.717196 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1203/2417] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:51:40.721155 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda1639-7e2f-4c42-aef9-7cf5a93d79ea admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:40.730927 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda1639-7e2f-4c42-aef9-7cf5a93d79ea admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:40.736765 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a3bdc-bb48-433c-9cce-06fd79982c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:40.737929 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a3bdc-bb48-433c-9cce-06fd79982c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.738289 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a3bdc-bb48-433c-9cce-06fd79982c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.738631 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a3bdc-bb48-433c-9cce-06fd79982c75 admin admin] PATH_INFO: `/v3/projects/1d042f4a2eed474dbbdac8098f09f060/users/2d97f00c6f2743fb8ed186dd1c66c183/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.740761 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a3bdc-bb48-433c-9cce-06fd79982c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d042f4a2eed474dbbdac8098f09f060, user_id=2d97f00c6f2743fb8ed186dd1c66c183, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:40.743616 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a3bdc-bb48-433c-9cce-06fd79982c75 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:40.744479 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1215/2418] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:51:40 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:51:40.748380 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d96c15-2a2f-4127-9fc1-a873148ba402 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:40.754486 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1204/2419] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:40 2022] PUT /identity/v3/projects/1d042f4a2eed474dbbdac8098f09f060/users/2d97f00c6f2743fb8ed186dd1c66c183/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:40.764741 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46361b-0670-423d-a190-d7916f678701 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.765024 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46361b-0670-423d-a190-d7916f678701 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.765299 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46361b-0670-423d-a190-d7916f678701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.791939 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-2b46361b-0670-423d-a190-d7916f678701 None None] MFA Rules not processed for user `2d97f00c6f2743fb8ed186dd1c66c183`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:40.793208 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-2b46361b-0670-423d-a190-d7916f678701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:40.807955 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d96c15-2a2f-4127-9fc1-a873148ba402 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:40.860753 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1205/2420] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:40 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:51:40.871098 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46361b-0670-423d-a190-d7916f678701 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:40.872533 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-2b46361b-0670-423d-a190-d7916f678701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:40.873117 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70df0f-cfb7-417d-8498-743b3fab85f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:40.873822 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70df0f-cfb7-417d-8498-743b3fab85f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.874103 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70df0f-cfb7-417d-8498-743b3fab85f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.874368 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70df0f-cfb7-417d-8498-743b3fab85f9 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.875076 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70df0f-cfb7-417d-8498-743b3fab85f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:40.877036 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70df0f-cfb7-417d-8498-743b3fab85f9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:40.898343 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1216/2421] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:51:40 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:51:40.902482 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70df0f-cfb7-417d-8498-743b3fab85f9 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:40.912603 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70df0f-cfb7-417d-8498-743b3fab85f9 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:40.917517 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8e4b7-b539-4cc1-b291-394237b78fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:40.918188 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8e4b7-b539-4cc1-b291-394237b78fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.918496 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8e4b7-b539-4cc1-b291-394237b78fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.918767 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8e4b7-b539-4cc1-b291-394237b78fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.919507 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8e4b7-b539-4cc1-b291-394237b78fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:40.921233 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8e4b7-b539-4cc1-b291-394237b78fa6 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:40.928088 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46361b-0670-423d-a190-d7916f678701 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:40.931484 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1217/2422] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:40.934792 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3153e-5923-4be7-8f40-24a64ff75c9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:40.935683 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3153e-5923-4be7-8f40-24a64ff75c9b service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.935809 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8e4b7-b539-4cc1-b291-394237b78fa6 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:40.936157 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3153e-5923-4be7-8f40-24a64ff75c9b service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.936486 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3153e-5923-4be7-8f40-24a64ff75c9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.945259 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8e4b7-b539-4cc1-b291-394237b78fa6 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:40.945641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3153e-5923-4be7-8f40-24a64ff75c9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:40.947125 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3153e-5923-4be7-8f40-24a64ff75c9b service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:40.949890 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c20f0e-8ad9-4534-9ceb-c101d667a983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:40.950541 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c20f0e-8ad9-4534-9ceb-c101d667a983 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.950823 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c20f0e-8ad9-4534-9ceb-c101d667a983 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.951094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c20f0e-8ad9-4534-9ceb-c101d667a983 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:40.951855 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c20f0e-8ad9-4534-9ceb-c101d667a983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:40.953491 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c20f0e-8ad9-4534-9ceb-c101d667a983 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:40.957190 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1206/2423] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:40 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:51:40.963937 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1218/2424] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:40.968189 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3153e-5923-4be7-8f40-24a64ff75c9b service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:40.978134 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3153e-5923-4be7-8f40-24a64ff75c9b service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:40.983313 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5afa7-478e-4dd1-a45d-bccc9e779529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:40.984223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5afa7-478e-4dd1-a45d-bccc9e779529 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:40.984496 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5afa7-478e-4dd1-a45d-bccc9e779529 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:40.984789 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5afa7-478e-4dd1-a45d-bccc9e779529 admin admin] PATH_INFO: `/v3/projects/5283f1d9c54945f29233de283ac8dc5c/users/ec3571c8046843e7a47bc57bcc39ffef/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:41.000377 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5afa7-478e-4dd1-a45d-bccc9e779529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5283f1d9c54945f29233de283ac8dc5c, user_id=ec3571c8046843e7a47bc57bcc39ffef, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:41.002988 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5afa7-478e-4dd1-a45d-bccc9e779529 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:41.017514 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1207/2425] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:40 2022] PUT /identity/v3/projects/5283f1d9c54945f29233de283ac8dc5c/users/ec3571c8046843e7a47bc57bcc39ffef/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:51:41.029125 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbd545-6af6-4600-bde0-419c2b9da186 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:41.029645 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbd545-6af6-4600-bde0-419c2b9da186 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:41.029765 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbd545-6af6-4600-bde0-419c2b9da186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:41.033709 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5afa7-478e-4dd1-a45d-bccc9e779529 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:41.059217 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-3bbbd545-6af6-4600-bde0-419c2b9da186 None None] MFA Rules not processed for user `ec3571c8046843e7a47bc57bcc39ffef`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:41.061000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-3bbbd545-6af6-4600-bde0-419c2b9da186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:41.093047 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5afa7-478e-4dd1-a45d-bccc9e779529 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:41.097270 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be298c5-6ddc-44d6-b48c-f016b188358d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:41.097866 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be298c5-6ddc-44d6-b48c-f016b188358d service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:41.098145 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be298c5-6ddc-44d6-b48c-f016b188358d service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:41.098412 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be298c5-6ddc-44d6-b48c-f016b188358d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:41.100745 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-8be298c5-6ddc-44d6-b48c-f016b188358d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:41.131130 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1219/2426] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:41.135648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbd545-6af6-4600-bde0-419c2b9da186 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:41.160970 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be298c5-6ddc-44d6-b48c-f016b188358d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:41.162411 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be298c5-6ddc-44d6-b48c-f016b188358d service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:41.171412 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1208/2427] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:51:41.196169 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbd545-6af6-4600-bde0-419c2b9da186 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:41.201123 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96b5f8-d082-441e-b3f1-02d08be825db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:41.201792 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96b5f8-d082-441e-b3f1-02d08be825db admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:41.202066 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96b5f8-d082-441e-b3f1-02d08be825db admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:41.202317 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96b5f8-d082-441e-b3f1-02d08be825db admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:41.203022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96b5f8-d082-441e-b3f1-02d08be825db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:41.204980 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96b5f8-d082-441e-b3f1-02d08be825db admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:41.235073 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1220/2428] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:51:41 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:51:41.236282 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be298c5-6ddc-44d6-b48c-f016b188358d service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:41.247375 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be298c5-6ddc-44d6-b48c-f016b188358d service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:41.314012 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240931f-1c59-41b3-a414-7f5c0bb04a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:41.314695 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240931f-1c59-41b3-a414-7f5c0bb04a9a admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:41.314973 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240931f-1c59-41b3-a414-7f5c0bb04a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:41.315239 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240931f-1c59-41b3-a414-7f5c0bb04a9a admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:41.315989 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240931f-1c59-41b3-a414-7f5c0bb04a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:41.317941 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240931f-1c59-41b3-a414-7f5c0bb04a9a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:41.339327 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1209/2429] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:51:41 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:51:41.343820 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96b5f8-d082-441e-b3f1-02d08be825db admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:41.358801 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96b5f8-d082-441e-b3f1-02d08be825db admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:41.364270 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06d6f5-d514-498c-9647-00443b005f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:41.364940 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06d6f5-d514-498c-9647-00443b005f9a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:41.365224 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06d6f5-d514-498c-9647-00443b005f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:41.365492 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06d6f5-d514-498c-9647-00443b005f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:41.366231 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06d6f5-d514-498c-9647-00443b005f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:41.367904 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b06d6f5-d514-498c-9647-00443b005f9a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:41.380819 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1221/2430] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:41.385276 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240931f-1c59-41b3-a414-7f5c0bb04a9a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:41.396290 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240931f-1c59-41b3-a414-7f5c0bb04a9a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:41.401146 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0becfc4-947b-4fe2-b991-9b393998647f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:41.401812 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0becfc4-947b-4fe2-b991-9b393998647f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:41.402078 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0becfc4-947b-4fe2-b991-9b393998647f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:41.402367 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0becfc4-947b-4fe2-b991-9b393998647f admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:41.403109 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0becfc4-947b-4fe2-b991-9b393998647f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:41.404751 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0becfc4-947b-4fe2-b991-9b393998647f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:41.414898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1210/2431] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:41.419933 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06d6f5-d514-498c-9647-00443b005f9a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:41.430815 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06d6f5-d514-498c-9647-00443b005f9a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:41.436133 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b22d97-c7b4-496c-9c04-a4b2ccfe9f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:41.437021 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b22d97-c7b4-496c-9c04-a4b2ccfe9f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:41.437291 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b22d97-c7b4-496c-9c04-a4b2ccfe9f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:41.437552 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b22d97-c7b4-496c-9c04-a4b2ccfe9f0a admin admin] PATH_INFO: `/v3/projects/bb06e47546dc4b7da8c7cc3ca2eda8c9/users/0c1b7326b86d480f97a1ef2b3e31193f/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:41.451653 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b22d97-c7b4-496c-9c04-a4b2ccfe9f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb06e47546dc4b7da8c7cc3ca2eda8c9, user_id=0c1b7326b86d480f97a1ef2b3e31193f, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:41.454311 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b22d97-c7b4-496c-9c04-a4b2ccfe9f0a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:41.471831 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1222/2432] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:41 2022] PUT /identity/v3/projects/bb06e47546dc4b7da8c7cc3ca2eda8c9/users/0c1b7326b86d480f97a1ef2b3e31193f/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:41.482990 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b0fe3-ddd6-4428-9414-366f14b99b48 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:41.483365 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b0fe3-ddd6-4428-9414-366f14b99b48 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:41.483624 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b0fe3-ddd6-4428-9414-366f14b99b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:41.509728 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-483b0fe3-ddd6-4428-9414-366f14b99b48 None None] MFA Rules not processed for user `0c1b7326b86d480f97a1ef2b3e31193f`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:41.510918 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-483b0fe3-ddd6-4428-9414-366f14b99b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:41.573256 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1211/2433] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:41.578044 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b22d97-c7b4-496c-9c04-a4b2ccfe9f0a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:41.640088 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b22d97-c7b4-496c-9c04-a4b2ccfe9f0a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:41.645106 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d3606-699d-4d1b-9176-f5527150a136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:41.645766 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d3606-699d-4d1b-9176-f5527150a136 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:41.646040 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d3606-699d-4d1b-9176-f5527150a136 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:41.646308 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d3606-699d-4d1b-9176-f5527150a136 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:41.647037 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d3606-699d-4d1b-9176-f5527150a136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:41.648949 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709d3606-699d-4d1b-9176-f5527150a136 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:41.676776 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1223/2434] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:51:41 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:51:41.682300 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b0fe3-ddd6-4428-9414-366f14b99b48 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:41.693867 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b0fe3-ddd6-4428-9414-366f14b99b48 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:41.753227 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8412e7e-9ec7-47a9-a55e-e86562b0d0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:41.753913 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8412e7e-9ec7-47a9-a55e-e86562b0d0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:41.754191 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8412e7e-9ec7-47a9-a55e-e86562b0d0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:41.754464 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8412e7e-9ec7-47a9-a55e-e86562b0d0a3 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:41.755170 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8412e7e-9ec7-47a9-a55e-e86562b0d0a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:41.757140 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8412e7e-9ec7-47a9-a55e-e86562b0d0a3 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:41.780420 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1212/2435] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:51:41 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:51:41.784398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d3606-699d-4d1b-9176-f5527150a136 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:41.794983 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d3606-699d-4d1b-9176-f5527150a136 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:41.800646 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb3957-1914-420d-b6ba-449b2c6507bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:41.801298 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb3957-1914-420d-b6ba-449b2c6507bc admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:41.801574 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb3957-1914-420d-b6ba-449b2c6507bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:41.801842 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb3957-1914-420d-b6ba-449b2c6507bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:41.802576 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb3957-1914-420d-b6ba-449b2c6507bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:41.804246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb3957-1914-420d-b6ba-449b2c6507bc admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:41.815056 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1224/2436] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:51:41.819147 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8412e7e-9ec7-47a9-a55e-e86562b0d0a3 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:41.829498 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8412e7e-9ec7-47a9-a55e-e86562b0d0a3 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:41.835191 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a0460-def1-4604-a09c-4149afb2afd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:41.836101 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a0460-def1-4604-a09c-4149afb2afd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:41.836376 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a0460-def1-4604-a09c-4149afb2afd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:41.836644 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a0460-def1-4604-a09c-4149afb2afd3 admin admin] PATH_INFO: `/v3/projects/80e5e2da3aa4480b8d1bd56496107df2/users/759dbb6a362b4ef5b3f613b18b2759c5/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:41.852908 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a0460-def1-4604-a09c-4149afb2afd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80e5e2da3aa4480b8d1bd56496107df2, user_id=759dbb6a362b4ef5b3f613b18b2759c5, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:41.856064 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a0460-def1-4604-a09c-4149afb2afd3 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:41.871736 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1213/2437] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:41 2022] PUT /identity/v3/projects/80e5e2da3aa4480b8d1bd56496107df2/users/759dbb6a362b4ef5b3f613b18b2759c5/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:41.875737 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb3957-1914-420d-b6ba-449b2c6507bc admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:41.886043 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb3957-1914-420d-b6ba-449b2c6507bc admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:41.946815 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae135b-160f-448a-b770-8e896fc84880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:41.947395 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae135b-160f-448a-b770-8e896fc84880 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:41.947717 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae135b-160f-448a-b770-8e896fc84880 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:41.947987 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae135b-160f-448a-b770-8e896fc84880 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:41.948715 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae135b-160f-448a-b770-8e896fc84880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:41.950677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae135b-160f-448a-b770-8e896fc84880 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:41.960775 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1225/2438] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:51:41.965277 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a0460-def1-4604-a09c-4149afb2afd3 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:41.976280 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a0460-def1-4604-a09c-4149afb2afd3 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:41.981591 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f463c85-844f-485a-bc4c-1b4ceaa50af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:41.982473 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f463c85-844f-485a-bc4c-1b4ceaa50af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:41.982758 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f463c85-844f-485a-bc4c-1b4ceaa50af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:41.983001 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f463c85-844f-485a-bc4c-1b4ceaa50af5 admin admin] PATH_INFO: `/v3/projects/80e5e2da3aa4480b8d1bd56496107df2/users/759dbb6a362b4ef5b3f613b18b2759c5/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:41.985126 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f463c85-844f-485a-bc4c-1b4ceaa50af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80e5e2da3aa4480b8d1bd56496107df2, user_id=759dbb6a362b4ef5b3f613b18b2759c5, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:41.987800 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f463c85-844f-485a-bc4c-1b4ceaa50af5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:41.998631 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1214/2439] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:51:41 2022] PUT /identity/v3/projects/80e5e2da3aa4480b8d1bd56496107df2/users/759dbb6a362b4ef5b3f613b18b2759c5/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:42.008688 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48f997-ce51-4571-acd2-cf0ed3a00662 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:42.008972 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48f997-ce51-4571-acd2-cf0ed3a00662 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:42.009239 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48f997-ce51-4571-acd2-cf0ed3a00662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:42.037640 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-2a48f997-ce51-4571-acd2-cf0ed3a00662 None None] MFA Rules not processed for user `759dbb6a362b4ef5b3f613b18b2759c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:42.038857 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-2a48f997-ce51-4571-acd2-cf0ed3a00662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:42.107158 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1226/2440] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:42.117359 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f463c85-844f-485a-bc4c-1b4ceaa50af5 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:42.119185 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-2f463c85-844f-485a-bc4c-1b4ceaa50af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:42.174187 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f463c85-844f-485a-bc4c-1b4ceaa50af5 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:42.178508 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d3b3d-9a88-4c93-80c6-3605523d0d44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:42.179145 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d3b3d-9a88-4c93-80c6-3605523d0d44 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:42.179418 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d3b3d-9a88-4c93-80c6-3605523d0d44 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:42.179717 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d3b3d-9a88-4c93-80c6-3605523d0d44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:42.242980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d3b3d-9a88-4c93-80c6-3605523d0d44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:42.244397 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d3b3d-9a88-4c93-80c6-3605523d0d44 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:42.253286 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1215/2441] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:51:43.791352 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48f997-ce51-4571-acd2-cf0ed3a00662 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:43.801841 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48f997-ce51-4571-acd2-cf0ed3a00662 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:43.806053 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56dcaba-6d9a-4148-8731-ed47dbddbd3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:43.806706 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dcaba-6d9a-4148-8731-ed47dbddbd3d service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:43.806980 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dcaba-6d9a-4148-8731-ed47dbddbd3d service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:43.807362 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dcaba-6d9a-4148-8731-ed47dbddbd3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:43.867500 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56dcaba-6d9a-4148-8731-ed47dbddbd3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:43.869138 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56dcaba-6d9a-4148-8731-ed47dbddbd3d service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:43.878788 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1227/2442] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:51:44.406777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d3b3d-9a88-4c93-80c6-3605523d0d44 service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:44.415389 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d3b3d-9a88-4c93-80c6-3605523d0d44 service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:44.419881 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b12bc6-5b2d-4885-aa4b-00788d902fa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:44.420545 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b12bc6-5b2d-4885-aa4b-00788d902fa1 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:44.420820 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b12bc6-5b2d-4885-aa4b-00788d902fa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:44.421087 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b12bc6-5b2d-4885-aa4b-00788d902fa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:44.430350 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b12bc6-5b2d-4885-aa4b-00788d902fa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:44.431800 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b12bc6-5b2d-4885-aa4b-00788d902fa1 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:44.441811 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1216/2443] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:51:55.743041 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56dcaba-6d9a-4148-8731-ed47dbddbd3d service cinder] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:55.807715 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56dcaba-6d9a-4148-8731-ed47dbddbd3d service cinder] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:55.813274 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16de91-b4b4-47c6-95dc-ad42a39d8843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:55.814207 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16de91-b4b4-47c6-95dc-ad42a39d8843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:55.814485 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16de91-b4b4-47c6-95dc-ad42a39d8843 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:55.814754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16de91-b4b4-47c6-95dc-ad42a39d8843 admin admin] PATH_INFO: `/v3/users/ec3571c8046843e7a47bc57bcc39ffef` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:55.815988 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16de91-b4b4-47c6-95dc-ad42a39d8843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec3571c8046843e7a47bc57bcc39ffef)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:55.817924 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16de91-b4b4-47c6-95dc-ad42a39d8843 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:55.865002 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0d16de91-b4b4-47c6-95dc-ad42a39d8843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec3571c8046843e7a47bc57bcc39ffef'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:55.872214 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0d16de91-b4b4-47c6-95dc-ad42a39d8843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec3571c8046843e7a47bc57bcc39ffef'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:55.879613 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0d16de91-b4b4-47c6-95dc-ad42a39d8843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec3571c8046843e7a47bc57bcc39ffef'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:55.880205 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0d16de91-b4b4-47c6-95dc-ad42a39d8843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec3571c8046843e7a47bc57bcc39ffef'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:55.880796 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0d16de91-b4b4-47c6-95dc-ad42a39d8843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec3571c8046843e7a47bc57bcc39ffef'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:55.897305 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1228/2444] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:51:55 2022] DELETE /identity/v3/users/ec3571c8046843e7a47bc57bcc39ffef => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:55.902108 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670d6d3-7052-4b4f-8837-e764041d56da None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:55.902618 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670d6d3-7052-4b4f-8837-e764041d56da None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:55.902618 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670d6d3-7052-4b4f-8837-e764041d56da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:55.921376 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-7670d6d3-7052-4b4f-8837-e764041d56da None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:51:55.922697 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-7670d6d3-7052-4b4f-8837-e764041d56da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:56.007383 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1217/2445] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:51:56.017812 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16de91-b4b4-47c6-95dc-ad42a39d8843 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:56.019522 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-0d16de91-b4b4-47c6-95dc-ad42a39d8843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:56.085534 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16de91-b4b4-47c6-95dc-ad42a39d8843 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:56.089954 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931c4f8-818d-40c6-93f1-9f729bc67560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:56.090619 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931c4f8-818d-40c6-93f1-9f729bc67560 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:56.090895 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931c4f8-818d-40c6-93f1-9f729bc67560 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:56.091165 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931c4f8-818d-40c6-93f1-9f729bc67560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:56.101186 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931c4f8-818d-40c6-93f1-9f729bc67560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:56.102630 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931c4f8-818d-40c6-93f1-9f729bc67560 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:56.112334 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1229/2446] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:51:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:51:56.396435 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670d6d3-7052-4b4f-8837-e764041d56da None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:56.398122 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-7670d6d3-7052-4b4f-8837-e764041d56da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:56.411024 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670d6d3-7052-4b4f-8837-e764041d56da None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:56.415989 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd77e9-dcc7-4f2a-a29c-9039d20a29bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:56.416956 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd77e9-dcc7-4f2a-a29c-9039d20a29bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:56.417299 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd77e9-dcc7-4f2a-a29c-9039d20a29bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:56.417644 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd77e9-dcc7-4f2a-a29c-9039d20a29bf admin admin] PATH_INFO: `/v3/projects/5283f1d9c54945f29233de283ac8dc5c` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:56.418930 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd77e9-dcc7-4f2a-a29c-9039d20a29bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5283f1d9c54945f29233de283ac8dc5c)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:56.420958 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd77e9-dcc7-4f2a-a29c-9039d20a29bf admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:56.475858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c1dd77e9-dcc7-4f2a-a29c-9039d20a29bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5283f1d9c54945f29233de283ac8dc5c', 'request_id': 'req-c1dd77e9-dcc7-4f2a-a29c-9039d20a29bf'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:56.487106 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c1dd77e9-dcc7-4f2a-a29c-9039d20a29bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5283f1d9c54945f29233de283ac8dc5c', 'request_id': 'req-c1dd77e9-dcc7-4f2a-a29c-9039d20a29bf'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:56.493661 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c1dd77e9-dcc7-4f2a-a29c-9039d20a29bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5283f1d9c54945f29233de283ac8dc5c', 'request_id': 'req-c1dd77e9-dcc7-4f2a-a29c-9039d20a29bf'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:56.507546 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c1dd77e9-dcc7-4f2a-a29c-9039d20a29bf admin admin] The token cache is being invalidate because project 5283f1d9c54945f29233de283ac8dc5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:51:56.507956 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c1dd77e9-dcc7-4f2a-a29c-9039d20a29bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:56.508732 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c1dd77e9-dcc7-4f2a-a29c-9039d20a29bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:56.510397 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1218/2447] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:51:56 2022] DELETE /identity/v3/projects/5283f1d9c54945f29233de283ac8dc5c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:56.515455 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931c4f8-818d-40c6-93f1-9f729bc67560 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:56.526945 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931c4f8-818d-40c6-93f1-9f729bc67560 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:56.586358 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2fe50-73e2-43f5-8169-46ef56314420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:56.587243 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2fe50-73e2-43f5-8169-46ef56314420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:56.587542 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2fe50-73e2-43f5-8169-46ef56314420 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:56.587850 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2fe50-73e2-43f5-8169-46ef56314420 admin admin] PATH_INFO: `/v3/users/0c1b7326b86d480f97a1ef2b3e31193f` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:56.589108 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2fe50-73e2-43f5-8169-46ef56314420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c1b7326b86d480f97a1ef2b3e31193f)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:56.591063 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2fe50-73e2-43f5-8169-46ef56314420 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:56.638675 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-37f2fe50-73e2-43f5-8169-46ef56314420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c1b7326b86d480f97a1ef2b3e31193f'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:56.645228 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-37f2fe50-73e2-43f5-8169-46ef56314420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c1b7326b86d480f97a1ef2b3e31193f'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:56.653102 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-37f2fe50-73e2-43f5-8169-46ef56314420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c1b7326b86d480f97a1ef2b3e31193f'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:56.653737 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-37f2fe50-73e2-43f5-8169-46ef56314420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c1b7326b86d480f97a1ef2b3e31193f'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:56.654336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-37f2fe50-73e2-43f5-8169-46ef56314420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c1b7326b86d480f97a1ef2b3e31193f'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:56.673706 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1230/2448] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:51:56 2022] DELETE /identity/v3/users/0c1b7326b86d480f97a1ef2b3e31193f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:57.071145 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd77e9-dcc7-4f2a-a29c-9039d20a29bf admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:57.073117 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-c1dd77e9-dcc7-4f2a-a29c-9039d20a29bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:57.109536 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd77e9-dcc7-4f2a-a29c-9039d20a29bf admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:57.171040 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60384b2-ae40-46a8-9123-dba53b760610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:57.171951 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60384b2-ae40-46a8-9123-dba53b760610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:57.172228 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60384b2-ae40-46a8-9123-dba53b760610 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:57.175630 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60384b2-ae40-46a8-9123-dba53b760610 admin admin] PATH_INFO: `/v3/projects/bb06e47546dc4b7da8c7cc3ca2eda8c9` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:57.177072 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60384b2-ae40-46a8-9123-dba53b760610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb06e47546dc4b7da8c7cc3ca2eda8c9)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:57.179090 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60384b2-ae40-46a8-9123-dba53b760610 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:57.237186 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c60384b2-ae40-46a8-9123-dba53b760610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb06e47546dc4b7da8c7cc3ca2eda8c9', 'request_id': 'req-c60384b2-ae40-46a8-9123-dba53b760610'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:57.245258 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c60384b2-ae40-46a8-9123-dba53b760610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb06e47546dc4b7da8c7cc3ca2eda8c9', 'request_id': 'req-c60384b2-ae40-46a8-9123-dba53b760610'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:57.251259 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c60384b2-ae40-46a8-9123-dba53b760610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb06e47546dc4b7da8c7cc3ca2eda8c9', 'request_id': 'req-c60384b2-ae40-46a8-9123-dba53b760610'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:57.265170 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c60384b2-ae40-46a8-9123-dba53b760610 admin admin] The token cache is being invalidate because project bb06e47546dc4b7da8c7cc3ca2eda8c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:51:57.265652 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c60384b2-ae40-46a8-9123-dba53b760610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:57.266844 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c60384b2-ae40-46a8-9123-dba53b760610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:57.268784 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1219/2449] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:51:57 2022] DELETE /identity/v3/projects/bb06e47546dc4b7da8c7cc3ca2eda8c9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:57.272483 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2fe50-73e2-43f5-8169-46ef56314420 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:57.273956 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-37f2fe50-73e2-43f5-8169-46ef56314420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:57.286964 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2fe50-73e2-43f5-8169-46ef56314420 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:57.370635 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e369a-b08f-4eea-996c-a08c962a8c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:57.372148 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e369a-b08f-4eea-996c-a08c962a8c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:57.372502 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e369a-b08f-4eea-996c-a08c962a8c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:57.372843 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e369a-b08f-4eea-996c-a08c962a8c05 admin admin] PATH_INFO: `/v3/users/759dbb6a362b4ef5b3f613b18b2759c5` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:57.374502 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e369a-b08f-4eea-996c-a08c962a8c05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=759dbb6a362b4ef5b3f613b18b2759c5)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:57.376636 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e369a-b08f-4eea-996c-a08c962a8c05 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:57.449458 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0d0e369a-b08f-4eea-996c-a08c962a8c05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '759dbb6a362b4ef5b3f613b18b2759c5'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:57.457712 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0d0e369a-b08f-4eea-996c-a08c962a8c05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '759dbb6a362b4ef5b3f613b18b2759c5'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:57.469761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0d0e369a-b08f-4eea-996c-a08c962a8c05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '759dbb6a362b4ef5b3f613b18b2759c5'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:57.471250 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0d0e369a-b08f-4eea-996c-a08c962a8c05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '759dbb6a362b4ef5b3f613b18b2759c5'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:57.472447 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0d0e369a-b08f-4eea-996c-a08c962a8c05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '759dbb6a362b4ef5b3f613b18b2759c5'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:57.498043 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1231/2450] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:51:57 2022] DELETE /identity/v3/users/759dbb6a362b4ef5b3f613b18b2759c5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:51:57.780155 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60384b2-ae40-46a8-9123-dba53b760610 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:51:57.781611 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-c60384b2-ae40-46a8-9123-dba53b760610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:51:57.795033 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60384b2-ae40-46a8-9123-dba53b760610 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:51:57.860792 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f2b80-6fc2-42ab-be79-733bda9474e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:51:57.861681 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f2b80-6fc2-42ab-be79-733bda9474e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:51:57.862004 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f2b80-6fc2-42ab-be79-733bda9474e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:51:57.862238 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f2b80-6fc2-42ab-be79-733bda9474e1 admin admin] PATH_INFO: `/v3/projects/80e5e2da3aa4480b8d1bd56496107df2` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:51:57.864136 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f2b80-6fc2-42ab-be79-733bda9474e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80e5e2da3aa4480b8d1bd56496107df2)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:51:57.866402 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f2b80-6fc2-42ab-be79-733bda9474e1 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:51:57.921151 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-351f2b80-6fc2-42ab-be79-733bda9474e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80e5e2da3aa4480b8d1bd56496107df2', 'request_id': 'req-351f2b80-6fc2-42ab-be79-733bda9474e1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:57.932726 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-351f2b80-6fc2-42ab-be79-733bda9474e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80e5e2da3aa4480b8d1bd56496107df2', 'request_id': 'req-351f2b80-6fc2-42ab-be79-733bda9474e1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:57.941273 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-351f2b80-6fc2-42ab-be79-733bda9474e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80e5e2da3aa4480b8d1bd56496107df2', 'request_id': 'req-351f2b80-6fc2-42ab-be79-733bda9474e1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:57.956662 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-351f2b80-6fc2-42ab-be79-733bda9474e1 admin admin] The token cache is being invalidate because project 80e5e2da3aa4480b8d1bd56496107df2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:51:57.957577 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-351f2b80-6fc2-42ab-be79-733bda9474e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:57.958543 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-351f2b80-6fc2-42ab-be79-733bda9474e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:51:57.961340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1220/2451] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:51:57 2022] DELETE /identity/v3/projects/80e5e2da3aa4480b8d1bd56496107df2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:00.767256 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5769a5-5b75-4c01-b1ec-82362d7d40b3 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:00.767813 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5769a5-5b75-4c01-b1ec-82362d7d40b3 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:00.767813 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5769a5-5b75-4c01-b1ec-82362d7d40b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:00.785823 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-1c5769a5-5b75-4c01-b1ec-82362d7d40b3 None None] MFA Rules not processed for user `8c5ac449d0494ab585c0aeccb9541016`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:00.787043 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-1c5769a5-5b75-4c01-b1ec-82362d7d40b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:00.851865 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1232/2452] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:27.328669 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f2b80-6fc2-42ab-be79-733bda9474e1 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:27.330193 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-351f2b80-6fc2-42ab-be79-733bda9474e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:27.406172 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f2b80-6fc2-42ab-be79-733bda9474e1 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:27.411342 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7c666-d96b-4043-a6a1-8814ad618faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:27.412293 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7c666-d96b-4043-a6a1-8814ad618faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:27.412750 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7c666-d96b-4043-a6a1-8814ad618faf admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:27.412750 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7c666-d96b-4043-a6a1-8814ad618faf admin admin] PATH_INFO: `/v3/users/33ef103b35e2455fbd2e489caf27ec45` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:27.414005 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7c666-d96b-4043-a6a1-8814ad618faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ef103b35e2455fbd2e489caf27ec45)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:27.415989 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7c666-d96b-4043-a6a1-8814ad618faf admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:27.470122 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-88a7c666-d96b-4043-a6a1-8814ad618faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ef103b35e2455fbd2e489caf27ec45'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:27.470789 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-88a7c666-d96b-4043-a6a1-8814ad618faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ef103b35e2455fbd2e489caf27ec45'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:27.471410 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-88a7c666-d96b-4043-a6a1-8814ad618faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ef103b35e2455fbd2e489caf27ec45'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:27.483558 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-88a7c666-d96b-4043-a6a1-8814ad618faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ef103b35e2455fbd2e489caf27ec45'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:27.491780 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-88a7c666-d96b-4043-a6a1-8814ad618faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ef103b35e2455fbd2e489caf27ec45'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:27.507617 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1221/2453] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:52:27 2022] DELETE /identity/v3/users/33ef103b35e2455fbd2e489caf27ec45 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:27.512241 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815420-0066-4ee9-988f-caad833ae07a None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:27.512745 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815420-0066-4ee9-988f-caad833ae07a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:27.512854 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815420-0066-4ee9-988f-caad833ae07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:27.530456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-6d815420-0066-4ee9-988f-caad833ae07a None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:27.531682 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-6d815420-0066-4ee9-988f-caad833ae07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:27.601504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1233/2454] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:27.611332 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7c666-d96b-4043-a6a1-8814ad618faf admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:27.612794 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-88a7c666-d96b-4043-a6a1-8814ad618faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:27.675615 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7c666-d96b-4043-a6a1-8814ad618faf admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:27.679505 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43526d5d-4f92-4a57-8302-2aa72294882c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:27.688457 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43526d5d-4f92-4a57-8302-2aa72294882c service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:27.688457 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43526d5d-4f92-4a57-8302-2aa72294882c service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:27.688457 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43526d5d-4f92-4a57-8302-2aa72294882c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:27.690198 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43526d5d-4f92-4a57-8302-2aa72294882c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:27.691646 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43526d5d-4f92-4a57-8302-2aa72294882c service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:27.700954 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1222/2455] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:52:27.971770 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d815420-0066-4ee9-988f-caad833ae07a None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:27.973316 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-6d815420-0066-4ee9-988f-caad833ae07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:27.985731 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d815420-0066-4ee9-988f-caad833ae07a None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:27.990912 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be730e-adae-490d-a50d-9d948fc01a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:27.991817 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be730e-adae-490d-a50d-9d948fc01a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:27.992089 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be730e-adae-490d-a50d-9d948fc01a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:27.992357 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be730e-adae-490d-a50d-9d948fc01a84 admin admin] PATH_INFO: `/v3/projects/5ec62cbe827a42fbb57e5722bb53524f` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:27.993601 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be730e-adae-490d-a50d-9d948fc01a84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec62cbe827a42fbb57e5722bb53524f)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:27.995546 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be730e-adae-490d-a50d-9d948fc01a84 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:28.043086 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-27be730e-adae-490d-a50d-9d948fc01a84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec62cbe827a42fbb57e5722bb53524f', 'request_id': 'req-27be730e-adae-490d-a50d-9d948fc01a84'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:28.049149 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-27be730e-adae-490d-a50d-9d948fc01a84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec62cbe827a42fbb57e5722bb53524f', 'request_id': 'req-27be730e-adae-490d-a50d-9d948fc01a84'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:28.059117 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-27be730e-adae-490d-a50d-9d948fc01a84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec62cbe827a42fbb57e5722bb53524f', 'request_id': 'req-27be730e-adae-490d-a50d-9d948fc01a84'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:28.070545 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-27be730e-adae-490d-a50d-9d948fc01a84 admin admin] The token cache is being invalidate because project 5ec62cbe827a42fbb57e5722bb53524f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:52:28.070830 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-27be730e-adae-490d-a50d-9d948fc01a84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:28.071609 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-27be730e-adae-490d-a50d-9d948fc01a84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:28.073269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1234/2456] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:52:27 2022] DELETE /identity/v3/projects/5ec62cbe827a42fbb57e5722bb53524f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:28.077495 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43526d5d-4f92-4a57-8302-2aa72294882c service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:28.087367 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43526d5d-4f92-4a57-8302-2aa72294882c service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:28.147192 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e52bde-a508-4fa5-96de-be657eafaa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:28.148110 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e52bde-a508-4fa5-96de-be657eafaa4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:28.148385 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e52bde-a508-4fa5-96de-be657eafaa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:28.148656 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e52bde-a508-4fa5-96de-be657eafaa4b admin admin] PATH_INFO: `/v3/users/2d97f00c6f2743fb8ed186dd1c66c183` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:28.149983 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e52bde-a508-4fa5-96de-be657eafaa4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d97f00c6f2743fb8ed186dd1c66c183)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:28.151955 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e52bde-a508-4fa5-96de-be657eafaa4b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:28.200289 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c3e52bde-a508-4fa5-96de-be657eafaa4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d97f00c6f2743fb8ed186dd1c66c183'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:28.200920 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c3e52bde-a508-4fa5-96de-be657eafaa4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d97f00c6f2743fb8ed186dd1c66c183'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:28.201506 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c3e52bde-a508-4fa5-96de-be657eafaa4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d97f00c6f2743fb8ed186dd1c66c183'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:28.214045 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c3e52bde-a508-4fa5-96de-be657eafaa4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d97f00c6f2743fb8ed186dd1c66c183'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:28.224602 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-c3e52bde-a508-4fa5-96de-be657eafaa4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d97f00c6f2743fb8ed186dd1c66c183'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:28.239481 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1223/2457] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:52:28 2022] DELETE /identity/v3/users/2d97f00c6f2743fb8ed186dd1c66c183 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:28.530753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be730e-adae-490d-a50d-9d948fc01a84 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:28.532248 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-27be730e-adae-490d-a50d-9d948fc01a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:28.546965 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be730e-adae-490d-a50d-9d948fc01a84 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:28.609189 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d88fc-dfbe-4981-9ea0-0cd1b025ebdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:28.610063 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d88fc-dfbe-4981-9ea0-0cd1b025ebdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:28.610343 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d88fc-dfbe-4981-9ea0-0cd1b025ebdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:28.610611 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d88fc-dfbe-4981-9ea0-0cd1b025ebdf admin admin] PATH_INFO: `/v3/projects/1d042f4a2eed474dbbdac8098f09f060` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:28.611867 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d88fc-dfbe-4981-9ea0-0cd1b025ebdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d042f4a2eed474dbbdac8098f09f060)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:28.613775 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d88fc-dfbe-4981-9ea0-0cd1b025ebdf admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:28.663320 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fd0d88fc-dfbe-4981-9ea0-0cd1b025ebdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d042f4a2eed474dbbdac8098f09f060', 'request_id': 'req-fd0d88fc-dfbe-4981-9ea0-0cd1b025ebdf'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:28.670166 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fd0d88fc-dfbe-4981-9ea0-0cd1b025ebdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d042f4a2eed474dbbdac8098f09f060', 'request_id': 'req-fd0d88fc-dfbe-4981-9ea0-0cd1b025ebdf'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:28.678593 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fd0d88fc-dfbe-4981-9ea0-0cd1b025ebdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d042f4a2eed474dbbdac8098f09f060', 'request_id': 'req-fd0d88fc-dfbe-4981-9ea0-0cd1b025ebdf'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:28.689355 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fd0d88fc-dfbe-4981-9ea0-0cd1b025ebdf admin admin] The token cache is being invalidate because project 1d042f4a2eed474dbbdac8098f09f060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:52:28.689647 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fd0d88fc-dfbe-4981-9ea0-0cd1b025ebdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:28.690403 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fd0d88fc-dfbe-4981-9ea0-0cd1b025ebdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:28.691990 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1235/2458] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:52:28 2022] DELETE /identity/v3/projects/1d042f4a2eed474dbbdac8098f09f060 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:28.697806 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad47647-76f4-475c-b591-4fafb0f4074c None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:28.698223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad47647-76f4-475c-b591-4fafb0f4074c None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:28.698377 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad47647-76f4-475c-b591-4fafb0f4074c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:28.716809 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-2ad47647-76f4-475c-b591-4fafb0f4074c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:28.717995 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-2ad47647-76f4-475c-b591-4fafb0f4074c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:28.784871 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1224/2459] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:28.793845 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12f3aa-5c27-437d-99c5-4148d620464d None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:28.794134 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12f3aa-5c27-437d-99c5-4148d620464d None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:28.794403 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12f3aa-5c27-437d-99c5-4148d620464d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:28.814307 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-4b12f3aa-5c27-437d-99c5-4148d620464d None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:28.815435 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-4b12f3aa-5c27-437d-99c5-4148d620464d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:28.824334 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1236/2460] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:28.828953 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad47647-76f4-475c-b591-4fafb0f4074c None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:28.838982 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad47647-76f4-475c-b591-4fafb0f4074c None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:28.843547 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73474b5-b745-4cd0-bad7-2feab96bd6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:28.844220 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73474b5-b745-4cd0-bad7-2feab96bd6ad admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:28.844498 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73474b5-b745-4cd0-bad7-2feab96bd6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:28.844762 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73474b5-b745-4cd0-bad7-2feab96bd6ad admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:28.845519 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73474b5-b745-4cd0-bad7-2feab96bd6ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:52:28.845795 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73474b5-b745-4cd0-bad7-2feab96bd6ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:28.847741 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73474b5-b745-4cd0-bad7-2feab96bd6ad admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:28.859764 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1225/2461] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:52:28.864420 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12f3aa-5c27-437d-99c5-4148d620464d None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:28.875178 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12f3aa-5c27-437d-99c5-4148d620464d None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:28.880332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc380b-acdf-4d19-9c39-ee994dbc0225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:28.880979 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc380b-acdf-4d19-9c39-ee994dbc0225 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:28.881311 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc380b-acdf-4d19-9c39-ee994dbc0225 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:28.881587 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc380b-acdf-4d19-9c39-ee994dbc0225 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:28.882869 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc380b-acdf-4d19-9c39-ee994dbc0225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:28.884804 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc380b-acdf-4d19-9c39-ee994dbc0225 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:28.912273 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1237/2462] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:52:28 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:52:28.916903 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73474b5-b745-4cd0-bad7-2feab96bd6ad admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:28.927914 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73474b5-b745-4cd0-bad7-2feab96bd6ad admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:28.987895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcb6da-3c2b-41c1-869a-1b9a8a0b84d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:28.988572 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcb6da-3c2b-41c1-869a-1b9a8a0b84d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:28.988852 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcb6da-3c2b-41c1-869a-1b9a8a0b84d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:28.989120 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcb6da-3c2b-41c1-869a-1b9a8a0b84d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:28.989830 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbcb6da-3c2b-41c1-869a-1b9a8a0b84d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:28.992054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbcb6da-3c2b-41c1-869a-1b9a8a0b84d2 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:29.012378 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1226/2463] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:52:28 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:52:29.016680 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc380b-acdf-4d19-9c39-ee994dbc0225 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:29.028937 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc380b-acdf-4d19-9c39-ee994dbc0225 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:29.033891 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd517187-47b4-474b-92ea-3c9273b84979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:29.034547 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd517187-47b4-474b-92ea-3c9273b84979 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:29.034823 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd517187-47b4-474b-92ea-3c9273b84979 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:29.035091 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd517187-47b4-474b-92ea-3c9273b84979 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:29.035868 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd517187-47b4-474b-92ea-3c9273b84979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:29.037469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd517187-47b4-474b-92ea-3c9273b84979 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:29.048303 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1238/2464] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:52:29.052312 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcb6da-3c2b-41c1-869a-1b9a8a0b84d2 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:29.063659 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcb6da-3c2b-41c1-869a-1b9a8a0b84d2 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:29.069138 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdb604-514e-4b9d-a4fa-5ef9b4d4b5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:29.069830 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdb604-514e-4b9d-a4fa-5ef9b4d4b5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:29.070130 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdb604-514e-4b9d-a4fa-5ef9b4d4b5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:29.070401 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdb604-514e-4b9d-a4fa-5ef9b4d4b5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:29.071152 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdb604-514e-4b9d-a4fa-5ef9b4d4b5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:29.072778 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdb604-514e-4b9d-a4fa-5ef9b4d4b5e2 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:29.083108 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1227/2465] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:52:29.087415 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd517187-47b4-474b-92ea-3c9273b84979 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:29.097889 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd517187-47b4-474b-92ea-3c9273b84979 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:29.103724 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d31eec-f551-4e9b-9d59-9cc64f31c0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:29.104635 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d31eec-f551-4e9b-9d59-9cc64f31c0eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:29.104903 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d31eec-f551-4e9b-9d59-9cc64f31c0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:29.105170 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d31eec-f551-4e9b-9d59-9cc64f31c0eb admin admin] PATH_INFO: `/v3/projects/66ba5dc31c03401e84a1c71bc2da9e9d/users/b63bc763414e467980250d8ffb1efc36/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:29.121201 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d31eec-f551-4e9b-9d59-9cc64f31c0eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ba5dc31c03401e84a1c71bc2da9e9d, user_id=b63bc763414e467980250d8ffb1efc36, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:29.124003 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d31eec-f551-4e9b-9d59-9cc64f31c0eb admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:29.137418 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1239/2466] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:52:29 2022] PUT /identity/v3/projects/66ba5dc31c03401e84a1c71bc2da9e9d/users/b63bc763414e467980250d8ffb1efc36/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:52:29.148161 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe7b06-73a2-4f2f-a3e2-d5edb60fa0f0 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:29.148346 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe7b06-73a2-4f2f-a3e2-d5edb60fa0f0 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:29.148466 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe7b06-73a2-4f2f-a3e2-d5edb60fa0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:29.176172 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-0afe7b06-73a2-4f2f-a3e2-d5edb60fa0f0 None None] MFA Rules not processed for user `b63bc763414e467980250d8ffb1efc36`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:29.177382 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-0afe7b06-73a2-4f2f-a3e2-d5edb60fa0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:29.245692 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1228/2467] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:29.250882 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d31eec-f551-4e9b-9d59-9cc64f31c0eb admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:29.323624 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d31eec-f551-4e9b-9d59-9cc64f31c0eb admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:29.329456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78402f-14db-4d19-bd6e-8217ec8d9c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:29.330117 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78402f-14db-4d19-bd6e-8217ec8d9c85 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:29.330404 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78402f-14db-4d19-bd6e-8217ec8d9c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:29.330670 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78402f-14db-4d19-bd6e-8217ec8d9c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:29.331404 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78402f-14db-4d19-bd6e-8217ec8d9c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:29.333329 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78402f-14db-4d19-bd6e-8217ec8d9c85 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:29.364566 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1240/2468] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:52:29 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:52:29.369208 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe7b06-73a2-4f2f-a3e2-d5edb60fa0f0 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:29.380292 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe7b06-73a2-4f2f-a3e2-d5edb60fa0f0 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:29.440975 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aac5f8-52eb-4e1b-b2ca-6c4dd27897d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:29.441652 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aac5f8-52eb-4e1b-b2ca-6c4dd27897d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:29.441935 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aac5f8-52eb-4e1b-b2ca-6c4dd27897d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:29.442207 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aac5f8-52eb-4e1b-b2ca-6c4dd27897d5 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:29.442944 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aac5f8-52eb-4e1b-b2ca-6c4dd27897d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:29.445045 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aac5f8-52eb-4e1b-b2ca-6c4dd27897d5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:29.466662 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1229/2469] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:52:29 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:52:29.470707 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78402f-14db-4d19-bd6e-8217ec8d9c85 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:29.481624 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78402f-14db-4d19-bd6e-8217ec8d9c85 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:29.486699 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314935ef-1c14-4bf8-9ad4-280c464c635b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:29.487365 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314935ef-1c14-4bf8-9ad4-280c464c635b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:29.487692 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314935ef-1c14-4bf8-9ad4-280c464c635b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:29.488101 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314935ef-1c14-4bf8-9ad4-280c464c635b admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:29.488890 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314935ef-1c14-4bf8-9ad4-280c464c635b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:29.490494 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314935ef-1c14-4bf8-9ad4-280c464c635b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:29.500835 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1241/2470] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:52:29.505107 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aac5f8-52eb-4e1b-b2ca-6c4dd27897d5 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:29.515425 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aac5f8-52eb-4e1b-b2ca-6c4dd27897d5 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:29.520458 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17817200-9714-4825-a399-e8a10d8960b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:29.521342 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17817200-9714-4825-a399-e8a10d8960b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:29.521621 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17817200-9714-4825-a399-e8a10d8960b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:29.521894 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17817200-9714-4825-a399-e8a10d8960b5 admin admin] PATH_INFO: `/v3/projects/5d27e14e04d5420ebad37b94053f3010/users/096742fdb8c147e7ac74f074626fc92b/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:29.537198 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17817200-9714-4825-a399-e8a10d8960b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d27e14e04d5420ebad37b94053f3010, user_id=096742fdb8c147e7ac74f074626fc92b, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:29.539949 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17817200-9714-4825-a399-e8a10d8960b5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:29.558278 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1230/2471] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:52:29 2022] PUT /identity/v3/projects/5d27e14e04d5420ebad37b94053f3010/users/096742fdb8c147e7ac74f074626fc92b/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:29.562872 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314935ef-1c14-4bf8-9ad4-280c464c635b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:29.573435 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314935ef-1c14-4bf8-9ad4-280c464c635b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:29.635393 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e43923-7b76-447d-9c4f-3161f521f01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:29.635615 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e43923-7b76-447d-9c4f-3161f521f01f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:29.635863 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e43923-7b76-447d-9c4f-3161f521f01f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:29.636129 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e43923-7b76-447d-9c4f-3161f521f01f admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:29.636891 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e43923-7b76-447d-9c4f-3161f521f01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:29.638584 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e43923-7b76-447d-9c4f-3161f521f01f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:29.649784 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1242/2472] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:52:29.654419 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17817200-9714-4825-a399-e8a10d8960b5 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:29.665338 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17817200-9714-4825-a399-e8a10d8960b5 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:29.670956 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ce9a5-2bb8-41ff-9b4c-9e0f4c2b29e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:29.671915 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ce9a5-2bb8-41ff-9b4c-9e0f4c2b29e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:29.672189 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ce9a5-2bb8-41ff-9b4c-9e0f4c2b29e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:29.672455 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ce9a5-2bb8-41ff-9b4c-9e0f4c2b29e1 admin admin] PATH_INFO: `/v3/projects/5d27e14e04d5420ebad37b94053f3010/users/096742fdb8c147e7ac74f074626fc92b/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:29.674635 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ce9a5-2bb8-41ff-9b4c-9e0f4c2b29e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d27e14e04d5420ebad37b94053f3010, user_id=096742fdb8c147e7ac74f074626fc92b, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:29.677340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ce9a5-2bb8-41ff-9b4c-9e0f4c2b29e1 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:29.688803 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1231/2473] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:52:29 2022] PUT /identity/v3/projects/5d27e14e04d5420ebad37b94053f3010/users/096742fdb8c147e7ac74f074626fc92b/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:29.703584 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b669fef-e157-41e0-aa59-f9e4fe913280 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:29.703906 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b669fef-e157-41e0-aa59-f9e4fe913280 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:29.704265 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b669fef-e157-41e0-aa59-f9e4fe913280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:29.733476 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-9b669fef-e157-41e0-aa59-f9e4fe913280 None None] MFA Rules not processed for user `096742fdb8c147e7ac74f074626fc92b`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:29.734672 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-9b669fef-e157-41e0-aa59-f9e4fe913280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:29.815346 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1243/2474] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:29.822613 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ce9a5-2bb8-41ff-9b4c-9e0f4c2b29e1 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:29.824559 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-bd5ce9a5-2bb8-41ff-9b4c-9e0f4c2b29e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:29.885275 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ce9a5-2bb8-41ff-9b4c-9e0f4c2b29e1 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:29.889355 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba192f-30bf-4c16-8cc7-c4429047f213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:29.890014 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba192f-30bf-4c16-8cc7-c4429047f213 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:29.890296 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba192f-30bf-4c16-8cc7-c4429047f213 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:29.890566 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba192f-30bf-4c16-8cc7-c4429047f213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:29.900586 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba192f-30bf-4c16-8cc7-c4429047f213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:29.902015 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba192f-30bf-4c16-8cc7-c4429047f213 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:29.912475 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1232/2475] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:52:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:52:30.036985 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b669fef-e157-41e0-aa59-f9e4fe913280 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:30.100639 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b669fef-e157-41e0-aa59-f9e4fe913280 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:30.105920 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080629cc-3649-40d4-913b-41bdc8a6962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:30.106876 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080629cc-3649-40d4-913b-41bdc8a6962f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:30.107332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080629cc-3649-40d4-913b-41bdc8a6962f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:30.107708 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080629cc-3649-40d4-913b-41bdc8a6962f admin admin] PATH_INFO: `/v3/users/b63bc763414e467980250d8ffb1efc36` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:30.109024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080629cc-3649-40d4-913b-41bdc8a6962f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b63bc763414e467980250d8ffb1efc36)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:30.110990 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080629cc-3649-40d4-913b-41bdc8a6962f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:30.159457 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-080629cc-3649-40d4-913b-41bdc8a6962f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b63bc763414e467980250d8ffb1efc36'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:30.167552 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-080629cc-3649-40d4-913b-41bdc8a6962f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b63bc763414e467980250d8ffb1efc36'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:30.175787 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-080629cc-3649-40d4-913b-41bdc8a6962f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b63bc763414e467980250d8ffb1efc36'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:30.176413 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-080629cc-3649-40d4-913b-41bdc8a6962f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b63bc763414e467980250d8ffb1efc36'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:30.177148 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-080629cc-3649-40d4-913b-41bdc8a6962f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b63bc763414e467980250d8ffb1efc36'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:30.194122 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1244/2476] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:52:30 2022] DELETE /identity/v3/users/b63bc763414e467980250d8ffb1efc36 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:30.198826 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc09234-0f45-4f71-bb51-5181dd43f31b None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:30.199110 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc09234-0f45-4f71-bb51-5181dd43f31b None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:30.199382 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc09234-0f45-4f71-bb51-5181dd43f31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:30.217658 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-cbc09234-0f45-4f71-bb51-5181dd43f31b None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:30.218858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-cbc09234-0f45-4f71-bb51-5181dd43f31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:30.291344 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1233/2477] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:30.301939 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080629cc-3649-40d4-913b-41bdc8a6962f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:30.304063 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-080629cc-3649-40d4-913b-41bdc8a6962f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:30.375141 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080629cc-3649-40d4-913b-41bdc8a6962f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:30.379877 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cff0e-6b27-4f77-963d-9524a9f1a149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:30.380523 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cff0e-6b27-4f77-963d-9524a9f1a149 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:30.380800 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cff0e-6b27-4f77-963d-9524a9f1a149 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:30.381064 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cff0e-6b27-4f77-963d-9524a9f1a149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:30.391000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cff0e-6b27-4f77-963d-9524a9f1a149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:30.392466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cff0e-6b27-4f77-963d-9524a9f1a149 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:30.402320 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1245/2478] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:52:30.677624 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc09234-0f45-4f71-bb51-5181dd43f31b None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:30.679392 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-cbc09234-0f45-4f71-bb51-5181dd43f31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:30.694913 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc09234-0f45-4f71-bb51-5181dd43f31b None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:30.707839 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe49b1f-5e5e-4ddc-878b-e611688dadd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:30.708722 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe49b1f-5e5e-4ddc-878b-e611688dadd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:30.708997 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe49b1f-5e5e-4ddc-878b-e611688dadd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:30.709265 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe49b1f-5e5e-4ddc-878b-e611688dadd7 admin admin] PATH_INFO: `/v3/projects/66ba5dc31c03401e84a1c71bc2da9e9d` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:30.710576 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe49b1f-5e5e-4ddc-878b-e611688dadd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ba5dc31c03401e84a1c71bc2da9e9d)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:30.712544 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe49b1f-5e5e-4ddc-878b-e611688dadd7 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:30.761523 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bfe49b1f-5e5e-4ddc-878b-e611688dadd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ba5dc31c03401e84a1c71bc2da9e9d', 'request_id': 'req-bfe49b1f-5e5e-4ddc-878b-e611688dadd7'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:30.769078 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bfe49b1f-5e5e-4ddc-878b-e611688dadd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ba5dc31c03401e84a1c71bc2da9e9d', 'request_id': 'req-bfe49b1f-5e5e-4ddc-878b-e611688dadd7'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:30.774635 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bfe49b1f-5e5e-4ddc-878b-e611688dadd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ba5dc31c03401e84a1c71bc2da9e9d', 'request_id': 'req-bfe49b1f-5e5e-4ddc-878b-e611688dadd7'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:30.785229 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bfe49b1f-5e5e-4ddc-878b-e611688dadd7 admin admin] The token cache is being invalidate because project 66ba5dc31c03401e84a1c71bc2da9e9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:52:30.785508 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bfe49b1f-5e5e-4ddc-878b-e611688dadd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:30.786160 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-bfe49b1f-5e5e-4ddc-878b-e611688dadd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:30.787815 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1234/2479] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:52:30 2022] DELETE /identity/v3/projects/66ba5dc31c03401e84a1c71bc2da9e9d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:30.792255 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cff0e-6b27-4f77-963d-9524a9f1a149 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:30.801816 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cff0e-6b27-4f77-963d-9524a9f1a149 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:30.860087 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260223cd-5625-4499-8f26-a12b83f1e22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:30.861443 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260223cd-5625-4499-8f26-a12b83f1e22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:30.861697 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260223cd-5625-4499-8f26-a12b83f1e22b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:30.862051 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260223cd-5625-4499-8f26-a12b83f1e22b admin admin] PATH_INFO: `/v3/users/096742fdb8c147e7ac74f074626fc92b` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:30.863924 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260223cd-5625-4499-8f26-a12b83f1e22b admin admin] RBAC: Authorizing `identity:delete_user(user_id=096742fdb8c147e7ac74f074626fc92b)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:30.867438 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260223cd-5625-4499-8f26-a12b83f1e22b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:30.914992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-260223cd-5625-4499-8f26-a12b83f1e22b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '096742fdb8c147e7ac74f074626fc92b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:30.921514 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-260223cd-5625-4499-8f26-a12b83f1e22b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '096742fdb8c147e7ac74f074626fc92b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:30.929135 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-260223cd-5625-4499-8f26-a12b83f1e22b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '096742fdb8c147e7ac74f074626fc92b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:30.930110 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-260223cd-5625-4499-8f26-a12b83f1e22b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '096742fdb8c147e7ac74f074626fc92b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:30.930723 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-260223cd-5625-4499-8f26-a12b83f1e22b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '096742fdb8c147e7ac74f074626fc92b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:30.948003 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1246/2480] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:52:30 2022] DELETE /identity/v3/users/096742fdb8c147e7ac74f074626fc92b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:31.224126 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe49b1f-5e5e-4ddc-878b-e611688dadd7 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:31.225782 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-bfe49b1f-5e5e-4ddc-878b-e611688dadd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:31.238809 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe49b1f-5e5e-4ddc-878b-e611688dadd7 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:31.299047 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5237e-7925-46e1-ad91-fc59f49db4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:31.299948 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5237e-7925-46e1-ad91-fc59f49db4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:31.300222 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5237e-7925-46e1-ad91-fc59f49db4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:31.300488 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5237e-7925-46e1-ad91-fc59f49db4c8 admin admin] PATH_INFO: `/v3/projects/5d27e14e04d5420ebad37b94053f3010` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:31.301677 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5237e-7925-46e1-ad91-fc59f49db4c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d27e14e04d5420ebad37b94053f3010)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:31.303630 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5237e-7925-46e1-ad91-fc59f49db4c8 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:31.356107 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-55f5237e-7925-46e1-ad91-fc59f49db4c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d27e14e04d5420ebad37b94053f3010', 'request_id': 'req-55f5237e-7925-46e1-ad91-fc59f49db4c8'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:31.365077 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-55f5237e-7925-46e1-ad91-fc59f49db4c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d27e14e04d5420ebad37b94053f3010', 'request_id': 'req-55f5237e-7925-46e1-ad91-fc59f49db4c8'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:31.370656 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-55f5237e-7925-46e1-ad91-fc59f49db4c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d27e14e04d5420ebad37b94053f3010', 'request_id': 'req-55f5237e-7925-46e1-ad91-fc59f49db4c8'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:31.384440 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-55f5237e-7925-46e1-ad91-fc59f49db4c8 admin admin] The token cache is being invalidate because project 5d27e14e04d5420ebad37b94053f3010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:52:31.384731 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-55f5237e-7925-46e1-ad91-fc59f49db4c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:31.385458 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-55f5237e-7925-46e1-ad91-fc59f49db4c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:31.387114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1235/2481] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:52:31 2022] DELETE /identity/v3/projects/5d27e14e04d5420ebad37b94053f3010 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:31.393158 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d3647-ba10-44c4-a100-e58f45ca8f05 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:31.393444 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d3647-ba10-44c4-a100-e58f45ca8f05 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:31.393743 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d3647-ba10-44c4-a100-e58f45ca8f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:31.419492 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-035d3647-ba10-44c4-a100-e58f45ca8f05 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:31.420703 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-035d3647-ba10-44c4-a100-e58f45ca8f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:31.498089 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1247/2482] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:31.506101 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de9e72-2fee-481c-84c6-411813b73ed1 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:31.506382 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de9e72-2fee-481c-84c6-411813b73ed1 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:31.506676 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de9e72-2fee-481c-84c6-411813b73ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:31.526736 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-f6de9e72-2fee-481c-84c6-411813b73ed1 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:31.528013 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-f6de9e72-2fee-481c-84c6-411813b73ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:31.537316 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1236/2483] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:31.542412 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d3647-ba10-44c4-a100-e58f45ca8f05 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:31.556283 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d3647-ba10-44c4-a100-e58f45ca8f05 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:31.562951 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbe18f-fdc4-4ea7-8f1a-e1a50cf6bc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:31.563937 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbe18f-fdc4-4ea7-8f1a-e1a50cf6bc3b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:31.564261 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbe18f-fdc4-4ea7-8f1a-e1a50cf6bc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:31.564563 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbe18f-fdc4-4ea7-8f1a-e1a50cf6bc3b admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:31.565630 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbe18f-fdc4-4ea7-8f1a-e1a50cf6bc3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:52:31.566022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbe18f-fdc4-4ea7-8f1a-e1a50cf6bc3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:31.568515 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bbe18f-fdc4-4ea7-8f1a-e1a50cf6bc3b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:31.582201 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1248/2484] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:52:31.586809 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de9e72-2fee-481c-84c6-411813b73ed1 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:31.596518 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de9e72-2fee-481c-84c6-411813b73ed1 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:31.602116 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e3715-eee6-4ba7-affd-af3c3ff7b667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:31.602778 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e3715-eee6-4ba7-affd-af3c3ff7b667 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:31.603054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e3715-eee6-4ba7-affd-af3c3ff7b667 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:31.603303 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e3715-eee6-4ba7-affd-af3c3ff7b667 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:31.604039 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e3715-eee6-4ba7-affd-af3c3ff7b667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:31.605933 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e3715-eee6-4ba7-affd-af3c3ff7b667 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:31.634503 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1237/2485] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:52:31 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:52:31.639323 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbe18f-fdc4-4ea7-8f1a-e1a50cf6bc3b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:31.649842 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbe18f-fdc4-4ea7-8f1a-e1a50cf6bc3b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:31.707373 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19825a33-db0a-42d8-a41e-abf304e59076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:31.708095 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19825a33-db0a-42d8-a41e-abf304e59076 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:31.708366 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19825a33-db0a-42d8-a41e-abf304e59076 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:31.708636 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19825a33-db0a-42d8-a41e-abf304e59076 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:31.709334 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19825a33-db0a-42d8-a41e-abf304e59076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:31.711460 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19825a33-db0a-42d8-a41e-abf304e59076 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:31.733287 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1249/2486] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:52:31 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:52:31.738278 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e3715-eee6-4ba7-affd-af3c3ff7b667 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:31.749232 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e3715-eee6-4ba7-affd-af3c3ff7b667 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:31.754300 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df28b5-a337-4225-8eed-77a226997c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:31.754966 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df28b5-a337-4225-8eed-77a226997c8e admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:31.755249 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df28b5-a337-4225-8eed-77a226997c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:31.755537 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df28b5-a337-4225-8eed-77a226997c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:31.756290 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df28b5-a337-4225-8eed-77a226997c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:31.757907 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df28b5-a337-4225-8eed-77a226997c8e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:31.768709 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1238/2487] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:52:31.772951 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19825a33-db0a-42d8-a41e-abf304e59076 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:31.783225 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19825a33-db0a-42d8-a41e-abf304e59076 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:31.788583 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab180e-7db8-4e69-a1f7-867307f02b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:31.789035 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab180e-7db8-4e69-a1f7-867307f02b93 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:31.789313 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab180e-7db8-4e69-a1f7-867307f02b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:31.789584 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab180e-7db8-4e69-a1f7-867307f02b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:31.790329 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab180e-7db8-4e69-a1f7-867307f02b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:31.791984 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab180e-7db8-4e69-a1f7-867307f02b93 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:31.803396 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1250/2488] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:52:31.809690 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df28b5-a337-4225-8eed-77a226997c8e admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:31.825451 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df28b5-a337-4225-8eed-77a226997c8e admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:31.832297 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5be06-ad41-4114-8fdc-e8fb1b119859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:31.833211 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5be06-ad41-4114-8fdc-e8fb1b119859 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:31.833508 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5be06-ad41-4114-8fdc-e8fb1b119859 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:31.833772 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5be06-ad41-4114-8fdc-e8fb1b119859 admin admin] PATH_INFO: `/v3/projects/073955128cea4fb78bc0320d5c79f2cc/users/8f580906c7854c6f8e1951e1edf0fc23/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:31.851061 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5be06-ad41-4114-8fdc-e8fb1b119859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=073955128cea4fb78bc0320d5c79f2cc, user_id=8f580906c7854c6f8e1951e1edf0fc23, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:31.853910 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5be06-ad41-4114-8fdc-e8fb1b119859 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:31.871241 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1239/2489] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:52:31 2022] PUT /identity/v3/projects/073955128cea4fb78bc0320d5c79f2cc/users/8f580906c7854c6f8e1951e1edf0fc23/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:31.881771 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f760b7-59e3-4f9a-ba07-d185ef427290 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:31.882027 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f760b7-59e3-4f9a-ba07-d185ef427290 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:31.882417 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f760b7-59e3-4f9a-ba07-d185ef427290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:31.910572 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-63f760b7-59e3-4f9a-ba07-d185ef427290 None None] MFA Rules not processed for user `8f580906c7854c6f8e1951e1edf0fc23`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:31.911803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-63f760b7-59e3-4f9a-ba07-d185ef427290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:31.985214 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1251/2490] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:52:31.990438 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5be06-ad41-4114-8fdc-e8fb1b119859 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:32.062319 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5be06-ad41-4114-8fdc-e8fb1b119859 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:32.067253 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4263b-56aa-42ff-8cdd-3bb46f5c6aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:32.070082 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4263b-56aa-42ff-8cdd-3bb46f5c6aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:32.073057 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4263b-56aa-42ff-8cdd-3bb46f5c6aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:32.073342 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4263b-56aa-42ff-8cdd-3bb46f5c6aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:32.074067 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4263b-56aa-42ff-8cdd-3bb46f5c6aa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:32.075992 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4263b-56aa-42ff-8cdd-3bb46f5c6aa3 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:32.106345 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1240/2491] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:52:31 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:52:32.110529 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f760b7-59e3-4f9a-ba07-d185ef427290 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:32.121829 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f760b7-59e3-4f9a-ba07-d185ef427290 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:32.184513 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89469d7a-01f0-4b0d-8159-b4b8aaf3b0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:32.185482 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89469d7a-01f0-4b0d-8159-b4b8aaf3b0ad admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:32.185826 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89469d7a-01f0-4b0d-8159-b4b8aaf3b0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:32.186149 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89469d7a-01f0-4b0d-8159-b4b8aaf3b0ad admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:32.187160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89469d7a-01f0-4b0d-8159-b4b8aaf3b0ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:32.189886 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89469d7a-01f0-4b0d-8159-b4b8aaf3b0ad admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:32.214943 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1252/2492] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:52:32 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:52:32.215461 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4263b-56aa-42ff-8cdd-3bb46f5c6aa3 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:32.226182 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4263b-56aa-42ff-8cdd-3bb46f5c6aa3 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:32.231542 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778213c4-0f24-457f-bb4b-f56c362fe189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:32.232223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778213c4-0f24-457f-bb4b-f56c362fe189 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:32.232502 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778213c4-0f24-457f-bb4b-f56c362fe189 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:32.232773 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778213c4-0f24-457f-bb4b-f56c362fe189 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:32.233513 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778213c4-0f24-457f-bb4b-f56c362fe189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:32.235113 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778213c4-0f24-457f-bb4b-f56c362fe189 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:32.246062 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1241/2493] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:52:32.250331 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89469d7a-01f0-4b0d-8159-b4b8aaf3b0ad admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:32.262791 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89469d7a-01f0-4b0d-8159-b4b8aaf3b0ad admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:32.269065 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f89ca-a2b1-499f-ad9e-c7b75501f6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:32.269770 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f89ca-a2b1-499f-ad9e-c7b75501f6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:32.270047 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f89ca-a2b1-499f-ad9e-c7b75501f6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:32.270324 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f89ca-a2b1-499f-ad9e-c7b75501f6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:32.271082 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f89ca-a2b1-499f-ad9e-c7b75501f6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:32.273425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f89ca-a2b1-499f-ad9e-c7b75501f6c4 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:32.284231 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1253/2494] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:52:32.288746 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778213c4-0f24-457f-bb4b-f56c362fe189 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:32.299281 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778213c4-0f24-457f-bb4b-f56c362fe189 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:32.307712 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2616a-32cf-4335-8321-a776b5a47308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:32.307712 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2616a-32cf-4335-8321-a776b5a47308 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:32.307712 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2616a-32cf-4335-8321-a776b5a47308 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:32.307712 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2616a-32cf-4335-8321-a776b5a47308 admin admin] PATH_INFO: `/v3/projects/7f1cad011df444af9ba63023a1826d68/users/4df1ce44dc4542f3ab18aa8791424fde/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:32.322533 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2616a-32cf-4335-8321-a776b5a47308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f1cad011df444af9ba63023a1826d68, user_id=4df1ce44dc4542f3ab18aa8791424fde, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:32.325111 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2616a-32cf-4335-8321-a776b5a47308 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:32.340198 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1242/2495] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:52:32 2022] PUT /identity/v3/projects/7f1cad011df444af9ba63023a1826d68/users/4df1ce44dc4542f3ab18aa8791424fde/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:32.351380 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273697e4-5407-438c-be9c-0f240840f85a None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:32.351718 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273697e4-5407-438c-be9c-0f240840f85a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:32.352001 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273697e4-5407-438c-be9c-0f240840f85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:32.382043 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-273697e4-5407-438c-be9c-0f240840f85a None None] MFA Rules not processed for user `4df1ce44dc4542f3ab18aa8791424fde`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:32.383668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-273697e4-5407-438c-be9c-0f240840f85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:32.449851 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1254/2496] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:32.454542 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2616a-32cf-4335-8321-a776b5a47308 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:32.518659 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2616a-32cf-4335-8321-a776b5a47308 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:32.523776 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f40a9-c842-44d3-b416-75e3824f0417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:32.524458 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f40a9-c842-44d3-b416-75e3824f0417 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:32.524735 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f40a9-c842-44d3-b416-75e3824f0417 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:32.525006 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f40a9-c842-44d3-b416-75e3824f0417 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:32.525709 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f40a9-c842-44d3-b416-75e3824f0417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:32.527652 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f40a9-c842-44d3-b416-75e3824f0417 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:32.553599 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1243/2497] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:52:32 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:52:32.557845 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273697e4-5407-438c-be9c-0f240840f85a None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:32.570225 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273697e4-5407-438c-be9c-0f240840f85a None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:32.630684 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf7cbd-c940-4bb5-9d2f-83174d9c1df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:32.631363 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7cbd-c940-4bb5-9d2f-83174d9c1df5 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:32.631677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7cbd-c940-4bb5-9d2f-83174d9c1df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:32.631971 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7cbd-c940-4bb5-9d2f-83174d9c1df5 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:32.632723 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf7cbd-c940-4bb5-9d2f-83174d9c1df5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:32.634673 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf7cbd-c940-4bb5-9d2f-83174d9c1df5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:32.656712 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1255/2498] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:52:32 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:52:32.661065 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f40a9-c842-44d3-b416-75e3824f0417 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:32.671999 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f40a9-c842-44d3-b416-75e3824f0417 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:32.677768 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91f365-ccbc-4941-b991-76bc15399f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:32.678744 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91f365-ccbc-4941-b991-76bc15399f89 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:32.679124 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91f365-ccbc-4941-b991-76bc15399f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:32.679845 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91f365-ccbc-4941-b991-76bc15399f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:32.680634 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91f365-ccbc-4941-b991-76bc15399f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:32.682467 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91f365-ccbc-4941-b991-76bc15399f89 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:32.694081 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1244/2499] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:52:32.698431 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf7cbd-c940-4bb5-9d2f-83174d9c1df5 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:32.708334 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf7cbd-c940-4bb5-9d2f-83174d9c1df5 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:32.713217 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e079405-94e2-4881-a557-947a32f8638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:32.714107 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e079405-94e2-4881-a557-947a32f8638f admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:32.714385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e079405-94e2-4881-a557-947a32f8638f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:32.714657 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e079405-94e2-4881-a557-947a32f8638f admin admin] PATH_INFO: `/v3/projects/cbfeceddd92b44e4b86919bf789c33df/users/4c7b9da800014be78e08ea9366bf18ce/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:32.732868 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e079405-94e2-4881-a557-947a32f8638f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbfeceddd92b44e4b86919bf789c33df, user_id=4c7b9da800014be78e08ea9366bf18ce, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:32.735561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e079405-94e2-4881-a557-947a32f8638f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:32.753137 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1256/2500] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:52:32 2022] PUT /identity/v3/projects/cbfeceddd92b44e4b86919bf789c33df/users/4c7b9da800014be78e08ea9366bf18ce/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:32.758437 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91f365-ccbc-4941-b991-76bc15399f89 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:32.768968 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91f365-ccbc-4941-b991-76bc15399f89 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:32.826398 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f87ec-7293-4ca2-aa73-0e171b1b5cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:32.827097 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f87ec-7293-4ca2-aa73-0e171b1b5cac admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:32.827401 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f87ec-7293-4ca2-aa73-0e171b1b5cac admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:32.827709 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f87ec-7293-4ca2-aa73-0e171b1b5cac admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:32.828467 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f87ec-7293-4ca2-aa73-0e171b1b5cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:32.830065 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f87ec-7293-4ca2-aa73-0e171b1b5cac admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:32.840152 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1245/2501] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:52:32.844438 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e079405-94e2-4881-a557-947a32f8638f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:32.855762 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e079405-94e2-4881-a557-947a32f8638f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:32.863748 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703a87a-5669-492f-834d-46cccc3bb853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:32.865050 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703a87a-5669-492f-834d-46cccc3bb853 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:32.865371 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703a87a-5669-492f-834d-46cccc3bb853 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:32.865712 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703a87a-5669-492f-834d-46cccc3bb853 admin admin] PATH_INFO: `/v3/projects/cbfeceddd92b44e4b86919bf789c33df/users/4c7b9da800014be78e08ea9366bf18ce/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:32.869633 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703a87a-5669-492f-834d-46cccc3bb853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbfeceddd92b44e4b86919bf789c33df, user_id=4c7b9da800014be78e08ea9366bf18ce, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:32.873471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703a87a-5669-492f-834d-46cccc3bb853 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:32.887873 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1257/2502] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:52:32 2022] PUT /identity/v3/projects/cbfeceddd92b44e4b86919bf789c33df/users/4c7b9da800014be78e08ea9366bf18ce/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:32.898408 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e0dec-cb47-4ddf-8bca-4fd0d4d4ec42 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:32.898693 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e0dec-cb47-4ddf-8bca-4fd0d4d4ec42 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:32.898961 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e0dec-cb47-4ddf-8bca-4fd0d4d4ec42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:32.926220 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-be9e0dec-cb47-4ddf-8bca-4fd0d4d4ec42 None None] MFA Rules not processed for user `4c7b9da800014be78e08ea9366bf18ce`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:32.927460 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-be9e0dec-cb47-4ddf-8bca-4fd0d4d4ec42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:33.014330 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1246/2503] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:33.028873 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703a87a-5669-492f-834d-46cccc3bb853 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:33.031862 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-0703a87a-5669-492f-834d-46cccc3bb853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:33.099387 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703a87a-5669-492f-834d-46cccc3bb853 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:33.103902 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4d856-0e86-45ed-bc48-2009a3f48b4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:33.104551 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4d856-0e86-45ed-bc48-2009a3f48b4e service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:33.104839 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4d856-0e86-45ed-bc48-2009a3f48b4e service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:33.105104 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4d856-0e86-45ed-bc48-2009a3f48b4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:33.114506 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4d856-0e86-45ed-bc48-2009a3f48b4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:33.116001 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4d856-0e86-45ed-bc48-2009a3f48b4e service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:33.126600 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1258/2504] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:52:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:52:33.169436 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e0dec-cb47-4ddf-8bca-4fd0d4d4ec42 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:33.171055 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-be9e0dec-cb47-4ddf-8bca-4fd0d4d4ec42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:33.183793 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e0dec-cb47-4ddf-8bca-4fd0d4d4ec42 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:33.187731 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130c820-4e96-4380-9604-4f00e3899426 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:33.188378 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130c820-4e96-4380-9604-4f00e3899426 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:33.188655 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130c820-4e96-4380-9604-4f00e3899426 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:33.188922 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130c820-4e96-4380-9604-4f00e3899426 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:33.247020 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130c820-4e96-4380-9604-4f00e3899426 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:33.248472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130c820-4e96-4380-9604-4f00e3899426 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:33.256980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1247/2505] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:52:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:52:33.855649 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4d856-0e86-45ed-bc48-2009a3f48b4e service cinder] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:33.857144 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-39e4d856-0e86-45ed-bc48-2009a3f48b4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:33.925083 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4d856-0e86-45ed-bc48-2009a3f48b4e service cinder] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:33.929915 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2e908-c5bf-41b2-91c7-0c191e5f62a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:33.930787 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2e908-c5bf-41b2-91c7-0c191e5f62a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:33.931064 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2e908-c5bf-41b2-91c7-0c191e5f62a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:33.931334 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2e908-c5bf-41b2-91c7-0c191e5f62a4 admin admin] PATH_INFO: `/v3/users/90f35219a70d4e0596a6c28bd9ef9acc` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:33.932562 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2e908-c5bf-41b2-91c7-0c191e5f62a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90f35219a70d4e0596a6c28bd9ef9acc)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:33.934858 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2e908-c5bf-41b2-91c7-0c191e5f62a4 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:33.984438 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f8e2e908-c5bf-41b2-91c7-0c191e5f62a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90f35219a70d4e0596a6c28bd9ef9acc'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:33.991596 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f8e2e908-c5bf-41b2-91c7-0c191e5f62a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90f35219a70d4e0596a6c28bd9ef9acc'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:34.001079 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f8e2e908-c5bf-41b2-91c7-0c191e5f62a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90f35219a70d4e0596a6c28bd9ef9acc'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:34.001858 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f8e2e908-c5bf-41b2-91c7-0c191e5f62a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90f35219a70d4e0596a6c28bd9ef9acc'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:34.002674 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f8e2e908-c5bf-41b2-91c7-0c191e5f62a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90f35219a70d4e0596a6c28bd9ef9acc'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:34.018929 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1259/2506] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:52:33 2022] DELETE /identity/v3/users/90f35219a70d4e0596a6c28bd9ef9acc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:34.196795 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130c820-4e96-4380-9604-4f00e3899426 service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:34.208453 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130c820-4e96-4380-9604-4f00e3899426 service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:34.267332 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3b347-cfbd-4bb0-937f-8a8755a1d19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:34.268232 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3b347-cfbd-4bb0-937f-8a8755a1d19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:34.268512 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3b347-cfbd-4bb0-937f-8a8755a1d19f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:34.268785 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3b347-cfbd-4bb0-937f-8a8755a1d19f admin admin] PATH_INFO: `/v3/projects/36b1b002256e43eba62e736d945f9049` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:34.270020 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3b347-cfbd-4bb0-937f-8a8755a1d19f admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b1b002256e43eba62e736d945f9049)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:34.271997 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3b347-cfbd-4bb0-937f-8a8755a1d19f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:34.319224 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5da3b347-cfbd-4bb0-937f-8a8755a1d19f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b1b002256e43eba62e736d945f9049', 'request_id': 'req-5da3b347-cfbd-4bb0-937f-8a8755a1d19f'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:34.326969 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5da3b347-cfbd-4bb0-937f-8a8755a1d19f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b1b002256e43eba62e736d945f9049', 'request_id': 'req-5da3b347-cfbd-4bb0-937f-8a8755a1d19f'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:34.332410 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5da3b347-cfbd-4bb0-937f-8a8755a1d19f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b1b002256e43eba62e736d945f9049', 'request_id': 'req-5da3b347-cfbd-4bb0-937f-8a8755a1d19f'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:34.343213 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5da3b347-cfbd-4bb0-937f-8a8755a1d19f admin admin] The token cache is being invalidate because project 36b1b002256e43eba62e736d945f9049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:52:34.343557 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5da3b347-cfbd-4bb0-937f-8a8755a1d19f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:34.344187 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5da3b347-cfbd-4bb0-937f-8a8755a1d19f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:34.345772 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1248/2507] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:52:34 2022] DELETE /identity/v3/projects/36b1b002256e43eba62e736d945f9049 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:34.351886 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443697b4-acc2-4c92-9df2-31f376d155c3 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:34.352169 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443697b4-acc2-4c92-9df2-31f376d155c3 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:34.352437 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443697b4-acc2-4c92-9df2-31f376d155c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:34.371973 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-443697b4-acc2-4c92-9df2-31f376d155c3 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:34.373121 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-443697b4-acc2-4c92-9df2-31f376d155c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:34.441860 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1260/2508] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:34.450881 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba228ac-70d9-477d-a94e-bcc12cde725c None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:34.451203 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba228ac-70d9-477d-a94e-bcc12cde725c None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:34.451599 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba228ac-70d9-477d-a94e-bcc12cde725c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:34.478946 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-5ba228ac-70d9-477d-a94e-bcc12cde725c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:34.480178 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5ba228ac-70d9-477d-a94e-bcc12cde725c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:34.488612 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1249/2509] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:34.493009 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443697b4-acc2-4c92-9df2-31f376d155c3 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:34.502535 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443697b4-acc2-4c92-9df2-31f376d155c3 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:34.507380 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60554260-6398-4460-9cb4-a8468c725f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:34.508052 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60554260-6398-4460-9cb4-a8468c725f78 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:34.508330 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60554260-6398-4460-9cb4-a8468c725f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:34.508588 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60554260-6398-4460-9cb4-a8468c725f78 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:34.509334 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60554260-6398-4460-9cb4-a8468c725f78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:52:34.509643 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60554260-6398-4460-9cb4-a8468c725f78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:34.511244 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60554260-6398-4460-9cb4-a8468c725f78 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:34.523827 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1261/2510] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 10 12:52:34.528109 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba228ac-70d9-477d-a94e-bcc12cde725c None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:34.537643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba228ac-70d9-477d-a94e-bcc12cde725c None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:34.543078 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f60a1-e7ca-4149-b2a6-26714f20de8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:34.543745 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f60a1-e7ca-4149-b2a6-26714f20de8e admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:34.544023 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f60a1-e7ca-4149-b2a6-26714f20de8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:34.544287 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f60a1-e7ca-4149-b2a6-26714f20de8e admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:34.544991 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f60a1-e7ca-4149-b2a6-26714f20de8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:34.546884 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f60a1-e7ca-4149-b2a6-26714f20de8e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:34.576551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1250/2511] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:52:34 2022] POST /identity/v3/projects => generated 397 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:52:34.581110 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60554260-6398-4460-9cb4-a8468c725f78 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:34.592624 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60554260-6398-4460-9cb4-a8468c725f78 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:34.653138 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e49b8-e23d-4a18-bf63-be3a2eb00fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:34.653813 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e49b8-e23d-4a18-bf63-be3a2eb00fcf admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:34.654091 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e49b8-e23d-4a18-bf63-be3a2eb00fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:34.654359 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e49b8-e23d-4a18-bf63-be3a2eb00fcf admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:34.655052 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e49b8-e23d-4a18-bf63-be3a2eb00fcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:34.657077 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e49b8-e23d-4a18-bf63-be3a2eb00fcf admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:34.683876 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1262/2512] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:52:34 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:52:34.691047 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f60a1-e7ca-4149-b2a6-26714f20de8e admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:34.701825 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f60a1-e7ca-4149-b2a6-26714f20de8e admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:34.707430 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480bdc7-5c36-4a9c-a90a-41432681ee5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:34.708133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480bdc7-5c36-4a9c-a90a-41432681ee5d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:34.708411 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480bdc7-5c36-4a9c-a90a-41432681ee5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:34.708722 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480bdc7-5c36-4a9c-a90a-41432681ee5d admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:34.709419 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480bdc7-5c36-4a9c-a90a-41432681ee5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:34.711051 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480bdc7-5c36-4a9c-a90a-41432681ee5d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:34.721808 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1251/2513] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:52:34.726416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e49b8-e23d-4a18-bf63-be3a2eb00fcf admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:34.737731 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e49b8-e23d-4a18-bf63-be3a2eb00fcf admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:34.743171 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b78b8-078d-424c-8181-ce7375f6e7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:34.743853 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b78b8-078d-424c-8181-ce7375f6e7ff admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:34.744156 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b78b8-078d-424c-8181-ce7375f6e7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:34.744420 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b78b8-078d-424c-8181-ce7375f6e7ff admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:34.745294 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b78b8-078d-424c-8181-ce7375f6e7ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:34.747165 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b78b8-078d-424c-8181-ce7375f6e7ff admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:34.757607 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1263/2514] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:52:34.761963 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480bdc7-5c36-4a9c-a90a-41432681ee5d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:34.771896 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480bdc7-5c36-4a9c-a90a-41432681ee5d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:34.776781 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671055c-2a62-4eea-8867-73f2f362bc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:34.777747 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671055c-2a62-4eea-8867-73f2f362bc2d admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:34.778048 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671055c-2a62-4eea-8867-73f2f362bc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:34.778411 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671055c-2a62-4eea-8867-73f2f362bc2d admin admin] PATH_INFO: `/v3/projects/6749fcdd53304452aa0ec75d3c683bb5/users/a51a26fa34844ade8118851e44b61887/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:34.793254 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671055c-2a62-4eea-8867-73f2f362bc2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6749fcdd53304452aa0ec75d3c683bb5, user_id=a51a26fa34844ade8118851e44b61887, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:34.795918 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671055c-2a62-4eea-8867-73f2f362bc2d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:34.811045 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1252/2515] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:52:34 2022] PUT /identity/v3/projects/6749fcdd53304452aa0ec75d3c683bb5/users/a51a26fa34844ade8118851e44b61887/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:34.820714 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412ec06-0ce1-4be4-a516-e798a87c01bf None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:34.820995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412ec06-0ce1-4be4-a516-e798a87c01bf None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:34.821315 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412ec06-0ce1-4be4-a516-e798a87c01bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:34.849281 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-0412ec06-0ce1-4be4-a516-e798a87c01bf None None] MFA Rules not processed for user `a51a26fa34844ade8118851e44b61887`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:34.850494 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-0412ec06-0ce1-4be4-a516-e798a87c01bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:34.921260 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1264/2516] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:34.933956 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671055c-2a62-4eea-8867-73f2f362bc2d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:34.935843 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-c671055c-2a62-4eea-8867-73f2f362bc2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:34.995012 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671055c-2a62-4eea-8867-73f2f362bc2d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:34.998611 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823da4b-9f80-49d9-ac98-cc8cdd3e9f12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:34.999275 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823da4b-9f80-49d9-ac98-cc8cdd3e9f12 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:34.999574 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823da4b-9f80-49d9-ac98-cc8cdd3e9f12 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:34.999845 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823da4b-9f80-49d9-ac98-cc8cdd3e9f12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:35.008847 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823da4b-9f80-49d9-ac98-cc8cdd3e9f12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:35.010293 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823da4b-9f80-49d9-ac98-cc8cdd3e9f12 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:35.019399 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1253/2517] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:52:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:52:36.065415 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412ec06-0ce1-4be4-a516-e798a87c01bf None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:36.067013 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-0412ec06-0ce1-4be4-a516-e798a87c01bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:36.079596 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412ec06-0ce1-4be4-a516-e798a87c01bf None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:36.083237 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91961f-015c-4dbb-afd9-6b3b5415614f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:36.083929 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91961f-015c-4dbb-afd9-6b3b5415614f service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:36.084207 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91961f-015c-4dbb-afd9-6b3b5415614f service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:36.084471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91961f-015c-4dbb-afd9-6b3b5415614f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:36.086321 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ab91961f-015c-4dbb-afd9-6b3b5415614f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:36.130880 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823da4b-9f80-49d9-ac98-cc8cdd3e9f12 service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:36.132721 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-3823da4b-9f80-49d9-ac98-cc8cdd3e9f12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:36.159828 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91961f-015c-4dbb-afd9-6b3b5415614f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:36.161282 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91961f-015c-4dbb-afd9-6b3b5415614f service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:36.172427 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1265/2518] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:52:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:52:36.196662 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823da4b-9f80-49d9-ac98-cc8cdd3e9f12 service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:36.201159 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392a8fb-2d13-47c9-b905-1a850e8495ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:36.202032 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392a8fb-2d13-47c9-b905-1a850e8495ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:36.202309 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392a8fb-2d13-47c9-b905-1a850e8495ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:36.202579 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392a8fb-2d13-47c9-b905-1a850e8495ae admin admin] PATH_INFO: `/v3/users/8f580906c7854c6f8e1951e1edf0fc23` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:36.203799 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a392a8fb-2d13-47c9-b905-1a850e8495ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f580906c7854c6f8e1951e1edf0fc23)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:36.205794 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a392a8fb-2d13-47c9-b905-1a850e8495ae admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:36.253450 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a392a8fb-2d13-47c9-b905-1a850e8495ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f580906c7854c6f8e1951e1edf0fc23'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:36.254227 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a392a8fb-2d13-47c9-b905-1a850e8495ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f580906c7854c6f8e1951e1edf0fc23'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:36.254812 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a392a8fb-2d13-47c9-b905-1a850e8495ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f580906c7854c6f8e1951e1edf0fc23'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:36.266729 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a392a8fb-2d13-47c9-b905-1a850e8495ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f580906c7854c6f8e1951e1edf0fc23'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:36.274088 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a392a8fb-2d13-47c9-b905-1a850e8495ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f580906c7854c6f8e1951e1edf0fc23'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:36.289053 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1254/2519] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:52:36 2022] DELETE /identity/v3/users/8f580906c7854c6f8e1951e1edf0fc23 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:52:36.293717 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d45e4-9a99-4c4a-a0e5-0d42209c1173 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:36.294025 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d45e4-9a99-4c4a-a0e5-0d42209c1173 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:36.294302 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d45e4-9a99-4c4a-a0e5-0d42209c1173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:36.314342 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-581d45e4-9a99-4c4a-a0e5-0d42209c1173 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:36.315874 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-581d45e4-9a99-4c4a-a0e5-0d42209c1173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:36.379973 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1266/2520] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:36.387046 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392a8fb-2d13-47c9-b905-1a850e8495ae admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:36.388505 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-a392a8fb-2d13-47c9-b905-1a850e8495ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:36.449599 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392a8fb-2d13-47c9-b905-1a850e8495ae admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:36.453916 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d942c0b-8892-451b-96fd-35ff009f3c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:36.454574 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d942c0b-8892-451b-96fd-35ff009f3c00 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:36.454853 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d942c0b-8892-451b-96fd-35ff009f3c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:36.455118 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d942c0b-8892-451b-96fd-35ff009f3c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:36.465863 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d942c0b-8892-451b-96fd-35ff009f3c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:36.467323 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d942c0b-8892-451b-96fd-35ff009f3c00 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:36.477220 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1255/2521] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:52:36.792911 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d45e4-9a99-4c4a-a0e5-0d42209c1173 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:36.794324 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-581d45e4-9a99-4c4a-a0e5-0d42209c1173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:36.808083 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d45e4-9a99-4c4a-a0e5-0d42209c1173 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:36.813986 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b0e7f-9790-4887-8dfd-455be18b8ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:36.814928 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b0e7f-9790-4887-8dfd-455be18b8ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:36.815271 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b0e7f-9790-4887-8dfd-455be18b8ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:36.815700 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b0e7f-9790-4887-8dfd-455be18b8ac4 admin admin] PATH_INFO: `/v3/projects/073955128cea4fb78bc0320d5c79f2cc` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:36.817042 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b0e7f-9790-4887-8dfd-455be18b8ac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=073955128cea4fb78bc0320d5c79f2cc)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:36.819138 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b0e7f-9790-4887-8dfd-455be18b8ac4 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:36.869296 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5e0b0e7f-9790-4887-8dfd-455be18b8ac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073955128cea4fb78bc0320d5c79f2cc', 'request_id': 'req-5e0b0e7f-9790-4887-8dfd-455be18b8ac4'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:36.875413 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5e0b0e7f-9790-4887-8dfd-455be18b8ac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073955128cea4fb78bc0320d5c79f2cc', 'request_id': 'req-5e0b0e7f-9790-4887-8dfd-455be18b8ac4'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:36.883681 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5e0b0e7f-9790-4887-8dfd-455be18b8ac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073955128cea4fb78bc0320d5c79f2cc', 'request_id': 'req-5e0b0e7f-9790-4887-8dfd-455be18b8ac4'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:36.893641 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5e0b0e7f-9790-4887-8dfd-455be18b8ac4 admin admin] The token cache is being invalidate because project 073955128cea4fb78bc0320d5c79f2cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:52:36.893922 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5e0b0e7f-9790-4887-8dfd-455be18b8ac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:36.894541 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5e0b0e7f-9790-4887-8dfd-455be18b8ac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:36.896125 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1267/2522] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:52:36 2022] DELETE /identity/v3/projects/073955128cea4fb78bc0320d5c79f2cc => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:36.900529 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d942c0b-8892-451b-96fd-35ff009f3c00 service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:36.910327 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d942c0b-8892-451b-96fd-35ff009f3c00 service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:36.966162 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff224e-8bc3-421c-a81e-09b29c2ac256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:36.967025 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff224e-8bc3-421c-a81e-09b29c2ac256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:36.967301 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff224e-8bc3-421c-a81e-09b29c2ac256 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:36.967607 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff224e-8bc3-421c-a81e-09b29c2ac256 admin admin] PATH_INFO: `/v3/users/4df1ce44dc4542f3ab18aa8791424fde` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:36.968873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff224e-8bc3-421c-a81e-09b29c2ac256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4df1ce44dc4542f3ab18aa8791424fde)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:36.970788 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff224e-8bc3-421c-a81e-09b29c2ac256 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:37.024145 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-9eff224e-8bc3-421c-a81e-09b29c2ac256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4df1ce44dc4542f3ab18aa8791424fde'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:37.024838 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-9eff224e-8bc3-421c-a81e-09b29c2ac256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4df1ce44dc4542f3ab18aa8791424fde'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:37.025428 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-9eff224e-8bc3-421c-a81e-09b29c2ac256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4df1ce44dc4542f3ab18aa8791424fde'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:37.036971 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-9eff224e-8bc3-421c-a81e-09b29c2ac256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4df1ce44dc4542f3ab18aa8791424fde'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:37.043477 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-9eff224e-8bc3-421c-a81e-09b29c2ac256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4df1ce44dc4542f3ab18aa8791424fde'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:37.061131 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1256/2523] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:52:36 2022] DELETE /identity/v3/users/4df1ce44dc4542f3ab18aa8791424fde => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:37.335499 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b0e7f-9790-4887-8dfd-455be18b8ac4 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:37.337307 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-5e0b0e7f-9790-4887-8dfd-455be18b8ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:37.352585 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b0e7f-9790-4887-8dfd-455be18b8ac4 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:37.416141 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac653639-5794-47bc-a6ae-fe054c451787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:37.417021 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac653639-5794-47bc-a6ae-fe054c451787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:37.417290 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac653639-5794-47bc-a6ae-fe054c451787 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:37.417562 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac653639-5794-47bc-a6ae-fe054c451787 admin admin] PATH_INFO: `/v3/projects/7f1cad011df444af9ba63023a1826d68` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:37.418836 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac653639-5794-47bc-a6ae-fe054c451787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f1cad011df444af9ba63023a1826d68)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:37.420805 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac653639-5794-47bc-a6ae-fe054c451787 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:37.470774 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ac653639-5794-47bc-a6ae-fe054c451787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f1cad011df444af9ba63023a1826d68', 'request_id': 'req-ac653639-5794-47bc-a6ae-fe054c451787'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:37.476841 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ac653639-5794-47bc-a6ae-fe054c451787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f1cad011df444af9ba63023a1826d68', 'request_id': 'req-ac653639-5794-47bc-a6ae-fe054c451787'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:37.485161 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ac653639-5794-47bc-a6ae-fe054c451787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f1cad011df444af9ba63023a1826d68', 'request_id': 'req-ac653639-5794-47bc-a6ae-fe054c451787'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:37.495995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ac653639-5794-47bc-a6ae-fe054c451787 admin admin] The token cache is being invalidate because project 7f1cad011df444af9ba63023a1826d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:52:37.496273 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ac653639-5794-47bc-a6ae-fe054c451787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:37.496896 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-ac653639-5794-47bc-a6ae-fe054c451787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:37.498439 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1268/2524] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:52:37 2022] DELETE /identity/v3/projects/7f1cad011df444af9ba63023a1826d68 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:37.502582 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff224e-8bc3-421c-a81e-09b29c2ac256 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:37.504031 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9eff224e-8bc3-421c-a81e-09b29c2ac256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:37.517568 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff224e-8bc3-421c-a81e-09b29c2ac256 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:37.582934 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0d34e-3ddc-44c6-86de-1b3809ca5d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:37.583749 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0d34e-3ddc-44c6-86de-1b3809ca5d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:37.584024 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0d34e-3ddc-44c6-86de-1b3809ca5d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:37.584288 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0d34e-3ddc-44c6-86de-1b3809ca5d91 admin admin] PATH_INFO: `/v3/users/4c7b9da800014be78e08ea9366bf18ce` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:37.585984 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0d34e-3ddc-44c6-86de-1b3809ca5d91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c7b9da800014be78e08ea9366bf18ce)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:37.587944 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0d34e-3ddc-44c6-86de-1b3809ca5d91 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:37.636089 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-dbd0d34e-3ddc-44c6-86de-1b3809ca5d91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c7b9da800014be78e08ea9366bf18ce'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:37.636812 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-dbd0d34e-3ddc-44c6-86de-1b3809ca5d91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c7b9da800014be78e08ea9366bf18ce'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:37.637500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-dbd0d34e-3ddc-44c6-86de-1b3809ca5d91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c7b9da800014be78e08ea9366bf18ce'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:37.649155 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-dbd0d34e-3ddc-44c6-86de-1b3809ca5d91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c7b9da800014be78e08ea9366bf18ce'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:37.655721 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-dbd0d34e-3ddc-44c6-86de-1b3809ca5d91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c7b9da800014be78e08ea9366bf18ce'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:37.670453 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1257/2525] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:52:37 2022] DELETE /identity/v3/users/4c7b9da800014be78e08ea9366bf18ce => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:37.949551 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac653639-5794-47bc-a6ae-fe054c451787 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:37.951000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ac653639-5794-47bc-a6ae-fe054c451787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:37.964190 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac653639-5794-47bc-a6ae-fe054c451787 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:38.042345 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795fd12-57c2-498f-ba0a-c81ecfe636e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:38.043230 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795fd12-57c2-498f-ba0a-c81ecfe636e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:38.043527 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795fd12-57c2-498f-ba0a-c81ecfe636e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:38.043820 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795fd12-57c2-498f-ba0a-c81ecfe636e5 admin admin] PATH_INFO: `/v3/projects/cbfeceddd92b44e4b86919bf789c33df` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:38.045190 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795fd12-57c2-498f-ba0a-c81ecfe636e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbfeceddd92b44e4b86919bf789c33df)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:38.047139 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795fd12-57c2-498f-ba0a-c81ecfe636e5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:38.100045 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-e795fd12-57c2-498f-ba0a-c81ecfe636e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbfeceddd92b44e4b86919bf789c33df', 'request_id': 'req-e795fd12-57c2-498f-ba0a-c81ecfe636e5'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:38.106425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-e795fd12-57c2-498f-ba0a-c81ecfe636e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbfeceddd92b44e4b86919bf789c33df', 'request_id': 'req-e795fd12-57c2-498f-ba0a-c81ecfe636e5'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:38.115415 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-e795fd12-57c2-498f-ba0a-c81ecfe636e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbfeceddd92b44e4b86919bf789c33df', 'request_id': 'req-e795fd12-57c2-498f-ba0a-c81ecfe636e5'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:38.127072 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-e795fd12-57c2-498f-ba0a-c81ecfe636e5 admin admin] The token cache is being invalidate because project cbfeceddd92b44e4b86919bf789c33df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:52:38.127313 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-e795fd12-57c2-498f-ba0a-c81ecfe636e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:38.127946 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-e795fd12-57c2-498f-ba0a-c81ecfe636e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:38.129475 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1269/2526] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:52:37 2022] DELETE /identity/v3/projects/cbfeceddd92b44e4b86919bf789c33df => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:38.137092 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a5d5e-2f4c-484b-ba82-3cf2cb160505 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:38.137421 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a5d5e-2f4c-484b-ba82-3cf2cb160505 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:38.137717 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a5d5e-2f4c-484b-ba82-3cf2cb160505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:38.156460 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-0b5a5d5e-2f4c-484b-ba82-3cf2cb160505 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:38.157677 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-0b5a5d5e-2f4c-484b-ba82-3cf2cb160505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:38.218696 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1258/2527] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:38.228056 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73605e9-bc9e-4f0c-a83f-6d2b081ffb7e None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:38.228473 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73605e9-bc9e-4f0c-a83f-6d2b081ffb7e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:38.228859 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73605e9-bc9e-4f0c-a83f-6d2b081ffb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:38.257629 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-e73605e9-bc9e-4f0c-a83f-6d2b081ffb7e None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:38.258841 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-e73605e9-bc9e-4f0c-a83f-6d2b081ffb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:38.268743 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1270/2528] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:38.273455 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a5d5e-2f4c-484b-ba82-3cf2cb160505 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:38.283901 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a5d5e-2f4c-484b-ba82-3cf2cb160505 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:38.290126 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e9f34-6efb-4329-a8cb-c96d2578f837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:38.290777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e9f34-6efb-4329-a8cb-c96d2578f837 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:38.291058 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e9f34-6efb-4329-a8cb-c96d2578f837 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:38.291311 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e9f34-6efb-4329-a8cb-c96d2578f837 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:38.292077 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e9f34-6efb-4329-a8cb-c96d2578f837 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:52:38.292378 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e9f34-6efb-4329-a8cb-c96d2578f837 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:38.293975 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e9f34-6efb-4329-a8cb-c96d2578f837 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:38.305623 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1259/2529] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:52:38.310589 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73605e9-bc9e-4f0c-a83f-6d2b081ffb7e None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:38.320677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73605e9-bc9e-4f0c-a83f-6d2b081ffb7e None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:38.326505 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6feefd1-4eb5-4360-8565-c7f237d9b1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:38.327153 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6feefd1-4eb5-4360-8565-c7f237d9b1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:38.327434 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6feefd1-4eb5-4360-8565-c7f237d9b1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:38.327740 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6feefd1-4eb5-4360-8565-c7f237d9b1d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:38.328450 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6feefd1-4eb5-4360-8565-c7f237d9b1d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:38.330353 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6feefd1-4eb5-4360-8565-c7f237d9b1d3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:38.369610 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1271/2530] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:52:38 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:52:38.374153 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e9f34-6efb-4329-a8cb-c96d2578f837 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:38.389052 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e9f34-6efb-4329-a8cb-c96d2578f837 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:38.452247 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec0d95-3a72-4f74-a569-ee53a4d6d252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:38.452938 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec0d95-3a72-4f74-a569-ee53a4d6d252 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:38.453216 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec0d95-3a72-4f74-a569-ee53a4d6d252 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:38.453485 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec0d95-3a72-4f74-a569-ee53a4d6d252 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:38.454188 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec0d95-3a72-4f74-a569-ee53a4d6d252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:38.456140 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec0d95-3a72-4f74-a569-ee53a4d6d252 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:38.478009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1260/2531] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:52:38 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:52:38.482426 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6feefd1-4eb5-4360-8565-c7f237d9b1d3 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:38.493128 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6feefd1-4eb5-4360-8565-c7f237d9b1d3 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:38.498229 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e8eaa-1c10-4b4a-b057-457ffeeaa2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:38.498896 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e8eaa-1c10-4b4a-b057-457ffeeaa2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:38.499177 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e8eaa-1c10-4b4a-b057-457ffeeaa2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:38.499451 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e8eaa-1c10-4b4a-b057-457ffeeaa2d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:38.500218 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e8eaa-1c10-4b4a-b057-457ffeeaa2d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:38.501839 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e8eaa-1c10-4b4a-b057-457ffeeaa2d8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:38.512543 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1272/2532] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:52:38.517980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec0d95-3a72-4f74-a569-ee53a4d6d252 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:38.528708 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec0d95-3a72-4f74-a569-ee53a4d6d252 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:38.533904 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab564bd-40a2-453d-9f58-30070031ff7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:38.534675 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab564bd-40a2-453d-9f58-30070031ff7a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:38.534954 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab564bd-40a2-453d-9f58-30070031ff7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:38.535228 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab564bd-40a2-453d-9f58-30070031ff7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:38.536003 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab564bd-40a2-453d-9f58-30070031ff7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:38.537606 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab564bd-40a2-453d-9f58-30070031ff7a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:38.548238 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1261/2533] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:52:38.552451 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e8eaa-1c10-4b4a-b057-457ffeeaa2d8 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:38.563200 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e8eaa-1c10-4b4a-b057-457ffeeaa2d8 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:38.568324 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05463add-0dba-44d3-932b-432d9773ea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:38.569245 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05463add-0dba-44d3-932b-432d9773ea8d admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:38.569528 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05463add-0dba-44d3-932b-432d9773ea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:38.569788 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05463add-0dba-44d3-932b-432d9773ea8d admin admin] PATH_INFO: `/v3/projects/49b93adb02f6421e98d26e140bc17634/users/0bd08123ff9041c099577fd755b432fe/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:38.586513 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05463add-0dba-44d3-932b-432d9773ea8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b93adb02f6421e98d26e140bc17634, user_id=0bd08123ff9041c099577fd755b432fe, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:38.589287 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05463add-0dba-44d3-932b-432d9773ea8d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:38.610411 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1273/2534] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:52:38 2022] PUT /identity/v3/projects/49b93adb02f6421e98d26e140bc17634/users/0bd08123ff9041c099577fd755b432fe/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:38.612441 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a679e3-0d71-40f6-8904-1a4602547744 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:38.613287 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a679e3-0d71-40f6-8904-1a4602547744 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:38.613287 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a679e3-0d71-40f6-8904-1a4602547744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:38.632615 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-12a679e3-0d71-40f6-8904-1a4602547744 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:38.633830 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-12a679e3-0d71-40f6-8904-1a4602547744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:38.698418 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1262/2535] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:38.708466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05463add-0dba-44d3-932b-432d9773ea8d admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:38.710636 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-05463add-0dba-44d3-932b-432d9773ea8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:38.769137 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05463add-0dba-44d3-932b-432d9773ea8d admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:38.773168 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462871c1-f5b0-45fa-ad8e-6efc25ea64ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:38.773799 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462871c1-f5b0-45fa-ad8e-6efc25ea64ed service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:38.774073 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462871c1-f5b0-45fa-ad8e-6efc25ea64ed service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:38.774337 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462871c1-f5b0-45fa-ad8e-6efc25ea64ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:38.783058 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462871c1-f5b0-45fa-ad8e-6efc25ea64ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:38.784514 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462871c1-f5b0-45fa-ad8e-6efc25ea64ed service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:38.793806 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1274/2536] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:52:42.109653 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a679e3-0d71-40f6-8904-1a4602547744 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:42.111311 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-12a679e3-0d71-40f6-8904-1a4602547744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:42.127551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a679e3-0d71-40f6-8904-1a4602547744 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:42.135677 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e256f3-b656-4d7b-8bd0-aa5ce57f5f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:42.136671 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e256f3-b656-4d7b-8bd0-aa5ce57f5f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:42.137007 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e256f3-b656-4d7b-8bd0-aa5ce57f5f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:42.137325 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e256f3-b656-4d7b-8bd0-aa5ce57f5f0d admin admin] PATH_INFO: `/v3/users/a51a26fa34844ade8118851e44b61887` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:42.139073 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e256f3-b656-4d7b-8bd0-aa5ce57f5f0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a51a26fa34844ade8118851e44b61887)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:42.142841 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e256f3-b656-4d7b-8bd0-aa5ce57f5f0d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:42.206083 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b6e256f3-b656-4d7b-8bd0-aa5ce57f5f0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a51a26fa34844ade8118851e44b61887'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:42.213472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b6e256f3-b656-4d7b-8bd0-aa5ce57f5f0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a51a26fa34844ade8118851e44b61887'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:42.214572 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b6e256f3-b656-4d7b-8bd0-aa5ce57f5f0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a51a26fa34844ade8118851e44b61887'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:42.228264 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b6e256f3-b656-4d7b-8bd0-aa5ce57f5f0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a51a26fa34844ade8118851e44b61887'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:42.237219 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b6e256f3-b656-4d7b-8bd0-aa5ce57f5f0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a51a26fa34844ade8118851e44b61887'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:42.254985 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1263/2537] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:52:42 2022] DELETE /identity/v3/users/a51a26fa34844ade8118851e44b61887 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:42.260383 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b3667-6fb6-4cee-85c3-9bccd44c999f None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:42.261041 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b3667-6fb6-4cee-85c3-9bccd44c999f None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:42.261041 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b3667-6fb6-4cee-85c3-9bccd44c999f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:42.278912 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-d17b3667-6fb6-4cee-85c3-9bccd44c999f None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:42.280431 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d17b3667-6fb6-4cee-85c3-9bccd44c999f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:42.345805 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1275/2538] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:42.356321 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e256f3-b656-4d7b-8bd0-aa5ce57f5f0d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:42.357737 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-b6e256f3-b656-4d7b-8bd0-aa5ce57f5f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:42.424346 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e256f3-b656-4d7b-8bd0-aa5ce57f5f0d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:42.431917 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e793bf-ebe1-4932-9d7a-0149dda9bd52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:42.432670 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e793bf-ebe1-4932-9d7a-0149dda9bd52 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:42.433001 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e793bf-ebe1-4932-9d7a-0149dda9bd52 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:42.434771 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e793bf-ebe1-4932-9d7a-0149dda9bd52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:42.446796 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e793bf-ebe1-4932-9d7a-0149dda9bd52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:42.448136 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e793bf-ebe1-4932-9d7a-0149dda9bd52 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:42.457928 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1264/2539] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:52:42.648956 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b3667-6fb6-4cee-85c3-9bccd44c999f None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:42.650425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d17b3667-6fb6-4cee-85c3-9bccd44c999f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:42.803255 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b3667-6fb6-4cee-85c3-9bccd44c999f None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:42.816756 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a512c-4e4b-4762-81f6-ae6d160a28c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:42.817448 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a512c-4e4b-4762-81f6-ae6d160a28c4 service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:42.817810 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a512c-4e4b-4762-81f6-ae6d160a28c4 service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:42.818316 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a512c-4e4b-4762-81f6-ae6d160a28c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:42.822396 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ce5a512c-4e4b-4762-81f6-ae6d160a28c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:42.855699 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e793bf-ebe1-4932-9d7a-0149dda9bd52 service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:42.857855 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-17e793bf-ebe1-4932-9d7a-0149dda9bd52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:42.882044 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e793bf-ebe1-4932-9d7a-0149dda9bd52 service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:42.894232 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f6a56-730a-43d7-8c14-e35fb41a936e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:42.895910 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f6a56-730a-43d7-8c14-e35fb41a936e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:42.896420 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f6a56-730a-43d7-8c14-e35fb41a936e admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:42.896904 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f6a56-730a-43d7-8c14-e35fb41a936e admin admin] PATH_INFO: `/v3/projects/6749fcdd53304452aa0ec75d3c683bb5` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:42.899039 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f6a56-730a-43d7-8c14-e35fb41a936e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6749fcdd53304452aa0ec75d3c683bb5)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:42.901922 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f6a56-730a-43d7-8c14-e35fb41a936e admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:42.944119 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a512c-4e4b-4762-81f6-ae6d160a28c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:42.946507 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a512c-4e4b-4762-81f6-ae6d160a28c4 service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:42.962791 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1276/2540] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:52:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:52:42.992870 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a87f6a56-730a-43d7-8c14-e35fb41a936e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6749fcdd53304452aa0ec75d3c683bb5', 'request_id': 'req-a87f6a56-730a-43d7-8c14-e35fb41a936e'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:43.004328 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a87f6a56-730a-43d7-8c14-e35fb41a936e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6749fcdd53304452aa0ec75d3c683bb5', 'request_id': 'req-a87f6a56-730a-43d7-8c14-e35fb41a936e'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:43.020324 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a87f6a56-730a-43d7-8c14-e35fb41a936e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6749fcdd53304452aa0ec75d3c683bb5', 'request_id': 'req-a87f6a56-730a-43d7-8c14-e35fb41a936e'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:43.035385 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a87f6a56-730a-43d7-8c14-e35fb41a936e admin admin] The token cache is being invalidate because project 6749fcdd53304452aa0ec75d3c683bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:52:43.035782 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a87f6a56-730a-43d7-8c14-e35fb41a936e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:43.036460 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a87f6a56-730a-43d7-8c14-e35fb41a936e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:52:43.048838 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1265/2541] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:52:42 2022] DELETE /identity/v3/projects/6749fcdd53304452aa0ec75d3c683bb5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:52:43.148376 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6decf9-0113-4b3f-a51d-ff2418afa619 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:43.148776 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6decf9-0113-4b3f-a51d-ff2418afa619 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:43.149091 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6decf9-0113-4b3f-a51d-ff2418afa619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:43.192612 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-1a6decf9-0113-4b3f-a51d-ff2418afa619 None None] MFA Rules not processed for user `0bd08123ff9041c099577fd755b432fe`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:43.194499 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-1a6decf9-0113-4b3f-a51d-ff2418afa619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:43.274349 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1277/2542] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:43.278898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f6a56-730a-43d7-8c14-e35fb41a936e admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:43.280336 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-a87f6a56-730a-43d7-8c14-e35fb41a936e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:43.348408 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f6a56-730a-43d7-8c14-e35fb41a936e admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:43.353666 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45a674-c4b4-4a23-8f6b-db4abf728597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:43.354350 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45a674-c4b4-4a23-8f6b-db4abf728597 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:43.354627 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45a674-c4b4-4a23-8f6b-db4abf728597 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:43.354891 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45a674-c4b4-4a23-8f6b-db4abf728597 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:43.355634 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45a674-c4b4-4a23-8f6b-db4abf728597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:43.357586 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45a674-c4b4-4a23-8f6b-db4abf728597 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:43.389138 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1266/2543] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:52:43 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:52:43.392957 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6decf9-0113-4b3f-a51d-ff2418afa619 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:43.414442 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6decf9-0113-4b3f-a51d-ff2418afa619 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:43.474821 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030369f6-439b-446d-ba95-345d27253b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:43.475849 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030369f6-439b-446d-ba95-345d27253b23 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:43.476129 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030369f6-439b-446d-ba95-345d27253b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:43.476466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030369f6-439b-446d-ba95-345d27253b23 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:43.477183 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030369f6-439b-446d-ba95-345d27253b23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:43.479119 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030369f6-439b-446d-ba95-345d27253b23 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:43.501964 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1278/2544] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:52:43 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:52:43.505978 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45a674-c4b4-4a23-8f6b-db4abf728597 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:43.516883 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45a674-c4b4-4a23-8f6b-db4abf728597 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:43.521758 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c8fbb-919c-45e4-a8a8-314ffef23511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:43.522470 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c8fbb-919c-45e4-a8a8-314ffef23511 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:43.522749 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c8fbb-919c-45e4-a8a8-314ffef23511 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:43.523020 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c8fbb-919c-45e4-a8a8-314ffef23511 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:43.523799 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c8fbb-919c-45e4-a8a8-314ffef23511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:43.525449 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c8fbb-919c-45e4-a8a8-314ffef23511 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:43.542082 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1267/2545] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:52:43.544856 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030369f6-439b-446d-ba95-345d27253b23 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:43.555686 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030369f6-439b-446d-ba95-345d27253b23 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:43.560928 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93180c1c-c62d-4275-a0fc-eeb8926bc425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:43.561832 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93180c1c-c62d-4275-a0fc-eeb8926bc425 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:43.562174 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93180c1c-c62d-4275-a0fc-eeb8926bc425 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:43.562469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93180c1c-c62d-4275-a0fc-eeb8926bc425 admin admin] PATH_INFO: `/v3/projects/4fc186955d454e3e897c9d832e5af9bf/users/7e1abd854cd2404e89069d7944d632c3/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:43.584667 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93180c1c-c62d-4275-a0fc-eeb8926bc425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc186955d454e3e897c9d832e5af9bf, user_id=7e1abd854cd2404e89069d7944d632c3, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:43.589600 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93180c1c-c62d-4275-a0fc-eeb8926bc425 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:43.611949 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1279/2546] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:52:43 2022] PUT /identity/v3/projects/4fc186955d454e3e897c9d832e5af9bf/users/7e1abd854cd2404e89069d7944d632c3/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:43.616199 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c8fbb-919c-45e4-a8a8-314ffef23511 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:43.626011 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c8fbb-919c-45e4-a8a8-314ffef23511 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:43.692674 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5cbee-18e4-4d70-bddd-fee43467d0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:43.693452 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5cbee-18e4-4d70-bddd-fee43467d0de admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:43.693802 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5cbee-18e4-4d70-bddd-fee43467d0de admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:43.694132 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5cbee-18e4-4d70-bddd-fee43467d0de admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:43.695236 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5cbee-18e4-4d70-bddd-fee43467d0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:43.696950 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5cbee-18e4-4d70-bddd-fee43467d0de admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:43.707859 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1268/2547] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:52:43.712453 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93180c1c-c62d-4275-a0fc-eeb8926bc425 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:43.724954 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93180c1c-c62d-4275-a0fc-eeb8926bc425 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:43.730769 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af3e71-a6a3-4cde-b3a2-8dced1b74eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:43.731719 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af3e71-a6a3-4cde-b3a2-8dced1b74eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:43.731998 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af3e71-a6a3-4cde-b3a2-8dced1b74eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:43.732272 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af3e71-a6a3-4cde-b3a2-8dced1b74eeb admin admin] PATH_INFO: `/v3/projects/4fc186955d454e3e897c9d832e5af9bf/users/7e1abd854cd2404e89069d7944d632c3/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:43.734459 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af3e71-a6a3-4cde-b3a2-8dced1b74eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc186955d454e3e897c9d832e5af9bf, user_id=7e1abd854cd2404e89069d7944d632c3, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:43.737035 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af3e71-a6a3-4cde-b3a2-8dced1b74eeb admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:43.749562 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1280/2548] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:52:43 2022] PUT /identity/v3/projects/4fc186955d454e3e897c9d832e5af9bf/users/7e1abd854cd2404e89069d7944d632c3/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:52:48.432372 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a101da2-ab5e-4942-872b-1a51335e2083 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:48.432896 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a101da2-ab5e-4942-872b-1a51335e2083 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:48.432896 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a101da2-ab5e-4942-872b-1a51335e2083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:48.461402 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-7a101da2-ab5e-4942-872b-1a51335e2083 None None] MFA Rules not processed for user `7e1abd854cd2404e89069d7944d632c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:48.462724 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-7a101da2-ab5e-4942-872b-1a51335e2083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:48.533357 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1269/2549] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:48.545923 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af3e71-a6a3-4cde-b3a2-8dced1b74eeb admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:48.547946 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d9af3e71-a6a3-4cde-b3a2-8dced1b74eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:48.645008 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af3e71-a6a3-4cde-b3a2-8dced1b74eeb admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:48.656872 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3094185-816a-4ff4-bd8f-62dd48e9cc7c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f812f38c242d4530b3fc73013f66c9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:48.657750 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3094185-816a-4ff4-bd8f-62dd48e9cc7c service glance] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:48.658033 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3094185-816a-4ff4-bd8f-62dd48e9cc7c service glance] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:48.658293 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3094185-816a-4ff4-bd8f-62dd48e9cc7c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:48.724853 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3094185-816a-4ff4-bd8f-62dd48e9cc7c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:48.727429 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3094185-816a-4ff4-bd8f-62dd48e9cc7c service glance] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:48.741722 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1281/2550] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:52:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:52:48.873483 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21685025-2b9c-417c-ad33-8eb43ccc074d None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:48.873822 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21685025-2b9c-417c-ad33-8eb43ccc074d None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:48.874096 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21685025-2b9c-417c-ad33-8eb43ccc074d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:48.936838 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-21685025-2b9c-417c-ad33-8eb43ccc074d None None] MFA Rules not processed for user `44e5602fd019411aa8f0e091ed533ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:48.938053 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-21685025-2b9c-417c-ad33-8eb43ccc074d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:49.003378 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1270/2551] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jan 10 12:52:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:49.083296 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3094185-816a-4ff4-bd8f-62dd48e9cc7c service glance] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:49.085062 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-b3094185-816a-4ff4-bd8f-62dd48e9cc7c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:49.193457 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3094185-816a-4ff4-bd8f-62dd48e9cc7c service glance] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:49.200289 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418789a8-de4f-48f0-8867-76863e54e550 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd898c7c2974bb38998ebad22fd5a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:49.201407 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418789a8-de4f-48f0-8867-76863e54e550 service swift] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:49.201407 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418789a8-de4f-48f0-8867-76863e54e550 service swift] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:49.201636 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418789a8-de4f-48f0-8867-76863e54e550 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:49.212135 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418789a8-de4f-48f0-8867-76863e54e550 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:49.213914 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418789a8-de4f-48f0-8867-76863e54e550 service swift] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:49.230566 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1282/2552] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jan 10 12:52:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:52:57.108175 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21685025-2b9c-417c-ad33-8eb43ccc074d None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:57.109701 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-21685025-2b9c-417c-ad33-8eb43ccc074d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:57.190444 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21685025-2b9c-417c-ad33-8eb43ccc074d None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:57.195774 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf0ceb-d736-4db1-b4b8-2078967c1445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:57.195774 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf0ceb-d736-4db1-b4b8-2078967c1445 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:57.195774 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf0ceb-d736-4db1-b4b8-2078967c1445 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:57.195774 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf0ceb-d736-4db1-b4b8-2078967c1445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:57.197424 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-36bf0ceb-d736-4db1-b4b8-2078967c1445 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:57.208206 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf0ceb-d736-4db1-b4b8-2078967c1445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:57.210174 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf0ceb-d736-4db1-b4b8-2078967c1445 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:57.218963 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1271/2553] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:52:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:52:58.545785 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f450dc6-313c-41eb-b09c-fe33578efc9e None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:58.546301 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f450dc6-313c-41eb-b09c-fe33578efc9e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:58.546301 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f450dc6-313c-41eb-b09c-fe33578efc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:58.565138 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-7f450dc6-313c-41eb-b09c-fe33578efc9e None None] MFA Rules not processed for user `0bd08123ff9041c099577fd755b432fe`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:52:58.566345 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-7f450dc6-313c-41eb-b09c-fe33578efc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:58.574306 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1283/2554] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:52:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:52:58.831360 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf0ceb-d736-4db1-b4b8-2078967c1445 service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:58.833052 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-36bf0ceb-d736-4db1-b4b8-2078967c1445 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:58.843806 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf0ceb-d736-4db1-b4b8-2078967c1445 service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:58.847836 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5166e52-8545-4248-adc0-d2d6400e1306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:58.848465 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5166e52-8545-4248-adc0-d2d6400e1306 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:58.848734 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5166e52-8545-4248-adc0-d2d6400e1306 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:58.848996 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5166e52-8545-4248-adc0-d2d6400e1306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:58.851197 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-b5166e52-8545-4248-adc0-d2d6400e1306 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:58.860453 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5166e52-8545-4248-adc0-d2d6400e1306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:58.861865 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5166e52-8545-4248-adc0-d2d6400e1306 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:58.869858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1272/2555] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:52:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:52:59.177898 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f450dc6-313c-41eb-b09c-fe33578efc9e None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:59.179837 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-7f450dc6-313c-41eb-b09c-fe33578efc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:59.187487 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5166e52-8545-4248-adc0-d2d6400e1306 service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:52:59.196244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5166e52-8545-4248-adc0-d2d6400e1306 service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:59.201251 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a47aa-2d93-4287-a468-07325c6a0d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:59.201912 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a47aa-2d93-4287-a468-07325c6a0d4d service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:59.202165 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a47aa-2d93-4287-a468-07325c6a0d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:59.202424 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a47aa-2d93-4287-a468-07325c6a0d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:59.204487 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-545a47aa-2d93-4287-a468-07325c6a0d4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:59.249677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f450dc6-313c-41eb-b09c-fe33578efc9e None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:52:59.254901 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caed0ac-f413-4065-81f0-6b8c3e0f0653 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6aa01ebd7314f30a1c729ff2b50c975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:52:59.255734 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caed0ac-f413-4065-81f0-6b8c3e0f0653 service placement] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:52:59.256073 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caed0ac-f413-4065-81f0-6b8c3e0f0653 service placement] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:52:59.256754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caed0ac-f413-4065-81f0-6b8c3e0f0653 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:52:59.258295 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-0caed0ac-f413-4065-81f0-6b8c3e0f0653 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:52:59.269811 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caed0ac-f413-4065-81f0-6b8c3e0f0653 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:59.271405 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caed0ac-f413-4065-81f0-6b8c3e0f0653 service placement] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:59.281317 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a47aa-2d93-4287-a468-07325c6a0d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:52:59.281487 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1284/2556] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:52:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:52:59.282973 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a47aa-2d93-4287-a468-07325c6a0d4d service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:52:59.294383 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1273/2557] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:52:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:53:00.473377 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e2f97-115e-4676-a3fc-61f3cf5b915a None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:53:00.473907 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e2f97-115e-4676-a3fc-61f3cf5b915a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:53:00.474009 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e2f97-115e-4676-a3fc-61f3cf5b915a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:53:00.491413 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-1b4e2f97-115e-4676-a3fc-61f3cf5b915a None None] MFA Rules not processed for user `44e5602fd019411aa8f0e091ed533ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:53:00.492649 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-1b4e2f97-115e-4676-a3fc-61f3cf5b915a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:53:00.500294 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1285/2558] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jan 10 12:53:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:53:00.513490 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a47aa-2d93-4287-a468-07325c6a0d4d service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:53:00.524855 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a47aa-2d93-4287-a468-07325c6a0d4d service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:53:00.529978 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e71718-2b6a-434d-9129-40dc4cea46a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd898c7c2974bb38998ebad22fd5a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:53:00.530620 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e71718-2b6a-434d-9129-40dc4cea46a2 service swift] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:53:00.530915 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e71718-2b6a-434d-9129-40dc4cea46a2 service swift] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:53:00.531159 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e71718-2b6a-434d-9129-40dc4cea46a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:53:00.539670 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e71718-2b6a-434d-9129-40dc4cea46a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:53:00.541249 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e71718-2b6a-434d-9129-40dc4cea46a2 service swift] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:53:00.549345 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1274/2559] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jan 10 12:53:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:53:08.707706 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e2f97-115e-4676-a3fc-61f3cf5b915a None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:53:08.710076 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-1b4e2f97-115e-4676-a3fc-61f3cf5b915a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:53:08.745334 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e2f97-115e-4676-a3fc-61f3cf5b915a None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:53:08.753437 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded3c62-5893-432b-90f9-4d3f8f0117b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:53:08.754741 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded3c62-5893-432b-90f9-4d3f8f0117b4 service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:53:08.756595 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded3c62-5893-432b-90f9-4d3f8f0117b4 service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:53:08.757499 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded3c62-5893-432b-90f9-4d3f8f0117b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:53:08.760268 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-5ded3c62-5893-432b-90f9-4d3f8f0117b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:53:08.775483 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded3c62-5893-432b-90f9-4d3f8f0117b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:53:08.777465 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ded3c62-5893-432b-90f9-4d3f8f0117b4 service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:53:08.789595 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1286/2560] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:53:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:53:14.322993 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e71718-2b6a-434d-9129-40dc4cea46a2 service swift] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:53:14.335993 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e71718-2b6a-434d-9129-40dc4cea46a2 service swift] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:53:14.342458 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b488686-bd24-4656-a0e7-e1d98fd9479b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:53:14.343103 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b488686-bd24-4656-a0e7-e1d98fd9479b service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:53:14.343380 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b488686-bd24-4656-a0e7-e1d98fd9479b service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:53:14.343678 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b488686-bd24-4656-a0e7-e1d98fd9479b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:53:14.345709 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9b488686-bd24-4656-a0e7-e1d98fd9479b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:53:14.358378 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b488686-bd24-4656-a0e7-e1d98fd9479b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:53:14.360007 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b488686-bd24-4656-a0e7-e1d98fd9479b service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:53:14.372539 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1275/2561] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:53:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:53:27.072354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded3c62-5893-432b-90f9-4d3f8f0117b4 service nova] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:53:27.087806 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded3c62-5893-432b-90f9-4d3f8f0117b4 service nova] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:53:27.092702 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46fa27-7f5c-4dfe-9463-7e50d508ec71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:53:27.093351 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46fa27-7f5c-4dfe-9463-7e50d508ec71 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:53:27.093627 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46fa27-7f5c-4dfe-9463-7e50d508ec71 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:53:27.093911 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46fa27-7f5c-4dfe-9463-7e50d508ec71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:53:27.104259 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46fa27-7f5c-4dfe-9463-7e50d508ec71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:53:27.105704 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46fa27-7f5c-4dfe-9463-7e50d508ec71 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:53:27.115531 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1287/2562] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:53:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:53:28.753798 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a8e4f-20e8-4edc-ad29-f077da0e19e9 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:53:28.754373 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a8e4f-20e8-4edc-ad29-f077da0e19e9 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:53:28.754373 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a8e4f-20e8-4edc-ad29-f077da0e19e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:53:28.774543 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-474a8e4f-20e8-4edc-ad29-f077da0e19e9 None None] MFA Rules not processed for user `44e5602fd019411aa8f0e091ed533ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:53:28.776529 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-474a8e4f-20e8-4edc-ad29-f077da0e19e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:53:28.783912 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1276/2563] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jan 10 12:53:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:53:28.797426 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46fa27-7f5c-4dfe-9463-7e50d508ec71 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:53:28.811357 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46fa27-7f5c-4dfe-9463-7e50d508ec71 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:53:28.818315 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d81bf4-6fee-49b1-801b-fdedacc18d11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd898c7c2974bb38998ebad22fd5a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:53:28.818987 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d81bf4-6fee-49b1-801b-fdedacc18d11 service swift] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:53:28.819346 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d81bf4-6fee-49b1-801b-fdedacc18d11 service swift] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:53:28.819712 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d81bf4-6fee-49b1-801b-fdedacc18d11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:53:28.830352 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d81bf4-6fee-49b1-801b-fdedacc18d11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:53:28.832025 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d81bf4-6fee-49b1-801b-fdedacc18d11 service swift] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:53:28.841509 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1288/2564] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jan 10 12:53:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:53:29.195173 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a8e4f-20e8-4edc-ad29-f077da0e19e9 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:53:29.196667 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-474a8e4f-20e8-4edc-ad29-f077da0e19e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:53:29.218752 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a8e4f-20e8-4edc-ad29-f077da0e19e9 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:53:29.227241 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c4245-ce47-45c9-93cc-ca41c4adc9ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:53:29.228273 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c4245-ce47-45c9-93cc-ca41c4adc9ed service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:53:29.228910 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c4245-ce47-45c9-93cc-ca41c4adc9ed service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:53:29.229596 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c4245-ce47-45c9-93cc-ca41c4adc9ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:53:29.232081 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-ea6c4245-ce47-45c9-93cc-ca41c4adc9ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:53:29.251408 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c4245-ce47-45c9-93cc-ca41c4adc9ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:53:29.256620 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c4245-ce47-45c9-93cc-ca41c4adc9ed service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:53:29.282660 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1277/2565] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:53:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:53:40.500538 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed65e5-6b26-4042-82b5-7d8221176bd1 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:53:40.501471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed65e5-6b26-4042-82b5-7d8221176bd1 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:53:40.501744 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed65e5-6b26-4042-82b5-7d8221176bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:53:40.525492 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-72ed65e5-6b26-4042-82b5-7d8221176bd1 None None] MFA Rules not processed for user `ffd65d5f1d484d48a3ed84cf1592956c`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:53:40.526829 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-72ed65e5-6b26-4042-82b5-7d8221176bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:53:40.597576 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1289/2566] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:53:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:53:40.964584 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c4245-ce47-45c9-93cc-ca41c4adc9ed service nova] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:53:40.974685 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c4245-ce47-45c9-93cc-ca41c4adc9ed service nova] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:53:40.978977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f708e-5c7b-49f7-a791-3ea141f6cdc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:53:40.979981 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f708e-5c7b-49f7-a791-3ea141f6cdc6 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:53:40.980507 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f708e-5c7b-49f7-a791-3ea141f6cdc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:53:40.980879 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f708e-5c7b-49f7-a791-3ea141f6cdc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:53:40.982844 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-ef5f708e-5c7b-49f7-a791-3ea141f6cdc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:53:40.993198 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f708e-5c7b-49f7-a791-3ea141f6cdc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:53:40.995077 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f708e-5c7b-49f7-a791-3ea141f6cdc6 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:53:41.007996 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1278/2567] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:53:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:53:42.722674 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05592855-2b02-48bd-9df9-7ce1627d6b10 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:53:42.723755 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05592855-2b02-48bd-9df9-7ce1627d6b10 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:53:42.724252 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05592855-2b02-48bd-9df9-7ce1627d6b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:53:42.746593 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-05592855-2b02-48bd-9df9-7ce1627d6b10 None None] MFA Rules not processed for user `9bbc10f093cd4a3f9de4d874cfa8b831`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:53:42.747989 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-05592855-2b02-48bd-9df9-7ce1627d6b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:53:42.813319 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1290/2568] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:53:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:53:43.950076 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf1bc2-862d-4fb2-bb2e-e2bd9e5ef33a None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:53:43.950646 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf1bc2-862d-4fb2-bb2e-e2bd9e5ef33a None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:53:43.950646 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf1bc2-862d-4fb2-bb2e-e2bd9e5ef33a None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:53:43.952883 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1279/2569] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jan 10 12:53:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:53:43.958602 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f09a4-a846-4119-b09b-b684d8a78e21 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:53:43.959182 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f09a4-a846-4119-b09b-b684d8a78e21 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:53:43.959182 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f09a4-a846-4119-b09b-b684d8a78e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:53:44.027176 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-363f09a4-a846-4119-b09b-b684d8a78e21 None None] MFA Rules not processed for user `d68fa8e4f3a341a5b74ee32c85e59869`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:53:44.028536 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-363f09a4-a846-4119-b09b-b684d8a78e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:53:44.048354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1291/2570] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jan 10 12:53:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:53:44.073592 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf1bc2-862d-4fb2-bb2e-e2bd9e5ef33a None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:53:44.088273 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf1bc2-862d-4fb2-bb2e-e2bd9e5ef33a None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:53:44.093655 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e1845-7cf7-4673-8891-0d8929122f04 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f812f38c242d4530b3fc73013f66c9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:53:44.095755 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e1845-7cf7-4673-8891-0d8929122f04 service glance] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:53:44.096293 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e1845-7cf7-4673-8891-0d8929122f04 service glance] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:53:44.096718 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e1845-7cf7-4673-8891-0d8929122f04 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:53:44.115886 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e1845-7cf7-4673-8891-0d8929122f04 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:53:44.117535 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e1845-7cf7-4673-8891-0d8929122f04 service glance] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:53:44.135806 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1280/2571] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:53:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:53:44.231198 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3289bb0-d163-48a8-b76a-2a49a0f41d48 None None] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:53:44.231624 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3289bb0-d163-48a8-b76a-2a49a0f41d48 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:53:44.232158 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3289bb0-d163-48a8-b76a-2a49a0f41d48 None None] PATH_INFO: `/` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:53:44.235438 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1292/2572] 10.222.0.13 () {54 vars in 921 bytes} [Mon Jan 10 12:53:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:53:44.241811 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046de5a4-113d-4415-a7d7-a9c4dcb555a9 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:53:44.242157 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046de5a4-113d-4415-a7d7-a9c4dcb555a9 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:53:44.242561 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046de5a4-113d-4415-a7d7-a9c4dcb555a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:53:44.280834 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-046de5a4-113d-4415-a7d7-a9c4dcb555a9 None None] MFA Rules not processed for user `fa3a96ff9ab74aeb88465b14de3038eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:53:44.282771 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-046de5a4-113d-4415-a7d7-a9c4dcb555a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:53:44.293289 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1281/2573] 10.222.0.13 () {58 vars in 1018 bytes} [Mon Jan 10 12:53:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:53:44.305843 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3289bb0-d163-48a8-b76a-2a49a0f41d48 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:53:44.322829 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3289bb0-d163-48a8-b76a-2a49a0f41d48 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:53:44.331788 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df3158-75ac-461d-9602-889e90aca004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:53:44.332619 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df3158-75ac-461d-9602-889e90aca004 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:53:44.332900 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df3158-75ac-461d-9602-889e90aca004 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:53:44.333169 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df3158-75ac-461d-9602-889e90aca004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:53:44.344171 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df3158-75ac-461d-9602-889e90aca004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:53:44.346003 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df3158-75ac-461d-9602-889e90aca004 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:53:44.375572 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1293/2574] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:53:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:53:46.726257 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153e5de-3891-403b-ba68-23540490c1e0 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:53:46.726750 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153e5de-3891-403b-ba68-23540490c1e0 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:53:46.726846 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153e5de-3891-403b-ba68-23540490c1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:53:46.746329 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-c153e5de-3891-403b-ba68-23540490c1e0 None None] MFA Rules not processed for user `44e5602fd019411aa8f0e091ed533ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:53:46.747565 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-c153e5de-3891-403b-ba68-23540490c1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:53:46.754518 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1282/2575] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jan 10 12:53:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:53:46.766661 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df3158-75ac-461d-9602-889e90aca004 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:53:46.779429 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df3158-75ac-461d-9602-889e90aca004 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:53:46.784501 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d27aa2-9f99-4a39-b713-15b78050adc3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd898c7c2974bb38998ebad22fd5a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:53:46.785157 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d27aa2-9f99-4a39-b713-15b78050adc3 service swift] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:53:46.785438 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d27aa2-9f99-4a39-b713-15b78050adc3 service swift] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:53:46.785710 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d27aa2-9f99-4a39-b713-15b78050adc3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:53:46.794136 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d27aa2-9f99-4a39-b713-15b78050adc3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:53:46.795779 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d27aa2-9f99-4a39-b713-15b78050adc3 service swift] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:53:46.803920 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1294/2576] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jan 10 12:53:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:53:59.082979 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153e5de-3891-403b-ba68-23540490c1e0 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:53:59.099950 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153e5de-3891-403b-ba68-23540490c1e0 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:53:59.108556 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceabce-8890-4d91-9ce8-1b5821077c2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:53:59.109282 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceabce-8890-4d91-9ce8-1b5821077c2b service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:53:59.109626 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceabce-8890-4d91-9ce8-1b5821077c2b service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:53:59.109955 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceabce-8890-4d91-9ce8-1b5821077c2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:53:59.112254 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9bceabce-8890-4d91-9ce8-1b5821077c2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:53:59.123650 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bceabce-8890-4d91-9ce8-1b5821077c2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:53:59.125306 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bceabce-8890-4d91-9ce8-1b5821077c2b service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:53:59.134579 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1283/2577] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:53:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:54:04.454832 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f79e49-87cf-4083-b17b-0fef7fcfee15 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:04.455395 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f79e49-87cf-4083-b17b-0fef7fcfee15 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:04.455395 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f79e49-87cf-4083-b17b-0fef7fcfee15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:04.474085 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-61f79e49-87cf-4083-b17b-0fef7fcfee15 None None] MFA Rules not processed for user `44e5602fd019411aa8f0e091ed533ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:54:04.475309 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-61f79e49-87cf-4083-b17b-0fef7fcfee15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:54:04.483992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1295/2578] 10.222.0.13 () {58 vars in 967 bytes} [Mon Jan 10 12:54:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:54:04.508307 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceabce-8890-4d91-9ce8-1b5821077c2b service nova] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:04.519862 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceabce-8890-4d91-9ce8-1b5821077c2b service nova] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:04.525549 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ae0d0-219e-4384-8bd4-420f9c2621c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd898c7c2974bb38998ebad22fd5a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:04.526193 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ae0d0-219e-4384-8bd4-420f9c2621c6 service swift] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:04.526732 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ae0d0-219e-4384-8bd4-420f9c2621c6 service swift] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:04.527006 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ae0d0-219e-4384-8bd4-420f9c2621c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:04.535720 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ae0d0-219e-4384-8bd4-420f9c2621c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:04.537294 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ae0d0-219e-4384-8bd4-420f9c2621c6 service swift] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:04.546277 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1284/2579] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jan 10 12:54:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:54:53.080500 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f79e49-87cf-4083-b17b-0fef7fcfee15 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:53.090427 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f79e49-87cf-4083-b17b-0fef7fcfee15 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:53.094245 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf828c32-f887-4848-aa6d-d4466b7024d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:53.094885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf828c32-f887-4848-aa6d-d4466b7024d5 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:53.095168 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf828c32-f887-4848-aa6d-d4466b7024d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:53.095445 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf828c32-f887-4848-aa6d-d4466b7024d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:53.097393 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-cf828c32-f887-4848-aa6d-d4466b7024d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:54:53.163575 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf828c32-f887-4848-aa6d-d4466b7024d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:53.165037 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf828c32-f887-4848-aa6d-d4466b7024d5 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:53.175409 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1296/2580] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:54:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:54:56.760328 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ae0d0-219e-4384-8bd4-420f9c2621c6 service swift] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:56.762100 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-830ae0d0-219e-4384-8bd4-420f9c2621c6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:54:56.781346 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ae0d0-219e-4384-8bd4-420f9c2621c6 service swift] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:56.786649 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0f0e1-91cf-46bd-a93f-e2e67d3e1f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:56.787595 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0f0e1-91cf-46bd-a93f-e2e67d3e1f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:56.787873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0f0e1-91cf-46bd-a93f-e2e67d3e1f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:56.788138 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0f0e1-91cf-46bd-a93f-e2e67d3e1f73 admin admin] PATH_INFO: `/v3/users/8c5ac449d0494ab585c0aeccb9541016` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:56.789349 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0f0e1-91cf-46bd-a93f-e2e67d3e1f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c5ac449d0494ab585c0aeccb9541016)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:56.791364 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0f0e1-91cf-46bd-a93f-e2e67d3e1f73 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:56.851842 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-fba0f0e1-91cf-46bd-a93f-e2e67d3e1f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c5ac449d0494ab585c0aeccb9541016'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:54:56.852541 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-fba0f0e1-91cf-46bd-a93f-e2e67d3e1f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c5ac449d0494ab585c0aeccb9541016'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:54:56.853146 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-fba0f0e1-91cf-46bd-a93f-e2e67d3e1f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c5ac449d0494ab585c0aeccb9541016'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:54:56.869788 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-fba0f0e1-91cf-46bd-a93f-e2e67d3e1f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c5ac449d0494ab585c0aeccb9541016'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:54:56.879823 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-fba0f0e1-91cf-46bd-a93f-e2e67d3e1f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c5ac449d0494ab585c0aeccb9541016'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:54:56.896847 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1285/2581] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:54:56 2022] DELETE /identity/v3/users/8c5ac449d0494ab585c0aeccb9541016 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:54:57.090335 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf828c32-f887-4848-aa6d-d4466b7024d5 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:57.104222 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf828c32-f887-4848-aa6d-d4466b7024d5 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:57.164709 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8025aa-217c-4b20-af54-d0072f5659c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:57.165575 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8025aa-217c-4b20-af54-d0072f5659c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:57.165855 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8025aa-217c-4b20-af54-d0072f5659c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:57.166123 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8025aa-217c-4b20-af54-d0072f5659c7 admin admin] PATH_INFO: `/v3/projects/4be23531f9014bfebfd2d51c8502d6ce` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:57.167342 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8025aa-217c-4b20-af54-d0072f5659c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4be23531f9014bfebfd2d51c8502d6ce)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:57.169348 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8025aa-217c-4b20-af54-d0072f5659c7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:57.216339 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-6d8025aa-217c-4b20-af54-d0072f5659c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4be23531f9014bfebfd2d51c8502d6ce', 'request_id': 'req-6d8025aa-217c-4b20-af54-d0072f5659c7'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:54:57.222245 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-6d8025aa-217c-4b20-af54-d0072f5659c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4be23531f9014bfebfd2d51c8502d6ce', 'request_id': 'req-6d8025aa-217c-4b20-af54-d0072f5659c7'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:54:57.230166 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-6d8025aa-217c-4b20-af54-d0072f5659c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4be23531f9014bfebfd2d51c8502d6ce', 'request_id': 'req-6d8025aa-217c-4b20-af54-d0072f5659c7'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:54:57.241070 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-6d8025aa-217c-4b20-af54-d0072f5659c7 admin admin] The token cache is being invalidate because project 4be23531f9014bfebfd2d51c8502d6ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:54:57.241354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-6d8025aa-217c-4b20-af54-d0072f5659c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:54:57.241989 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-6d8025aa-217c-4b20-af54-d0072f5659c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:54:57.243646 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1297/2582] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:54:57 2022] DELETE /identity/v3/projects/4be23531f9014bfebfd2d51c8502d6ce => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:54:57.249519 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e460f7-e3c8-43f5-959b-bfaf6032cd18 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:57.249839 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e460f7-e3c8-43f5-959b-bfaf6032cd18 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:57.250135 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e460f7-e3c8-43f5-959b-bfaf6032cd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:57.269074 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-e1e460f7-e3c8-43f5-959b-bfaf6032cd18 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:54:57.270266 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e1e460f7-e3c8-43f5-959b-bfaf6032cd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:54:57.337859 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1286/2583] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:54:57.346142 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8922b-66b7-44f9-b2c6-d4f5f17d47cd None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:57.346426 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8922b-66b7-44f9-b2c6-d4f5f17d47cd None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:57.346708 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8922b-66b7-44f9-b2c6-d4f5f17d47cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:57.366963 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-a1b8922b-66b7-44f9-b2c6-d4f5f17d47cd None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:54:57.368208 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-a1b8922b-66b7-44f9-b2c6-d4f5f17d47cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:54:57.377578 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1298/2584] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:54:57.382056 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e460f7-e3c8-43f5-959b-bfaf6032cd18 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:57.391985 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e460f7-e3c8-43f5-959b-bfaf6032cd18 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:57.396759 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad5128-bcbf-4bbe-888b-5b5cec364f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:57.397419 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad5128-bcbf-4bbe-888b-5b5cec364f0c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:57.397694 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad5128-bcbf-4bbe-888b-5b5cec364f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:57.397965 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad5128-bcbf-4bbe-888b-5b5cec364f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:57.398700 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad5128-bcbf-4bbe-888b-5b5cec364f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:54:57.399002 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad5128-bcbf-4bbe-888b-5b5cec364f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:57.400644 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad5128-bcbf-4bbe-888b-5b5cec364f0c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:57.412612 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1287/2585] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:54:57.417035 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8922b-66b7-44f9-b2c6-d4f5f17d47cd None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:57.428120 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8922b-66b7-44f9-b2c6-d4f5f17d47cd None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:57.434332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815e4f2-21d4-44fa-9350-409c2ca61d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:57.434984 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815e4f2-21d4-44fa-9350-409c2ca61d22 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:57.435261 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815e4f2-21d4-44fa-9350-409c2ca61d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:57.435573 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815e4f2-21d4-44fa-9350-409c2ca61d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:57.436275 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815e4f2-21d4-44fa-9350-409c2ca61d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:57.438170 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815e4f2-21d4-44fa-9350-409c2ca61d22 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:57.477510 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1299/2586] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:54:57 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:54:57.484092 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad5128-bcbf-4bbe-888b-5b5cec364f0c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:57.495098 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad5128-bcbf-4bbe-888b-5b5cec364f0c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:57.558181 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09fd96-81b6-4ccd-8e1d-76b3ca1c16cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:57.559471 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09fd96-81b6-4ccd-8e1d-76b3ca1c16cf admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:57.560012 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09fd96-81b6-4ccd-8e1d-76b3ca1c16cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:57.560295 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09fd96-81b6-4ccd-8e1d-76b3ca1c16cf admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:57.561035 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09fd96-81b6-4ccd-8e1d-76b3ca1c16cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:57.562960 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09fd96-81b6-4ccd-8e1d-76b3ca1c16cf admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:57.585158 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1288/2587] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:54:57 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:54:57.589414 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815e4f2-21d4-44fa-9350-409c2ca61d22 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:57.601399 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815e4f2-21d4-44fa-9350-409c2ca61d22 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:57.609261 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324dbf78-64a3-4860-a121-f383a87ef96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:57.610410 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dbf78-64a3-4860-a121-f383a87ef96a admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:57.610876 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dbf78-64a3-4860-a121-f383a87ef96a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:57.611285 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324dbf78-64a3-4860-a121-f383a87ef96a admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:57.612261 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324dbf78-64a3-4860-a121-f383a87ef96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:57.615159 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324dbf78-64a3-4860-a121-f383a87ef96a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:57.628734 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1300/2588] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:54:57.633008 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09fd96-81b6-4ccd-8e1d-76b3ca1c16cf admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:57.643966 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09fd96-81b6-4ccd-8e1d-76b3ca1c16cf admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:57.649482 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba321a8-321e-43c2-b934-db80d41a72b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:57.650182 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba321a8-321e-43c2-b934-db80d41a72b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:57.650498 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba321a8-321e-43c2-b934-db80d41a72b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:57.650771 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba321a8-321e-43c2-b934-db80d41a72b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:57.651507 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba321a8-321e-43c2-b934-db80d41a72b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:57.653712 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba321a8-321e-43c2-b934-db80d41a72b6 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:57.664507 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1289/2589] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:54:57.669385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324dbf78-64a3-4860-a121-f383a87ef96a admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:57.679405 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324dbf78-64a3-4860-a121-f383a87ef96a admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:57.685377 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dc368-7a89-4531-b315-a22f061f2b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:57.686291 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dc368-7a89-4531-b315-a22f061f2b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:57.686568 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dc368-7a89-4531-b315-a22f061f2b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:57.686833 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dc368-7a89-4531-b315-a22f061f2b64 admin admin] PATH_INFO: `/v3/projects/e3aa00cbd32a401d975dd66d0de08102/users/eaea6ac623fb43f2ae79d5dfa449c3d6/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:57.702072 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594dc368-7a89-4531-b315-a22f061f2b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3aa00cbd32a401d975dd66d0de08102, user_id=eaea6ac623fb43f2ae79d5dfa449c3d6, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:57.704803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594dc368-7a89-4531-b315-a22f061f2b64 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:57.719020 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1301/2590] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:54:57 2022] PUT /identity/v3/projects/e3aa00cbd32a401d975dd66d0de08102/users/eaea6ac623fb43f2ae79d5dfa449c3d6/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:54:57.730344 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37633f8b-774d-4d38-b044-0bc3b3dd5c5c None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:57.730598 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37633f8b-774d-4d38-b044-0bc3b3dd5c5c None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:57.730873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37633f8b-774d-4d38-b044-0bc3b3dd5c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:57.759082 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-37633f8b-774d-4d38-b044-0bc3b3dd5c5c None None] MFA Rules not processed for user `eaea6ac623fb43f2ae79d5dfa449c3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:54:57.760365 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-37633f8b-774d-4d38-b044-0bc3b3dd5c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:54:57.833768 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1290/2591] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:54:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:54:57.851839 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dc368-7a89-4531-b315-a22f061f2b64 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:57.854865 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-594dc368-7a89-4531-b315-a22f061f2b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:54:57.950883 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dc368-7a89-4531-b315-a22f061f2b64 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:57.957649 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7cf0a7-cc6a-4f19-8bd5-a50ab83be135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:57.958307 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cf0a7-cc6a-4f19-8bd5-a50ab83be135 service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:57.958581 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cf0a7-cc6a-4f19-8bd5-a50ab83be135 service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:57.958850 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cf0a7-cc6a-4f19-8bd5-a50ab83be135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:57.967851 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cf0a7-cc6a-4f19-8bd5-a50ab83be135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:57.969425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7cf0a7-cc6a-4f19-8bd5-a50ab83be135 service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:57.978572 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1302/2592] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:54:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:54:58.166089 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37633f8b-774d-4d38-b044-0bc3b3dd5c5c None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:58.232574 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37633f8b-774d-4d38-b044-0bc3b3dd5c5c None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:58.238038 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae29106-b895-4d34-be85-2b1c7e313790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:58.238997 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae29106-b895-4d34-be85-2b1c7e313790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:58.239350 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae29106-b895-4d34-be85-2b1c7e313790 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:58.239738 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae29106-b895-4d34-be85-2b1c7e313790 admin admin] PATH_INFO: `/v3/users/eaea6ac623fb43f2ae79d5dfa449c3d6` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:58.241021 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae29106-b895-4d34-be85-2b1c7e313790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaea6ac623fb43f2ae79d5dfa449c3d6)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:58.243050 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae29106-b895-4d34-be85-2b1c7e313790 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:58.297061 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-0ae29106-b895-4d34-be85-2b1c7e313790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaea6ac623fb43f2ae79d5dfa449c3d6'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:54:58.298321 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-0ae29106-b895-4d34-be85-2b1c7e313790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaea6ac623fb43f2ae79d5dfa449c3d6'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:54:58.298879 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-0ae29106-b895-4d34-be85-2b1c7e313790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaea6ac623fb43f2ae79d5dfa449c3d6'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:54:58.314607 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-0ae29106-b895-4d34-be85-2b1c7e313790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaea6ac623fb43f2ae79d5dfa449c3d6'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:54:58.322729 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-0ae29106-b895-4d34-be85-2b1c7e313790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaea6ac623fb43f2ae79d5dfa449c3d6'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:54:58.338808 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1291/2593] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:54:58 2022] DELETE /identity/v3/users/eaea6ac623fb43f2ae79d5dfa449c3d6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:54:58.343916 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bcb91-1339-497b-bdac-ce015e263a48 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:58.344747 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bcb91-1339-497b-bdac-ce015e263a48 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:58.345527 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bcb91-1339-497b-bdac-ce015e263a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:58.365832 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-536bcb91-1339-497b-bdac-ce015e263a48 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:54:58.367608 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-536bcb91-1339-497b-bdac-ce015e263a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:54:58.434540 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1303/2594] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:54:58.445162 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae29106-b895-4d34-be85-2b1c7e313790 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:58.446679 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-0ae29106-b895-4d34-be85-2b1c7e313790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:54:58.506599 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae29106-b895-4d34-be85-2b1c7e313790 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:58.510890 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe175125-6951-4276-b898-63fcc8d79928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:58.511616 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe175125-6951-4276-b898-63fcc8d79928 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:58.511959 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe175125-6951-4276-b898-63fcc8d79928 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:58.512185 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe175125-6951-4276-b898-63fcc8d79928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:58.521582 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe175125-6951-4276-b898-63fcc8d79928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:58.523011 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe175125-6951-4276-b898-63fcc8d79928 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:58.532943 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1292/2595] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:54:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:54:58.802222 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bcb91-1339-497b-bdac-ce015e263a48 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:58.803682 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-536bcb91-1339-497b-bdac-ce015e263a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:54:58.818832 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bcb91-1339-497b-bdac-ce015e263a48 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:58.824351 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc78bbd-1b05-4a54-95b8-b46b6f6cf66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:58.825411 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc78bbd-1b05-4a54-95b8-b46b6f6cf66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:58.825689 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc78bbd-1b05-4a54-95b8-b46b6f6cf66b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:58.826027 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc78bbd-1b05-4a54-95b8-b46b6f6cf66b admin admin] PATH_INFO: `/v3/projects/e3aa00cbd32a401d975dd66d0de08102` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:58.827230 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc78bbd-1b05-4a54-95b8-b46b6f6cf66b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3aa00cbd32a401d975dd66d0de08102)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:58.829229 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc78bbd-1b05-4a54-95b8-b46b6f6cf66b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:58.878008 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-afc78bbd-1b05-4a54-95b8-b46b6f6cf66b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3aa00cbd32a401d975dd66d0de08102', 'request_id': 'req-afc78bbd-1b05-4a54-95b8-b46b6f6cf66b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:54:58.884083 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-afc78bbd-1b05-4a54-95b8-b46b6f6cf66b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3aa00cbd32a401d975dd66d0de08102', 'request_id': 'req-afc78bbd-1b05-4a54-95b8-b46b6f6cf66b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:54:58.894017 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-afc78bbd-1b05-4a54-95b8-b46b6f6cf66b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3aa00cbd32a401d975dd66d0de08102', 'request_id': 'req-afc78bbd-1b05-4a54-95b8-b46b6f6cf66b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:54:58.905057 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-afc78bbd-1b05-4a54-95b8-b46b6f6cf66b admin admin] The token cache is being invalidate because project e3aa00cbd32a401d975dd66d0de08102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:54:58.905346 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-afc78bbd-1b05-4a54-95b8-b46b6f6cf66b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:54:58.905981 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-afc78bbd-1b05-4a54-95b8-b46b6f6cf66b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:54:58.907550 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1304/2596] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:54:58 2022] DELETE /identity/v3/projects/e3aa00cbd32a401d975dd66d0de08102 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:54:58.913341 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad30da-48c7-4fce-9025-6f3dbb4a6f6c None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:58.913836 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad30da-48c7-4fce-9025-6f3dbb4a6f6c None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:58.913836 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad30da-48c7-4fce-9025-6f3dbb4a6f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:58.933128 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-4aad30da-48c7-4fce-9025-6f3dbb4a6f6c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:54:58.934544 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-4aad30da-48c7-4fce-9025-6f3dbb4a6f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:54:58.997732 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1293/2597] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:54:59.005891 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a1483-0a0b-462a-8fac-de3d0a87ece7 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:59.006175 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a1483-0a0b-462a-8fac-de3d0a87ece7 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:59.006445 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a1483-0a0b-462a-8fac-de3d0a87ece7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:59.026135 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-1c6a1483-0a0b-462a-8fac-de3d0a87ece7 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:54:59.027338 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-1c6a1483-0a0b-462a-8fac-de3d0a87ece7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:54:59.036800 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1305/2598] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:54:59.041138 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad30da-48c7-4fce-9025-6f3dbb4a6f6c None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:59.051559 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad30da-48c7-4fce-9025-6f3dbb4a6f6c None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:59.057444 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12450eae-c049-4af6-a2b3-d4326ec53f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:59.058105 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12450eae-c049-4af6-a2b3-d4326ec53f61 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:59.058454 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12450eae-c049-4af6-a2b3-d4326ec53f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:59.058721 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12450eae-c049-4af6-a2b3-d4326ec53f61 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:59.059596 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12450eae-c049-4af6-a2b3-d4326ec53f61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:54:59.059884 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12450eae-c049-4af6-a2b3-d4326ec53f61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:59.061498 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12450eae-c049-4af6-a2b3-d4326ec53f61 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:59.073531 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1294/2599] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:54:59.078037 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a1483-0a0b-462a-8fac-de3d0a87ece7 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:59.087356 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a1483-0a0b-462a-8fac-de3d0a87ece7 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:59.092809 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb33af-6263-46de-9364-961626c50dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:59.093461 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb33af-6263-46de-9364-961626c50dde admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:59.093734 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb33af-6263-46de-9364-961626c50dde admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:59.094001 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb33af-6263-46de-9364-961626c50dde admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:59.094698 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb33af-6263-46de-9364-961626c50dde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:59.096623 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb33af-6263-46de-9364-961626c50dde admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:59.123146 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1306/2600] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:54:59 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:54:59.127473 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12450eae-c049-4af6-a2b3-d4326ec53f61 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:59.138248 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12450eae-c049-4af6-a2b3-d4326ec53f61 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:59.195893 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac638bf-cee6-41fa-bd4c-0f3bdbb79380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:59.196565 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac638bf-cee6-41fa-bd4c-0f3bdbb79380 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:59.196846 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac638bf-cee6-41fa-bd4c-0f3bdbb79380 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:59.197116 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac638bf-cee6-41fa-bd4c-0f3bdbb79380 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:59.197815 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac638bf-cee6-41fa-bd4c-0f3bdbb79380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:59.200177 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac638bf-cee6-41fa-bd4c-0f3bdbb79380 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:59.222020 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1295/2601] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:54:59 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:54:59.226222 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb33af-6263-46de-9364-961626c50dde admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:59.237003 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb33af-6263-46de-9364-961626c50dde admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:59.242090 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55bda2-e2b0-43f3-9d82-610c066c6453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:59.242762 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55bda2-e2b0-43f3-9d82-610c066c6453 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:59.243042 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55bda2-e2b0-43f3-9d82-610c066c6453 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:59.243314 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55bda2-e2b0-43f3-9d82-610c066c6453 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:59.244134 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55bda2-e2b0-43f3-9d82-610c066c6453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:59.245720 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55bda2-e2b0-43f3-9d82-610c066c6453 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:59.256980 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1307/2602] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:54:59.261114 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac638bf-cee6-41fa-bd4c-0f3bdbb79380 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:59.271436 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac638bf-cee6-41fa-bd4c-0f3bdbb79380 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:59.277583 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381218c5-1087-4503-8e90-12794a3fcfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:59.278244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381218c5-1087-4503-8e90-12794a3fcfa8 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:59.278518 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381218c5-1087-4503-8e90-12794a3fcfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:59.278784 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381218c5-1087-4503-8e90-12794a3fcfa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:59.279557 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381218c5-1087-4503-8e90-12794a3fcfa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:59.281191 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381218c5-1087-4503-8e90-12794a3fcfa8 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:59.291672 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1296/2603] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:54:59.296258 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55bda2-e2b0-43f3-9d82-610c066c6453 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:59.306564 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55bda2-e2b0-43f3-9d82-610c066c6453 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:59.312570 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d62b6-d5d2-4f56-b155-c8182b72ee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:59.313472 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d62b6-d5d2-4f56-b155-c8182b72ee0d admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:59.313738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d62b6-d5d2-4f56-b155-c8182b72ee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:59.314011 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d62b6-d5d2-4f56-b155-c8182b72ee0d admin admin] PATH_INFO: `/v3/projects/264230796e874588b6adf053d9f2cf1b/users/e4f9e0b01a0c48cdae44bb2abf68f008/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:59.328791 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d62b6-d5d2-4f56-b155-c8182b72ee0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=264230796e874588b6adf053d9f2cf1b, user_id=e4f9e0b01a0c48cdae44bb2abf68f008, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:59.331469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d62b6-d5d2-4f56-b155-c8182b72ee0d admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:59.346336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1308/2604] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:54:59 2022] PUT /identity/v3/projects/264230796e874588b6adf053d9f2cf1b/users/e4f9e0b01a0c48cdae44bb2abf68f008/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:54:59.359172 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e60ad1-a006-4dd9-b898-25618239fe0e None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:59.359822 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e60ad1-a006-4dd9-b898-25618239fe0e None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:59.360342 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e60ad1-a006-4dd9-b898-25618239fe0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:59.402654 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-79e60ad1-a006-4dd9-b898-25618239fe0e None None] MFA Rules not processed for user `e4f9e0b01a0c48cdae44bb2abf68f008`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:54:59.403922 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-79e60ad1-a006-4dd9-b898-25618239fe0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:54:59.476403 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1297/2605] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:54:59 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:54:59.478404 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d62b6-d5d2-4f56-b155-c8182b72ee0d admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:59.551851 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d62b6-d5d2-4f56-b155-c8182b72ee0d admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:59.557561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b8464-3b58-4bd2-a01b-756ce3e5d717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:59.558226 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b8464-3b58-4bd2-a01b-756ce3e5d717 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:59.558599 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b8464-3b58-4bd2-a01b-756ce3e5d717 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:59.559426 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b8464-3b58-4bd2-a01b-756ce3e5d717 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:59.560568 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b8464-3b58-4bd2-a01b-756ce3e5d717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:59.562743 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b8464-3b58-4bd2-a01b-756ce3e5d717 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:59.594437 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1309/2606] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:54:59 2022] POST /identity/v3/projects => generated 361 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:54:59.595729 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e60ad1-a006-4dd9-b898-25618239fe0e None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:59.607790 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e60ad1-a006-4dd9-b898-25618239fe0e None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:59.673011 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ad7a3-7369-48e7-8e0e-57039a00bc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:59.673739 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad7a3-7369-48e7-8e0e-57039a00bc1a admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:59.674096 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad7a3-7369-48e7-8e0e-57039a00bc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:59.674308 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad7a3-7369-48e7-8e0e-57039a00bc1a admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:59.675023 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ad7a3-7369-48e7-8e0e-57039a00bc1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:59.677316 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ad7a3-7369-48e7-8e0e-57039a00bc1a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:59.700233 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1298/2607] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:54:59 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:54:59.704686 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b8464-3b58-4bd2-a01b-756ce3e5d717 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:59.717006 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b8464-3b58-4bd2-a01b-756ce3e5d717 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:59.723604 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58cd50-2174-4e25-a212-e11835e510a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:59.724277 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58cd50-2174-4e25-a212-e11835e510a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:59.724557 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58cd50-2174-4e25-a212-e11835e510a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:59.724825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58cd50-2174-4e25-a212-e11835e510a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:59.725563 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58cd50-2174-4e25-a212-e11835e510a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:59.727227 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58cd50-2174-4e25-a212-e11835e510a0 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:59.741664 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1310/2608] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:54:59.746623 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ad7a3-7369-48e7-8e0e-57039a00bc1a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:59.758858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ad7a3-7369-48e7-8e0e-57039a00bc1a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:59.764280 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed9ce5-f6a7-42f1-9509-84e933bf8fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:59.765038 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed9ce5-f6a7-42f1-9509-84e933bf8fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:59.765330 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed9ce5-f6a7-42f1-9509-84e933bf8fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:59.765580 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed9ce5-f6a7-42f1-9509-84e933bf8fcf admin admin] PATH_INFO: `/v3/projects/2ba5915acda44803b0967421dca66290/users/866a702ecdc1426eaecda17a2ac4e096/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:59.781518 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed9ce5-f6a7-42f1-9509-84e933bf8fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ba5915acda44803b0967421dca66290, user_id=866a702ecdc1426eaecda17a2ac4e096, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:59.784357 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed9ce5-f6a7-42f1-9509-84e933bf8fcf admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:59.799192 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1299/2609] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:54:59 2022] PUT /identity/v3/projects/2ba5915acda44803b0967421dca66290/users/866a702ecdc1426eaecda17a2ac4e096/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:54:59.802890 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58cd50-2174-4e25-a212-e11835e510a0 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:59.817041 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58cd50-2174-4e25-a212-e11835e510a0 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:59.873292 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077ee16-786c-41b5-b083-3d8d92aad3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:59.873980 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077ee16-786c-41b5-b083-3d8d92aad3fe admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:59.874254 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077ee16-786c-41b5-b083-3d8d92aad3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:59.874525 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077ee16-786c-41b5-b083-3d8d92aad3fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:59.875256 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077ee16-786c-41b5-b083-3d8d92aad3fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:59.876953 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077ee16-786c-41b5-b083-3d8d92aad3fe admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:59.891144 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1311/2610] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:54:59.892618 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed9ce5-f6a7-42f1-9509-84e933bf8fcf admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:54:59.904057 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed9ce5-f6a7-42f1-9509-84e933bf8fcf admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:54:59.909681 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9aa515-29ea-48e6-8248-dcb59d0a3444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:54:59.911252 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aa515-29ea-48e6-8248-dcb59d0a3444 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:59.911576 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aa515-29ea-48e6-8248-dcb59d0a3444 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:59.911847 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aa515-29ea-48e6-8248-dcb59d0a3444 admin admin] PATH_INFO: `/v3/projects/2ba5915acda44803b0967421dca66290/users/866a702ecdc1426eaecda17a2ac4e096/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:59.914032 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9aa515-29ea-48e6-8248-dcb59d0a3444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ba5915acda44803b0967421dca66290, user_id=866a702ecdc1426eaecda17a2ac4e096, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:54:59.916978 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9aa515-29ea-48e6-8248-dcb59d0a3444 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:54:59.929600 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1300/2611] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:54:59 2022] PUT /identity/v3/projects/2ba5915acda44803b0967421dca66290/users/866a702ecdc1426eaecda17a2ac4e096/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:54:59.942722 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1680c-afb5-41bd-8717-7ad602e87cca None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:54:59.943080 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1680c-afb5-41bd-8717-7ad602e87cca None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:54:59.943468 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1680c-afb5-41bd-8717-7ad602e87cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:54:59.976095 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-08d1680c-afb5-41bd-8717-7ad602e87cca None None] MFA Rules not processed for user `866a702ecdc1426eaecda17a2ac4e096`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:54:59.977288 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-08d1680c-afb5-41bd-8717-7ad602e87cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:00.048422 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1312/2612] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:54:59 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:00.060985 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9aa515-29ea-48e6-8248-dcb59d0a3444 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:00.062859 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5f9aa515-29ea-48e6-8248-dcb59d0a3444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:00.122159 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9aa515-29ea-48e6-8248-dcb59d0a3444 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:00.125878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c91c6-ec57-487b-8ca9-64c0810ad3c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:00.126572 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c91c6-ec57-487b-8ca9-64c0810ad3c4 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:00.126847 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c91c6-ec57-487b-8ca9-64c0810ad3c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:00.127113 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c91c6-ec57-487b-8ca9-64c0810ad3c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:00.136901 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c91c6-ec57-487b-8ca9-64c0810ad3c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:00.138272 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c91c6-ec57-487b-8ca9-64c0810ad3c4 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:00.148032 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1301/2613] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:00 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:00.323425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1680c-afb5-41bd-8717-7ad602e87cca None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:00.391118 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1680c-afb5-41bd-8717-7ad602e87cca None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:00.397899 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90aa8f-0894-467d-addb-bc20db34b582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:00.399181 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90aa8f-0894-467d-addb-bc20db34b582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:00.399555 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90aa8f-0894-467d-addb-bc20db34b582 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:00.399908 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90aa8f-0894-467d-addb-bc20db34b582 admin admin] PATH_INFO: `/v3/users/e4f9e0b01a0c48cdae44bb2abf68f008` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:00.401680 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90aa8f-0894-467d-addb-bc20db34b582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4f9e0b01a0c48cdae44bb2abf68f008)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:00.404657 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90aa8f-0894-467d-addb-bc20db34b582 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:00.463222 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fa90aa8f-0894-467d-addb-bc20db34b582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4f9e0b01a0c48cdae44bb2abf68f008'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:00.472906 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fa90aa8f-0894-467d-addb-bc20db34b582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4f9e0b01a0c48cdae44bb2abf68f008'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:00.482320 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fa90aa8f-0894-467d-addb-bc20db34b582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4f9e0b01a0c48cdae44bb2abf68f008'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:00.483144 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fa90aa8f-0894-467d-addb-bc20db34b582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4f9e0b01a0c48cdae44bb2abf68f008'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:00.484227 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fa90aa8f-0894-467d-addb-bc20db34b582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4f9e0b01a0c48cdae44bb2abf68f008'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:00.507822 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1313/2614] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:55:00 2022] DELETE /identity/v3/users/e4f9e0b01a0c48cdae44bb2abf68f008 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:00.513264 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9931440-17d6-4503-91cd-b92d579b47c0 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:00.513542 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9931440-17d6-4503-91cd-b92d579b47c0 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:00.513811 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9931440-17d6-4503-91cd-b92d579b47c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:00.532853 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-e9931440-17d6-4503-91cd-b92d579b47c0 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:00.534035 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e9931440-17d6-4503-91cd-b92d579b47c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:00.593621 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1302/2615] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:00.603614 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90aa8f-0894-467d-addb-bc20db34b582 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:00.605284 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-fa90aa8f-0894-467d-addb-bc20db34b582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:00.667616 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90aa8f-0894-467d-addb-bc20db34b582 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:00.672365 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041b6ec-3ceb-4674-a5cf-7980ad062e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:00.673021 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041b6ec-3ceb-4674-a5cf-7980ad062e6f service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:00.673295 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041b6ec-3ceb-4674-a5cf-7980ad062e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:00.673591 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041b6ec-3ceb-4674-a5cf-7980ad062e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:00.684065 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041b6ec-3ceb-4674-a5cf-7980ad062e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:00.685792 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041b6ec-3ceb-4674-a5cf-7980ad062e6f service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:00.694963 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1314/2616] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:00.995629 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9931440-17d6-4503-91cd-b92d579b47c0 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:00.997163 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e9931440-17d6-4503-91cd-b92d579b47c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:01.009740 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9931440-17d6-4503-91cd-b92d579b47c0 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:01.014851 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363b0e2-790d-498a-b7db-b1e153cee23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:01.015915 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363b0e2-790d-498a-b7db-b1e153cee23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:01.016724 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363b0e2-790d-498a-b7db-b1e153cee23d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:01.017016 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363b0e2-790d-498a-b7db-b1e153cee23d admin admin] PATH_INFO: `/v3/projects/264230796e874588b6adf053d9f2cf1b` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:01.018572 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363b0e2-790d-498a-b7db-b1e153cee23d admin admin] RBAC: Authorizing `identity:delete_project(project_id=264230796e874588b6adf053d9f2cf1b)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:01.020469 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363b0e2-790d-498a-b7db-b1e153cee23d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:01.069238 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4363b0e2-790d-498a-b7db-b1e153cee23d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '264230796e874588b6adf053d9f2cf1b', 'request_id': 'req-4363b0e2-790d-498a-b7db-b1e153cee23d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:01.078431 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4363b0e2-790d-498a-b7db-b1e153cee23d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '264230796e874588b6adf053d9f2cf1b', 'request_id': 'req-4363b0e2-790d-498a-b7db-b1e153cee23d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:01.086096 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4363b0e2-790d-498a-b7db-b1e153cee23d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '264230796e874588b6adf053d9f2cf1b', 'request_id': 'req-4363b0e2-790d-498a-b7db-b1e153cee23d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:01.103822 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4363b0e2-790d-498a-b7db-b1e153cee23d admin admin] The token cache is being invalidate because project 264230796e874588b6adf053d9f2cf1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:55:01.104143 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4363b0e2-790d-498a-b7db-b1e153cee23d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:01.105129 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4363b0e2-790d-498a-b7db-b1e153cee23d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:01.107365 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1303/2617] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:55:00 2022] DELETE /identity/v3/projects/264230796e874588b6adf053d9f2cf1b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:01.111726 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041b6ec-3ceb-4674-a5cf-7980ad062e6f service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:01.122231 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041b6ec-3ceb-4674-a5cf-7980ad062e6f service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:01.183186 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ceacb-bf07-4acc-8b5b-a7773c26253f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:01.184084 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ceacb-bf07-4acc-8b5b-a7773c26253f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:01.184334 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ceacb-bf07-4acc-8b5b-a7773c26253f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:01.184599 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ceacb-bf07-4acc-8b5b-a7773c26253f admin admin] PATH_INFO: `/v3/users/866a702ecdc1426eaecda17a2ac4e096` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:01.185944 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ceacb-bf07-4acc-8b5b-a7773c26253f admin admin] RBAC: Authorizing `identity:delete_user(user_id=866a702ecdc1426eaecda17a2ac4e096)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:01.188400 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ceacb-bf07-4acc-8b5b-a7773c26253f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:01.240678 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f46ceacb-bf07-4acc-8b5b-a7773c26253f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '866a702ecdc1426eaecda17a2ac4e096'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:01.247789 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f46ceacb-bf07-4acc-8b5b-a7773c26253f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '866a702ecdc1426eaecda17a2ac4e096'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:01.256827 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f46ceacb-bf07-4acc-8b5b-a7773c26253f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '866a702ecdc1426eaecda17a2ac4e096'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:01.257843 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f46ceacb-bf07-4acc-8b5b-a7773c26253f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '866a702ecdc1426eaecda17a2ac4e096'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:01.258708 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-f46ceacb-bf07-4acc-8b5b-a7773c26253f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '866a702ecdc1426eaecda17a2ac4e096'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:01.279117 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1315/2618] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:55:01 2022] DELETE /identity/v3/users/866a702ecdc1426eaecda17a2ac4e096 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:01.677851 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363b0e2-790d-498a-b7db-b1e153cee23d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:01.680187 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-4363b0e2-790d-498a-b7db-b1e153cee23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:01.694029 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363b0e2-790d-498a-b7db-b1e153cee23d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:01.759175 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a28f24-4d14-45ef-b798-d830eabfa82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:01.760397 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a28f24-4d14-45ef-b798-d830eabfa82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:01.760900 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a28f24-4d14-45ef-b798-d830eabfa82b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:01.761352 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a28f24-4d14-45ef-b798-d830eabfa82b admin admin] PATH_INFO: `/v3/projects/2ba5915acda44803b0967421dca66290` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:01.762796 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a28f24-4d14-45ef-b798-d830eabfa82b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ba5915acda44803b0967421dca66290)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:01.764945 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a28f24-4d14-45ef-b798-d830eabfa82b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:01.816593 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a5a28f24-4d14-45ef-b798-d830eabfa82b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ba5915acda44803b0967421dca66290', 'request_id': 'req-a5a28f24-4d14-45ef-b798-d830eabfa82b'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:01.825221 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a5a28f24-4d14-45ef-b798-d830eabfa82b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ba5915acda44803b0967421dca66290', 'request_id': 'req-a5a28f24-4d14-45ef-b798-d830eabfa82b'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:01.831977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a5a28f24-4d14-45ef-b798-d830eabfa82b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ba5915acda44803b0967421dca66290', 'request_id': 'req-a5a28f24-4d14-45ef-b798-d830eabfa82b'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:01.844730 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a5a28f24-4d14-45ef-b798-d830eabfa82b admin admin] The token cache is being invalidate because project 2ba5915acda44803b0967421dca66290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:55:01.845024 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a5a28f24-4d14-45ef-b798-d830eabfa82b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:01.845664 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a5a28f24-4d14-45ef-b798-d830eabfa82b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:01.847412 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1304/2619] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:55:01 2022] DELETE /identity/v3/projects/2ba5915acda44803b0967421dca66290 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:01.853558 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa99097-3841-4fdc-9398-57a5e18420a2 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:01.854054 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa99097-3841-4fdc-9398-57a5e18420a2 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:01.854173 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa99097-3841-4fdc-9398-57a5e18420a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:01.874719 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-cfa99097-3841-4fdc-9398-57a5e18420a2 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:01.876015 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-cfa99097-3841-4fdc-9398-57a5e18420a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:01.950564 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1316/2620] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:01.958538 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ce78c-6cac-4e40-ba1d-83cd932a208e None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:01.958847 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ce78c-6cac-4e40-ba1d-83cd932a208e None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:01.959119 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ce78c-6cac-4e40-ba1d-83cd932a208e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:01.982717 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-ff5ce78c-6cac-4e40-ba1d-83cd932a208e None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:01.984061 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-ff5ce78c-6cac-4e40-ba1d-83cd932a208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:01.996621 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1305/2621] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:02.001205 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa99097-3841-4fdc-9398-57a5e18420a2 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:02.010896 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa99097-3841-4fdc-9398-57a5e18420a2 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:02.015843 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e88464-e86e-4bda-b805-13be0b772b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:02.016524 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e88464-e86e-4bda-b805-13be0b772b3f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:02.016803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e88464-e86e-4bda-b805-13be0b772b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:02.017074 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e88464-e86e-4bda-b805-13be0b772b3f admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:02.017853 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e88464-e86e-4bda-b805-13be0b772b3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:55:02.018155 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e88464-e86e-4bda-b805-13be0b772b3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:02.019810 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e88464-e86e-4bda-b805-13be0b772b3f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:02.036058 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1317/2622] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:55:02.037867 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ce78c-6cac-4e40-ba1d-83cd932a208e None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:02.049192 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ce78c-6cac-4e40-ba1d-83cd932a208e None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:02.054539 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6edf0b-1fc9-4abc-a439-be75b322a38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:02.055209 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6edf0b-1fc9-4abc-a439-be75b322a38f admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:02.055479 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6edf0b-1fc9-4abc-a439-be75b322a38f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:02.055777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6edf0b-1fc9-4abc-a439-be75b322a38f admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:02.056481 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6edf0b-1fc9-4abc-a439-be75b322a38f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:02.058904 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6edf0b-1fc9-4abc-a439-be75b322a38f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:02.086432 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1306/2623] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:55:02 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:02.090936 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e88464-e86e-4bda-b805-13be0b772b3f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:02.101303 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e88464-e86e-4bda-b805-13be0b772b3f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:02.159007 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa168980-ba93-4dd1-b28f-9adab0cc54fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:02.159738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa168980-ba93-4dd1-b28f-9adab0cc54fe admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:02.160022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa168980-ba93-4dd1-b28f-9adab0cc54fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:02.160290 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa168980-ba93-4dd1-b28f-9adab0cc54fe admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:02.161002 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa168980-ba93-4dd1-b28f-9adab0cc54fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:02.162935 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa168980-ba93-4dd1-b28f-9adab0cc54fe admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:02.184027 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1318/2624] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:55:02 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:02.188260 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6edf0b-1fc9-4abc-a439-be75b322a38f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:02.209392 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6edf0b-1fc9-4abc-a439-be75b322a38f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:02.214948 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4d4f4-0890-4035-971c-d7c2da6cd747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:02.215742 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4d4f4-0890-4035-971c-d7c2da6cd747 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:02.216031 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4d4f4-0890-4035-971c-d7c2da6cd747 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:02.216770 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4d4f4-0890-4035-971c-d7c2da6cd747 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:02.217048 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4d4f4-0890-4035-971c-d7c2da6cd747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:02.218695 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4d4f4-0890-4035-971c-d7c2da6cd747 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:02.231691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1307/2625] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:02.234694 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa168980-ba93-4dd1-b28f-9adab0cc54fe admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:02.248751 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa168980-ba93-4dd1-b28f-9adab0cc54fe admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:02.253941 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9996a-6442-4245-9260-5117e8b6d029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:02.254619 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9996a-6442-4245-9260-5117e8b6d029 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:02.254954 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9996a-6442-4245-9260-5117e8b6d029 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:02.255223 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9996a-6442-4245-9260-5117e8b6d029 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:02.256266 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9996a-6442-4245-9260-5117e8b6d029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:02.257996 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9996a-6442-4245-9260-5117e8b6d029 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:02.270445 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1319/2626] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:02.274661 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4d4f4-0890-4035-971c-d7c2da6cd747 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:02.289494 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4d4f4-0890-4035-971c-d7c2da6cd747 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:02.295816 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac4dd8-840f-470f-95e6-baa51202acaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:02.297396 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac4dd8-840f-470f-95e6-baa51202acaa admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:02.297953 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac4dd8-840f-470f-95e6-baa51202acaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:02.298238 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac4dd8-840f-470f-95e6-baa51202acaa admin admin] PATH_INFO: `/v3/projects/e73902d7c4b5484087c1b95f4c1fea9d/users/16c3c9346c864b85a2f0c45ba1496e58/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:02.317585 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac4dd8-840f-470f-95e6-baa51202acaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e73902d7c4b5484087c1b95f4c1fea9d, user_id=16c3c9346c864b85a2f0c45ba1496e58, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:02.320256 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac4dd8-840f-470f-95e6-baa51202acaa admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:02.333339 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1308/2627] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:02 2022] PUT /identity/v3/projects/e73902d7c4b5484087c1b95f4c1fea9d/users/16c3c9346c864b85a2f0c45ba1496e58/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:02.344038 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06217de-2b8d-451d-bebd-a65959eca256 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:02.344302 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06217de-2b8d-451d-bebd-a65959eca256 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:02.344598 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06217de-2b8d-451d-bebd-a65959eca256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:02.372676 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-f06217de-2b8d-451d-bebd-a65959eca256 None None] MFA Rules not processed for user `16c3c9346c864b85a2f0c45ba1496e58`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:02.373857 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f06217de-2b8d-451d-bebd-a65959eca256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:02.445433 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1320/2628] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:55:02.450361 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac4dd8-840f-470f-95e6-baa51202acaa admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:02.528194 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac4dd8-840f-470f-95e6-baa51202acaa admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:02.537895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81998a7a-9137-4d2e-a871-84493b6bfa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:02.538957 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81998a7a-9137-4d2e-a871-84493b6bfa4b admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:02.539430 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81998a7a-9137-4d2e-a871-84493b6bfa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:02.539928 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81998a7a-9137-4d2e-a871-84493b6bfa4b admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:02.541072 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81998a7a-9137-4d2e-a871-84493b6bfa4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:02.543688 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81998a7a-9137-4d2e-a871-84493b6bfa4b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:02.577900 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1309/2629] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:55:02 2022] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:02.582162 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06217de-2b8d-451d-bebd-a65959eca256 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:02.593042 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06217de-2b8d-451d-bebd-a65959eca256 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:02.666086 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195edc39-c794-48b4-854c-1ee6adabe724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:02.667085 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195edc39-c794-48b4-854c-1ee6adabe724 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:02.667368 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195edc39-c794-48b4-854c-1ee6adabe724 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:02.667787 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195edc39-c794-48b4-854c-1ee6adabe724 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:02.668596 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195edc39-c794-48b4-854c-1ee6adabe724 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:02.670525 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195edc39-c794-48b4-854c-1ee6adabe724 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:02.693060 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1321/2630] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:55:02 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:55:02.696922 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81998a7a-9137-4d2e-a871-84493b6bfa4b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:02.707438 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81998a7a-9137-4d2e-a871-84493b6bfa4b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:02.712271 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa3c53-145e-4712-97ad-b6c191f6bc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:02.713351 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa3c53-145e-4712-97ad-b6c191f6bc75 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:02.713627 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa3c53-145e-4712-97ad-b6c191f6bc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:02.713897 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa3c53-145e-4712-97ad-b6c191f6bc75 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:02.714684 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa3c53-145e-4712-97ad-b6c191f6bc75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:02.716323 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa3c53-145e-4712-97ad-b6c191f6bc75 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:02.726773 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1310/2631] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:02.731059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195edc39-c794-48b4-854c-1ee6adabe724 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:02.741825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195edc39-c794-48b4-854c-1ee6adabe724 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:02.748246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bf840-9529-41a5-b88e-f0187a77968c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:02.749138 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bf840-9529-41a5-b88e-f0187a77968c admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:02.749416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bf840-9529-41a5-b88e-f0187a77968c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:02.749680 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bf840-9529-41a5-b88e-f0187a77968c admin admin] PATH_INFO: `/v3/projects/f86952c5f9624a6693be4297c05b754a/users/83117767c4424f8487d27c172e94bc69/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:02.766554 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91bf840-9529-41a5-b88e-f0187a77968c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f86952c5f9624a6693be4297c05b754a, user_id=83117767c4424f8487d27c172e94bc69, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:02.769277 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91bf840-9529-41a5-b88e-f0187a77968c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:02.784358 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1322/2632] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:02 2022] PUT /identity/v3/projects/f86952c5f9624a6693be4297c05b754a/users/83117767c4424f8487d27c172e94bc69/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:02.788544 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa3c53-145e-4712-97ad-b6c191f6bc75 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:02.799128 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa3c53-145e-4712-97ad-b6c191f6bc75 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:02.863821 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc49a70-4e3b-492d-b3b5-11a74511ba1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:02.864404 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc49a70-4e3b-492d-b3b5-11a74511ba1a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:02.864702 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc49a70-4e3b-492d-b3b5-11a74511ba1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:02.864967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc49a70-4e3b-492d-b3b5-11a74511ba1a admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:02.865693 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc49a70-4e3b-492d-b3b5-11a74511ba1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:02.867279 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc49a70-4e3b-492d-b3b5-11a74511ba1a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:02.878101 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1311/2633] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:02.882495 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bf840-9529-41a5-b88e-f0187a77968c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:02.893497 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bf840-9529-41a5-b88e-f0187a77968c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:02.899309 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df64259-68b3-43e4-9cc6-2049de31f29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:02.900234 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df64259-68b3-43e4-9cc6-2049de31f29b admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:02.900505 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df64259-68b3-43e4-9cc6-2049de31f29b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:02.900770 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df64259-68b3-43e4-9cc6-2049de31f29b admin admin] PATH_INFO: `/v3/projects/f86952c5f9624a6693be4297c05b754a/users/83117767c4424f8487d27c172e94bc69/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:02.903367 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df64259-68b3-43e4-9cc6-2049de31f29b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f86952c5f9624a6693be4297c05b754a, user_id=83117767c4424f8487d27c172e94bc69, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:02.906027 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df64259-68b3-43e4-9cc6-2049de31f29b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:02.917222 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1323/2634] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:02 2022] PUT /identity/v3/projects/f86952c5f9624a6693be4297c05b754a/users/83117767c4424f8487d27c172e94bc69/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:02.929213 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a587f80-93b8-4298-a4e2-588d20b71b66 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:02.929525 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a587f80-93b8-4298-a4e2-588d20b71b66 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:02.929795 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a587f80-93b8-4298-a4e2-588d20b71b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:02.964252 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-2a587f80-93b8-4298-a4e2-588d20b71b66 None None] MFA Rules not processed for user `83117767c4424f8487d27c172e94bc69`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:02.965990 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-2a587f80-93b8-4298-a4e2-588d20b71b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:03.033977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1312/2635] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:02 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:03.044446 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df64259-68b3-43e4-9cc6-2049de31f29b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:03.046299 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-4df64259-68b3-43e4-9cc6-2049de31f29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:03.108181 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df64259-68b3-43e4-9cc6-2049de31f29b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:03.112043 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bef04-c4ed-43f2-b3bb-f82b6540074f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:03.112697 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bef04-c4ed-43f2-b3bb-f82b6540074f service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:03.112979 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bef04-c4ed-43f2-b3bb-f82b6540074f service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:03.113250 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bef04-c4ed-43f2-b3bb-f82b6540074f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:03.122504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bef04-c4ed-43f2-b3bb-f82b6540074f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:03.124096 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bef04-c4ed-43f2-b3bb-f82b6540074f service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:03.131272 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51e318-aebb-4ad0-9790-508d323b4af4 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:03.131672 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51e318-aebb-4ad0-9790-508d323b4af4 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:03.131951 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f51e318-aebb-4ad0-9790-508d323b4af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:03.133345 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1324/2636] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:03 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:55:03.150682 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-9f51e318-aebb-4ad0-9790-508d323b4af4 None None] MFA Rules not processed for user `44e5602fd019411aa8f0e091ed533ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:03.151952 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9f51e318-aebb-4ad0-9790-508d323b4af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:03.210376 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1313/2637] 10.222.0.13 () {58 vars in 967 bytes} [Mon Jan 10 12:55:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:55:03.223763 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bef04-c4ed-43f2-b3bb-f82b6540074f service cinder] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:03.225673 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-1c6bef04-c4ed-43f2-b3bb-f82b6540074f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:03.293586 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bef04-c4ed-43f2-b3bb-f82b6540074f service cinder] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:03.298762 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88c2a6-4351-4fee-893f-9d0c6d0ec249 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd898c7c2974bb38998ebad22fd5a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:03.299398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88c2a6-4351-4fee-893f-9d0c6d0ec249 service swift] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:03.299705 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88c2a6-4351-4fee-893f-9d0c6d0ec249 service swift] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:03.299972 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88c2a6-4351-4fee-893f-9d0c6d0ec249 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:03.308416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88c2a6-4351-4fee-893f-9d0c6d0ec249 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:03.310564 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88c2a6-4351-4fee-893f-9d0c6d0ec249 service swift] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:03.320143 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1325/2638] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jan 10 12:55:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:55:04.452827 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51e318-aebb-4ad0-9790-508d323b4af4 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:04.513486 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f51e318-aebb-4ad0-9790-508d323b4af4 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:04.519757 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ac676-758d-4b85-96d3-00e470b68096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:04.520642 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ac676-758d-4b85-96d3-00e470b68096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:04.520921 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ac676-758d-4b85-96d3-00e470b68096 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:04.521210 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ac676-758d-4b85-96d3-00e470b68096 admin admin] PATH_INFO: `/v3/users/16c3c9346c864b85a2f0c45ba1496e58` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:04.522465 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ac676-758d-4b85-96d3-00e470b68096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16c3c9346c864b85a2f0c45ba1496e58)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:04.524439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ac676-758d-4b85-96d3-00e470b68096 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:04.577820 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-2f5ac676-758d-4b85-96d3-00e470b68096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16c3c9346c864b85a2f0c45ba1496e58'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:04.578508 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-2f5ac676-758d-4b85-96d3-00e470b68096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16c3c9346c864b85a2f0c45ba1496e58'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:04.579172 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-2f5ac676-758d-4b85-96d3-00e470b68096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16c3c9346c864b85a2f0c45ba1496e58'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:04.592559 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-2f5ac676-758d-4b85-96d3-00e470b68096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16c3c9346c864b85a2f0c45ba1496e58'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:04.599290 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-2f5ac676-758d-4b85-96d3-00e470b68096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16c3c9346c864b85a2f0c45ba1496e58'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:04.614557 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1314/2639] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:55:04 2022] DELETE /identity/v3/users/16c3c9346c864b85a2f0c45ba1496e58 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:04.619233 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce98ab-ee18-49ad-b553-cda1f41c496d None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:04.619760 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce98ab-ee18-49ad-b553-cda1f41c496d None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:04.619888 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce98ab-ee18-49ad-b553-cda1f41c496d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:04.639736 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-d0ce98ab-ee18-49ad-b553-cda1f41c496d None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:04.640963 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d0ce98ab-ee18-49ad-b553-cda1f41c496d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:04.702534 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1326/2640] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:04.713862 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ac676-758d-4b85-96d3-00e470b68096 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:04.717190 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-2f5ac676-758d-4b85-96d3-00e470b68096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:04.785689 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ac676-758d-4b85-96d3-00e470b68096 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:04.789446 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97274f81-60b9-4e7d-8144-7f7f6722a648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:04.790124 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97274f81-60b9-4e7d-8144-7f7f6722a648 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:04.790398 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97274f81-60b9-4e7d-8144-7f7f6722a648 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:04.790668 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97274f81-60b9-4e7d-8144-7f7f6722a648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:04.804093 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97274f81-60b9-4e7d-8144-7f7f6722a648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:04.805545 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97274f81-60b9-4e7d-8144-7f7f6722a648 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:04.818175 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1315/2641] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:05.102841 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce98ab-ee18-49ad-b553-cda1f41c496d None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:05.104523 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d0ce98ab-ee18-49ad-b553-cda1f41c496d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:05.128357 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce98ab-ee18-49ad-b553-cda1f41c496d None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:05.134393 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16f5c1-ccdf-44cb-a855-361262150bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:05.135369 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16f5c1-ccdf-44cb-a855-361262150bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:05.135721 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16f5c1-ccdf-44cb-a855-361262150bea admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:05.136046 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16f5c1-ccdf-44cb-a855-361262150bea admin admin] PATH_INFO: `/v3/projects/e73902d7c4b5484087c1b95f4c1fea9d` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:05.137344 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16f5c1-ccdf-44cb-a855-361262150bea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e73902d7c4b5484087c1b95f4c1fea9d)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:05.139557 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16f5c1-ccdf-44cb-a855-361262150bea admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:05.186413 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-da16f5c1-ccdf-44cb-a855-361262150bea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e73902d7c4b5484087c1b95f4c1fea9d', 'request_id': 'req-da16f5c1-ccdf-44cb-a855-361262150bea'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:05.192337 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-da16f5c1-ccdf-44cb-a855-361262150bea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e73902d7c4b5484087c1b95f4c1fea9d', 'request_id': 'req-da16f5c1-ccdf-44cb-a855-361262150bea'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:05.200725 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-da16f5c1-ccdf-44cb-a855-361262150bea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e73902d7c4b5484087c1b95f4c1fea9d', 'request_id': 'req-da16f5c1-ccdf-44cb-a855-361262150bea'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:05.210584 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-da16f5c1-ccdf-44cb-a855-361262150bea admin admin] The token cache is being invalidate because project e73902d7c4b5484087c1b95f4c1fea9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:55:05.210865 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-da16f5c1-ccdf-44cb-a855-361262150bea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:05.211466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-da16f5c1-ccdf-44cb-a855-361262150bea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:05.213299 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1327/2642] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:55:05 2022] DELETE /identity/v3/projects/e73902d7c4b5484087c1b95f4c1fea9d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:05.217493 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97274f81-60b9-4e7d-8144-7f7f6722a648 service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:05.227183 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97274f81-60b9-4e7d-8144-7f7f6722a648 service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:05.285190 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ed1cd-fb8c-4a5c-ad61-8c84705a3ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:05.286230 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ed1cd-fb8c-4a5c-ad61-8c84705a3ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:05.286500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ed1cd-fb8c-4a5c-ad61-8c84705a3ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:05.286766 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ed1cd-fb8c-4a5c-ad61-8c84705a3ad1 admin admin] PATH_INFO: `/v3/users/83117767c4424f8487d27c172e94bc69` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:05.288000 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ed1cd-fb8c-4a5c-ad61-8c84705a3ad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83117767c4424f8487d27c172e94bc69)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:05.289933 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ed1cd-fb8c-4a5c-ad61-8c84705a3ad1 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:05.338574 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b47ed1cd-fb8c-4a5c-ad61-8c84705a3ad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83117767c4424f8487d27c172e94bc69'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:05.339218 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b47ed1cd-fb8c-4a5c-ad61-8c84705a3ad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83117767c4424f8487d27c172e94bc69'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:05.339873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b47ed1cd-fb8c-4a5c-ad61-8c84705a3ad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83117767c4424f8487d27c172e94bc69'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:05.350891 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b47ed1cd-fb8c-4a5c-ad61-8c84705a3ad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83117767c4424f8487d27c172e94bc69'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:05.357814 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-b47ed1cd-fb8c-4a5c-ad61-8c84705a3ad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83117767c4424f8487d27c172e94bc69'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:05.371416 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1316/2643] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:55:05 2022] DELETE /identity/v3/users/83117767c4424f8487d27c172e94bc69 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:55:05.664449 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16f5c1-ccdf-44cb-a855-361262150bea admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:05.665907 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-da16f5c1-ccdf-44cb-a855-361262150bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:05.693837 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16f5c1-ccdf-44cb-a855-361262150bea admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:05.763218 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c4fd9-bea9-4af7-abe4-dfb5ab9b5867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:05.764269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c4fd9-bea9-4af7-abe4-dfb5ab9b5867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:05.764549 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c4fd9-bea9-4af7-abe4-dfb5ab9b5867 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:05.764816 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c4fd9-bea9-4af7-abe4-dfb5ab9b5867 admin admin] PATH_INFO: `/v3/projects/f86952c5f9624a6693be4297c05b754a` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:05.766103 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c4fd9-bea9-4af7-abe4-dfb5ab9b5867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f86952c5f9624a6693be4297c05b754a)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:05.768265 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c4fd9-bea9-4af7-abe4-dfb5ab9b5867 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:05.828066 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c63c4fd9-bea9-4af7-abe4-dfb5ab9b5867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f86952c5f9624a6693be4297c05b754a', 'request_id': 'req-c63c4fd9-bea9-4af7-abe4-dfb5ab9b5867'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:05.835797 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c63c4fd9-bea9-4af7-abe4-dfb5ab9b5867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f86952c5f9624a6693be4297c05b754a', 'request_id': 'req-c63c4fd9-bea9-4af7-abe4-dfb5ab9b5867'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:05.848619 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c63c4fd9-bea9-4af7-abe4-dfb5ab9b5867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f86952c5f9624a6693be4297c05b754a', 'request_id': 'req-c63c4fd9-bea9-4af7-abe4-dfb5ab9b5867'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:05.864707 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c63c4fd9-bea9-4af7-abe4-dfb5ab9b5867 admin admin] The token cache is being invalidate because project f86952c5f9624a6693be4297c05b754a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:55:05.865403 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c63c4fd9-bea9-4af7-abe4-dfb5ab9b5867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:05.866573 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-c63c4fd9-bea9-4af7-abe4-dfb5ab9b5867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:05.869473 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1328/2644] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:55:05 2022] DELETE /identity/v3/projects/f86952c5f9624a6693be4297c05b754a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:05.875161 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e259d6b-ed09-4b50-8f76-23c7b93643da None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:05.875775 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e259d6b-ed09-4b50-8f76-23c7b93643da None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:05.875775 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e259d6b-ed09-4b50-8f76-23c7b93643da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:05.897498 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-4e259d6b-ed09-4b50-8f76-23c7b93643da None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:05.898733 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-4e259d6b-ed09-4b50-8f76-23c7b93643da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:05.973716 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1317/2645] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:05.981772 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e704e-f5ec-4bca-a5d2-dac529b2272f None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:05.982054 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e704e-f5ec-4bca-a5d2-dac529b2272f None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:05.982328 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e704e-f5ec-4bca-a5d2-dac529b2272f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:06.005728 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-0f3e704e-f5ec-4bca-a5d2-dac529b2272f None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:06.007617 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-0f3e704e-f5ec-4bca-a5d2-dac529b2272f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:06.017138 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1329/2646] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:06.021226 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e259d6b-ed09-4b50-8f76-23c7b93643da None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:06.031166 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e259d6b-ed09-4b50-8f76-23c7b93643da None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:06.037349 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8669fd-3490-4354-bc80-d638cfb13532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:06.038023 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8669fd-3490-4354-bc80-d638cfb13532 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:06.038294 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8669fd-3490-4354-bc80-d638cfb13532 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:06.038555 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8669fd-3490-4354-bc80-d638cfb13532 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:06.040038 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8669fd-3490-4354-bc80-d638cfb13532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:55:06.040342 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8669fd-3490-4354-bc80-d638cfb13532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:06.041949 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8669fd-3490-4354-bc80-d638cfb13532 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:06.058171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1318/2647] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:55:06.062691 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e704e-f5ec-4bca-a5d2-dac529b2272f None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:06.074627 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e704e-f5ec-4bca-a5d2-dac529b2272f None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:06.080360 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1e1d1-11b7-4daf-9763-39ad1d23c440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:06.081241 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e1d1-11b7-4daf-9763-39ad1d23c440 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:06.081540 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e1d1-11b7-4daf-9763-39ad1d23c440 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:06.081840 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1e1d1-11b7-4daf-9763-39ad1d23c440 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:06.083017 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1e1d1-11b7-4daf-9763-39ad1d23c440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:06.085394 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1e1d1-11b7-4daf-9763-39ad1d23c440 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:06.119576 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1330/2648] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:55:06 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:06.120783 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8669fd-3490-4354-bc80-d638cfb13532 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:06.130936 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8669fd-3490-4354-bc80-d638cfb13532 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:06.198071 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628d897-ab7f-4beb-95b8-849e7e277ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:06.199058 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628d897-ab7f-4beb-95b8-849e7e277ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:06.199621 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628d897-ab7f-4beb-95b8-849e7e277ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:06.200015 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628d897-ab7f-4beb-95b8-849e7e277ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:06.200788 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628d897-ab7f-4beb-95b8-849e7e277ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:06.202813 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628d897-ab7f-4beb-95b8-849e7e277ea6 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:06.234320 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1319/2649] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:55:06 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:06.238525 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1e1d1-11b7-4daf-9763-39ad1d23c440 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:06.254311 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1e1d1-11b7-4daf-9763-39ad1d23c440 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:06.267159 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c309116-e277-4a5d-bb01-406b715cff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:06.267159 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c309116-e277-4a5d-bb01-406b715cff8f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:06.267159 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c309116-e277-4a5d-bb01-406b715cff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:06.267661 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c309116-e277-4a5d-bb01-406b715cff8f admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:06.271360 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c309116-e277-4a5d-bb01-406b715cff8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:06.274254 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c309116-e277-4a5d-bb01-406b715cff8f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:06.290884 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1331/2650] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:06.294819 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628d897-ab7f-4beb-95b8-849e7e277ea6 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:06.304824 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628d897-ab7f-4beb-95b8-849e7e277ea6 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:06.309933 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70fb67-a29c-4efc-a7bb-e374e2d66018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:06.310601 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70fb67-a29c-4efc-a7bb-e374e2d66018 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:06.310883 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70fb67-a29c-4efc-a7bb-e374e2d66018 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:06.311157 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70fb67-a29c-4efc-a7bb-e374e2d66018 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:06.311933 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70fb67-a29c-4efc-a7bb-e374e2d66018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:06.313539 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70fb67-a29c-4efc-a7bb-e374e2d66018 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:06.323538 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1320/2651] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:06.327826 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c309116-e277-4a5d-bb01-406b715cff8f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:06.337990 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c309116-e277-4a5d-bb01-406b715cff8f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:06.342679 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6c44c-9919-4a26-ae0d-662cc3cb219c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:06.343635 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6c44c-9919-4a26-ae0d-662cc3cb219c admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:06.343915 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6c44c-9919-4a26-ae0d-662cc3cb219c admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:06.344192 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6c44c-9919-4a26-ae0d-662cc3cb219c admin admin] PATH_INFO: `/v3/projects/71878a4050644be3ae33961960dd8cf6/users/6a52e3ac9306479daceea09d8d222b4e/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:06.359128 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6c44c-9919-4a26-ae0d-662cc3cb219c admin admin] RBAC: Authorizing `identity:create_grant(project_id=71878a4050644be3ae33961960dd8cf6, user_id=6a52e3ac9306479daceea09d8d222b4e, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:06.361812 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6c44c-9919-4a26-ae0d-662cc3cb219c admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:06.375314 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1332/2652] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:06 2022] PUT /identity/v3/projects/71878a4050644be3ae33961960dd8cf6/users/6a52e3ac9306479daceea09d8d222b4e/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:06.387565 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dad88f-11a2-44ba-9132-e13de74be18e None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:06.387929 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dad88f-11a2-44ba-9132-e13de74be18e None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:06.388297 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dad88f-11a2-44ba-9132-e13de74be18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:06.416634 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-e7dad88f-11a2-44ba-9132-e13de74be18e None None] MFA Rules not processed for user `6a52e3ac9306479daceea09d8d222b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:06.417939 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e7dad88f-11a2-44ba-9132-e13de74be18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:06.482417 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1321/2653] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:06.487062 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6c44c-9919-4a26-ae0d-662cc3cb219c admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:06.547962 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6c44c-9919-4a26-ae0d-662cc3cb219c admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:06.552853 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb9ec0-995b-4b47-9348-3b271535e813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:06.553527 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb9ec0-995b-4b47-9348-3b271535e813 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:06.553809 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb9ec0-995b-4b47-9348-3b271535e813 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:06.554081 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb9ec0-995b-4b47-9348-3b271535e813 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:06.554793 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb9ec0-995b-4b47-9348-3b271535e813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:06.558010 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb9ec0-995b-4b47-9348-3b271535e813 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:06.586241 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1333/2654] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:55:06 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:06.590200 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dad88f-11a2-44ba-9132-e13de74be18e None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:06.602181 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dad88f-11a2-44ba-9132-e13de74be18e None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:06.665772 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4833052-7c7f-43a9-90c3-7a8a76c1c1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:06.666556 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4833052-7c7f-43a9-90c3-7a8a76c1c1ff admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:06.666746 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4833052-7c7f-43a9-90c3-7a8a76c1c1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:06.667001 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4833052-7c7f-43a9-90c3-7a8a76c1c1ff admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:06.667781 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4833052-7c7f-43a9-90c3-7a8a76c1c1ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:06.669731 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4833052-7c7f-43a9-90c3-7a8a76c1c1ff admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:06.708916 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1322/2655] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:55:06 2022] POST /identity/v3/users => generated 300 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:06.713160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb9ec0-995b-4b47-9348-3b271535e813 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:06.724752 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb9ec0-995b-4b47-9348-3b271535e813 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:06.744559 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833b27b-0714-46e6-903a-8b8e4ed031b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:06.745309 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833b27b-0714-46e6-903a-8b8e4ed031b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:06.745898 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833b27b-0714-46e6-903a-8b8e4ed031b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:06.745898 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833b27b-0714-46e6-903a-8b8e4ed031b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:06.746661 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833b27b-0714-46e6-903a-8b8e4ed031b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:06.748405 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833b27b-0714-46e6-903a-8b8e4ed031b7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:06.759929 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1334/2656] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:06.764621 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4833052-7c7f-43a9-90c3-7a8a76c1c1ff admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:06.774528 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4833052-7c7f-43a9-90c3-7a8a76c1c1ff admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:06.780733 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5729f0c-5ee4-42f9-a5bb-1860306d7a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:06.781644 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5729f0c-5ee4-42f9-a5bb-1860306d7a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:06.781895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5729f0c-5ee4-42f9-a5bb-1860306d7a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:06.782196 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5729f0c-5ee4-42f9-a5bb-1860306d7a0b admin admin] PATH_INFO: `/v3/projects/88870211e5ca4adf82600b3609d1c1b4/users/b9ed292837bd41fc99d7c2f2f1631247/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:06.820245 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5729f0c-5ee4-42f9-a5bb-1860306d7a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=88870211e5ca4adf82600b3609d1c1b4, user_id=b9ed292837bd41fc99d7c2f2f1631247, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:06.824210 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5729f0c-5ee4-42f9-a5bb-1860306d7a0b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:06.843795 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1323/2657] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:06 2022] PUT /identity/v3/projects/88870211e5ca4adf82600b3609d1c1b4/users/b9ed292837bd41fc99d7c2f2f1631247/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:06.847707 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833b27b-0714-46e6-903a-8b8e4ed031b7 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:06.857810 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833b27b-0714-46e6-903a-8b8e4ed031b7 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:06.918689 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aad166-698b-4afa-bc52-f21055e397fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:06.919317 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aad166-698b-4afa-bc52-f21055e397fe admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:06.919655 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aad166-698b-4afa-bc52-f21055e397fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:06.919924 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aad166-698b-4afa-bc52-f21055e397fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:06.920660 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aad166-698b-4afa-bc52-f21055e397fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:06.922261 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aad166-698b-4afa-bc52-f21055e397fe admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:06.935315 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1335/2658] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:06.939682 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5729f0c-5ee4-42f9-a5bb-1860306d7a0b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:06.952347 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5729f0c-5ee4-42f9-a5bb-1860306d7a0b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:06.957726 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cc8be-1dd3-4267-804b-303de0c0792a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:06.958904 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cc8be-1dd3-4267-804b-303de0c0792a admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:06.959245 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cc8be-1dd3-4267-804b-303de0c0792a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:06.959604 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cc8be-1dd3-4267-804b-303de0c0792a admin admin] PATH_INFO: `/v3/projects/88870211e5ca4adf82600b3609d1c1b4/users/b9ed292837bd41fc99d7c2f2f1631247/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:06.962157 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cc8be-1dd3-4267-804b-303de0c0792a admin admin] RBAC: Authorizing `identity:create_grant(project_id=88870211e5ca4adf82600b3609d1c1b4, user_id=b9ed292837bd41fc99d7c2f2f1631247, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:06.965221 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cc8be-1dd3-4267-804b-303de0c0792a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:06.976774 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1324/2659] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:06 2022] PUT /identity/v3/projects/88870211e5ca4adf82600b3609d1c1b4/users/b9ed292837bd41fc99d7c2f2f1631247/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:55:06.987630 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a117f-0fe0-4161-8b8d-2ade26745a45 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:06.987870 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a117f-0fe0-4161-8b8d-2ade26745a45 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:06.988138 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a117f-0fe0-4161-8b8d-2ade26745a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:07.027327 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-462a117f-0fe0-4161-8b8d-2ade26745a45 None None] MFA Rules not processed for user `b9ed292837bd41fc99d7c2f2f1631247`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:07.028928 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-462a117f-0fe0-4161-8b8d-2ade26745a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:07.140988 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1336/2660] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:07.154289 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cc8be-1dd3-4267-804b-303de0c0792a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:07.161238 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5a9cc8be-1dd3-4267-804b-303de0c0792a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:07.288069 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cc8be-1dd3-4267-804b-303de0c0792a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:07.293752 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a90645-3cd6-4c67-94a4-b7d83625f270 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:07.294433 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a90645-3cd6-4c67-94a4-b7d83625f270 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:07.295472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a90645-3cd6-4c67-94a4-b7d83625f270 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:07.295782 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a90645-3cd6-4c67-94a4-b7d83625f270 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:07.308618 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a90645-3cd6-4c67-94a4-b7d83625f270 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:07.310650 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a90645-3cd6-4c67-94a4-b7d83625f270 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:07.337364 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1325/2661] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:07.357478 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a117f-0fe0-4161-8b8d-2ade26745a45 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:07.454346 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a117f-0fe0-4161-8b8d-2ade26745a45 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:07.470881 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e7b8f-1e1f-496e-9645-1ee7c67c565f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:07.471919 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e7b8f-1e1f-496e-9645-1ee7c67c565f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:07.472097 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e7b8f-1e1f-496e-9645-1ee7c67c565f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:07.472434 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e7b8f-1e1f-496e-9645-1ee7c67c565f admin admin] PATH_INFO: `/v3/users/6a52e3ac9306479daceea09d8d222b4e` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:07.473874 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e7b8f-1e1f-496e-9645-1ee7c67c565f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a52e3ac9306479daceea09d8d222b4e)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:07.476082 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e7b8f-1e1f-496e-9645-1ee7c67c565f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:07.539614 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-611e7b8f-1e1f-496e-9645-1ee7c67c565f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a52e3ac9306479daceea09d8d222b4e'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:07.546905 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-611e7b8f-1e1f-496e-9645-1ee7c67c565f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a52e3ac9306479daceea09d8d222b4e'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:07.555743 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-611e7b8f-1e1f-496e-9645-1ee7c67c565f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a52e3ac9306479daceea09d8d222b4e'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:07.557033 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-611e7b8f-1e1f-496e-9645-1ee7c67c565f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a52e3ac9306479daceea09d8d222b4e'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:07.557640 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-611e7b8f-1e1f-496e-9645-1ee7c67c565f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a52e3ac9306479daceea09d8d222b4e'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:07.575757 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1337/2662] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:55:07 2022] DELETE /identity/v3/users/6a52e3ac9306479daceea09d8d222b4e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:07.582554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e9695-9e6f-48bc-bf6c-f93b23ff597b None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:07.582812 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e9695-9e6f-48bc-bf6c-f93b23ff597b None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:07.583091 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e9695-9e6f-48bc-bf6c-f93b23ff597b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:07.606162 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-f28e9695-9e6f-48bc-bf6c-f93b23ff597b None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:07.607406 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-f28e9695-9e6f-48bc-bf6c-f93b23ff597b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:07.671727 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1326/2663] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:07.682103 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e7b8f-1e1f-496e-9645-1ee7c67c565f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:07.683731 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-611e7b8f-1e1f-496e-9645-1ee7c67c565f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:07.759901 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e7b8f-1e1f-496e-9645-1ee7c67c565f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:07.765884 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b391c9-7624-4dfa-85ad-c30fcd13eee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:07.767920 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b391c9-7624-4dfa-85ad-c30fcd13eee2 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:07.768114 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b391c9-7624-4dfa-85ad-c30fcd13eee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:07.768370 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b391c9-7624-4dfa-85ad-c30fcd13eee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:07.783279 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b391c9-7624-4dfa-85ad-c30fcd13eee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:07.785709 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b391c9-7624-4dfa-85ad-c30fcd13eee2 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:07.797503 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1338/2664] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:08.110626 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e9695-9e6f-48bc-bf6c-f93b23ff597b None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:08.112205 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-f28e9695-9e6f-48bc-bf6c-f93b23ff597b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:08.124519 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e9695-9e6f-48bc-bf6c-f93b23ff597b None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:08.129220 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea9a30-629b-476c-aa54-caaa851ee56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:08.130083 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea9a30-629b-476c-aa54-caaa851ee56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:08.130362 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea9a30-629b-476c-aa54-caaa851ee56d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:08.130632 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea9a30-629b-476c-aa54-caaa851ee56d admin admin] PATH_INFO: `/v3/projects/71878a4050644be3ae33961960dd8cf6` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:08.131871 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea9a30-629b-476c-aa54-caaa851ee56d admin admin] RBAC: Authorizing `identity:delete_project(project_id=71878a4050644be3ae33961960dd8cf6)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:08.133817 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea9a30-629b-476c-aa54-caaa851ee56d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:08.181507 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-e5ea9a30-629b-476c-aa54-caaa851ee56d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71878a4050644be3ae33961960dd8cf6', 'request_id': 'req-e5ea9a30-629b-476c-aa54-caaa851ee56d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:08.189154 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-e5ea9a30-629b-476c-aa54-caaa851ee56d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71878a4050644be3ae33961960dd8cf6', 'request_id': 'req-e5ea9a30-629b-476c-aa54-caaa851ee56d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:08.194759 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-e5ea9a30-629b-476c-aa54-caaa851ee56d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71878a4050644be3ae33961960dd8cf6', 'request_id': 'req-e5ea9a30-629b-476c-aa54-caaa851ee56d'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:08.205850 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-e5ea9a30-629b-476c-aa54-caaa851ee56d admin admin] The token cache is being invalidate because project 71878a4050644be3ae33961960dd8cf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:55:08.206140 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-e5ea9a30-629b-476c-aa54-caaa851ee56d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:08.206766 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-e5ea9a30-629b-476c-aa54-caaa851ee56d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:08.208362 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1327/2665] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:55:08 2022] DELETE /identity/v3/projects/71878a4050644be3ae33961960dd8cf6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:08.212538 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b391c9-7624-4dfa-85ad-c30fcd13eee2 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:08.222293 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b391c9-7624-4dfa-85ad-c30fcd13eee2 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:08.279485 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a1876-aff5-467d-a576-acca3a28d641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:08.280326 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a1876-aff5-467d-a576-acca3a28d641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:08.280655 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a1876-aff5-467d-a576-acca3a28d641 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:08.280984 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a1876-aff5-467d-a576-acca3a28d641 admin admin] PATH_INFO: `/v3/users/b9ed292837bd41fc99d7c2f2f1631247` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:08.282161 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a1876-aff5-467d-a576-acca3a28d641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ed292837bd41fc99d7c2f2f1631247)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:08.284148 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a1876-aff5-467d-a576-acca3a28d641 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:08.335266 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3b3a1876-aff5-467d-a576-acca3a28d641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ed292837bd41fc99d7c2f2f1631247'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:08.342753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3b3a1876-aff5-467d-a576-acca3a28d641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ed292837bd41fc99d7c2f2f1631247'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:08.350854 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3b3a1876-aff5-467d-a576-acca3a28d641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ed292837bd41fc99d7c2f2f1631247'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:08.351659 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3b3a1876-aff5-467d-a576-acca3a28d641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ed292837bd41fc99d7c2f2f1631247'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:08.352691 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3b3a1876-aff5-467d-a576-acca3a28d641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ed292837bd41fc99d7c2f2f1631247'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:08.373871 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1339/2666] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:55:08 2022] DELETE /identity/v3/users/b9ed292837bd41fc99d7c2f2f1631247 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:08.696024 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea9a30-629b-476c-aa54-caaa851ee56d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:08.697469 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e5ea9a30-629b-476c-aa54-caaa851ee56d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:08.717208 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea9a30-629b-476c-aa54-caaa851ee56d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:08.799798 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29639f11-fa29-4b19-bf46-6a56728e3dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:08.800666 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29639f11-fa29-4b19-bf46-6a56728e3dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:08.800940 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29639f11-fa29-4b19-bf46-6a56728e3dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:08.801208 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29639f11-fa29-4b19-bf46-6a56728e3dc9 admin admin] PATH_INFO: `/v3/projects/88870211e5ca4adf82600b3609d1c1b4` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:08.802417 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29639f11-fa29-4b19-bf46-6a56728e3dc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88870211e5ca4adf82600b3609d1c1b4)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:08.804375 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29639f11-fa29-4b19-bf46-6a56728e3dc9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:08.858101 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-29639f11-fa29-4b19-bf46-6a56728e3dc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88870211e5ca4adf82600b3609d1c1b4', 'request_id': 'req-29639f11-fa29-4b19-bf46-6a56728e3dc9'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:08.867319 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-29639f11-fa29-4b19-bf46-6a56728e3dc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88870211e5ca4adf82600b3609d1c1b4', 'request_id': 'req-29639f11-fa29-4b19-bf46-6a56728e3dc9'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:08.873409 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-29639f11-fa29-4b19-bf46-6a56728e3dc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88870211e5ca4adf82600b3609d1c1b4', 'request_id': 'req-29639f11-fa29-4b19-bf46-6a56728e3dc9'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:08.885986 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-29639f11-fa29-4b19-bf46-6a56728e3dc9 admin admin] The token cache is being invalidate because project 88870211e5ca4adf82600b3609d1c1b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:55:08.886970 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-29639f11-fa29-4b19-bf46-6a56728e3dc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:08.887734 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-29639f11-fa29-4b19-bf46-6a56728e3dc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:08.889536 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1328/2667] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:55:08 2022] DELETE /identity/v3/projects/88870211e5ca4adf82600b3609d1c1b4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:08.895131 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47fbe0-3313-4310-b9c8-7c4a74182d5b None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:08.895670 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47fbe0-3313-4310-b9c8-7c4a74182d5b None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:08.895820 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47fbe0-3313-4310-b9c8-7c4a74182d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:08.914998 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-cf47fbe0-3313-4310-b9c8-7c4a74182d5b None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:08.916340 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-cf47fbe0-3313-4310-b9c8-7c4a74182d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:08.983541 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1340/2668] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:08.992011 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1392e-1243-4046-8026-7387571fb44c None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:08.992296 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1392e-1243-4046-8026-7387571fb44c None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:08.992543 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1392e-1243-4046-8026-7387571fb44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:09.010701 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-f6f1392e-1243-4046-8026-7387571fb44c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:09.011963 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-f6f1392e-1243-4046-8026-7387571fb44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:09.020608 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1329/2669] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:09.024958 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47fbe0-3313-4310-b9c8-7c4a74182d5b None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:09.035420 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47fbe0-3313-4310-b9c8-7c4a74182d5b None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:09.047078 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f0496-5377-4c16-8453-cf6c887a2dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:09.047879 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f0496-5377-4c16-8453-cf6c887a2dad admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:09.048222 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f0496-5377-4c16-8453-cf6c887a2dad admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:09.048583 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f0496-5377-4c16-8453-cf6c887a2dad admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:09.049442 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f0496-5377-4c16-8453-cf6c887a2dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:55:09.049815 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f0496-5377-4c16-8453-cf6c887a2dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:09.051562 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f0496-5377-4c16-8453-cf6c887a2dad admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:09.065102 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1341/2670] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:55:09.069481 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1392e-1243-4046-8026-7387571fb44c None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:09.079838 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1392e-1243-4046-8026-7387571fb44c None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:09.085151 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce7ae9-5a3c-40f8-8b2f-73b696de2646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:09.085880 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7ae9-5a3c-40f8-8b2f-73b696de2646 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:09.086219 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7ae9-5a3c-40f8-8b2f-73b696de2646 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:09.086543 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce7ae9-5a3c-40f8-8b2f-73b696de2646 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:09.087298 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce7ae9-5a3c-40f8-8b2f-73b696de2646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:09.090910 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce7ae9-5a3c-40f8-8b2f-73b696de2646 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:09.120591 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1330/2671] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:55:09 2022] POST /identity/v3/projects => generated 407 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:09.125638 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f0496-5377-4c16-8453-cf6c887a2dad admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:09.139101 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f0496-5377-4c16-8453-cf6c887a2dad admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:09.206796 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee0a21-a68a-41d9-8f9d-91850deb9649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:09.207686 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee0a21-a68a-41d9-8f9d-91850deb9649 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:09.207975 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee0a21-a68a-41d9-8f9d-91850deb9649 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:09.208246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee0a21-a68a-41d9-8f9d-91850deb9649 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:09.208978 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee0a21-a68a-41d9-8f9d-91850deb9649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:09.211061 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee0a21-a68a-41d9-8f9d-91850deb9649 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:09.243284 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1342/2672] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:55:09 2022] POST /identity/v3/users => generated 304 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:55:09.245231 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce7ae9-5a3c-40f8-8b2f-73b696de2646 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:09.257878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce7ae9-5a3c-40f8-8b2f-73b696de2646 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:09.263118 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdfdea-f279-4a86-9994-350a270bb502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:09.264215 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdfdea-f279-4a86-9994-350a270bb502 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:09.264708 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdfdea-f279-4a86-9994-350a270bb502 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:09.265187 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdfdea-f279-4a86-9994-350a270bb502 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:09.266414 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdfdea-f279-4a86-9994-350a270bb502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:09.268268 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdfdea-f279-4a86-9994-350a270bb502 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:09.284795 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee0a21-a68a-41d9-8f9d-91850deb9649 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:09.285546 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1331/2673] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:09.297622 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee0a21-a68a-41d9-8f9d-91850deb9649 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:09.308752 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b6266-27dd-4ecb-8066-950b7b657f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:09.309921 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b6266-27dd-4ecb-8066-950b7b657f7b admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:09.310791 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b6266-27dd-4ecb-8066-950b7b657f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:09.312388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b6266-27dd-4ecb-8066-950b7b657f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:09.313292 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b6266-27dd-4ecb-8066-950b7b657f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:09.315095 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b6266-27dd-4ecb-8066-950b7b657f7b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:09.333176 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1343/2674] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:09.335061 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdfdea-f279-4a86-9994-350a270bb502 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:09.348270 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdfdea-f279-4a86-9994-350a270bb502 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:09.367809 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c919c-9ab3-4dfc-87e6-9f578a8cdfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:09.371488 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c919c-9ab3-4dfc-87e6-9f578a8cdfd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:09.371947 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c919c-9ab3-4dfc-87e6-9f578a8cdfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:09.372292 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c919c-9ab3-4dfc-87e6-9f578a8cdfd7 admin admin] PATH_INFO: `/v3/projects/84b8a137aaf143ddbb6cb2a4d5cb5823/users/43ba6e10aaa34cb1b509f8d8b6c7ed61/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:09.396674 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c919c-9ab3-4dfc-87e6-9f578a8cdfd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b8a137aaf143ddbb6cb2a4d5cb5823, user_id=43ba6e10aaa34cb1b509f8d8b6c7ed61, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:09.400863 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c919c-9ab3-4dfc-87e6-9f578a8cdfd7 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:09.419998 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1332/2675] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:09 2022] PUT /identity/v3/projects/84b8a137aaf143ddbb6cb2a4d5cb5823/users/43ba6e10aaa34cb1b509f8d8b6c7ed61/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:55:09.434856 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eb5bb-3717-4b13-b722-e311d08eda9f None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:09.435182 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eb5bb-3717-4b13-b722-e311d08eda9f None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:09.435408 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eb5bb-3717-4b13-b722-e311d08eda9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:09.474822 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-463eb5bb-3717-4b13-b722-e311d08eda9f None None] MFA Rules not processed for user `43ba6e10aaa34cb1b509f8d8b6c7ed61`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:09.477022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-463eb5bb-3717-4b13-b722-e311d08eda9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:09.547602 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1344/2676] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:09 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:09.551600 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c919c-9ab3-4dfc-87e6-9f578a8cdfd7 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:09.616376 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c919c-9ab3-4dfc-87e6-9f578a8cdfd7 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:09.621974 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f430945-3efe-42a5-9456-103f43c2ef1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:09.622643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f430945-3efe-42a5-9456-103f43c2ef1a admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:09.622915 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f430945-3efe-42a5-9456-103f43c2ef1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:09.623188 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f430945-3efe-42a5-9456-103f43c2ef1a admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:09.624000 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f430945-3efe-42a5-9456-103f43c2ef1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:09.625841 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f430945-3efe-42a5-9456-103f43c2ef1a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:09.655203 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1333/2677] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:55:09 2022] POST /identity/v3/projects => generated 409 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:09.659633 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463eb5bb-3717-4b13-b722-e311d08eda9f None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:09.674753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463eb5bb-3717-4b13-b722-e311d08eda9f None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:09.748736 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665599e5-cd8d-4de9-a80f-c0eda2cc7727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:09.749143 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665599e5-cd8d-4de9-a80f-c0eda2cc7727 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:09.754701 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665599e5-cd8d-4de9-a80f-c0eda2cc7727 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:09.755082 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665599e5-cd8d-4de9-a80f-c0eda2cc7727 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:09.755948 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665599e5-cd8d-4de9-a80f-c0eda2cc7727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:09.760939 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665599e5-cd8d-4de9-a80f-c0eda2cc7727 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:09.797365 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1345/2678] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:55:09 2022] POST /identity/v3/users => generated 311 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:55:09.798446 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f430945-3efe-42a5-9456-103f43c2ef1a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:09.809644 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f430945-3efe-42a5-9456-103f43c2ef1a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:09.814193 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d480daf-3842-4f71-af99-d51e933e4892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:09.814867 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d480daf-3842-4f71-af99-d51e933e4892 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:09.815385 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d480daf-3842-4f71-af99-d51e933e4892 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:09.815703 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d480daf-3842-4f71-af99-d51e933e4892 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:09.816445 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d480daf-3842-4f71-af99-d51e933e4892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:09.818042 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d480daf-3842-4f71-af99-d51e933e4892 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:09.830463 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1334/2679] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:55:09.834865 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665599e5-cd8d-4de9-a80f-c0eda2cc7727 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:09.846023 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665599e5-cd8d-4de9-a80f-c0eda2cc7727 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:09.850989 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816f53e-9989-41f0-a447-8bafeb8f3883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:09.852147 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816f53e-9989-41f0-a447-8bafeb8f3883 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:09.852521 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816f53e-9989-41f0-a447-8bafeb8f3883 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:09.852868 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816f53e-9989-41f0-a447-8bafeb8f3883 admin admin] PATH_INFO: `/v3/projects/26403772e0fc46d3b1b9704bb3cb43d3/users/1a9a9d01faba4ed6a0cc0fe5f1d189ef/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:09.874012 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816f53e-9989-41f0-a447-8bafeb8f3883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26403772e0fc46d3b1b9704bb3cb43d3, user_id=1a9a9d01faba4ed6a0cc0fe5f1d189ef, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:09.876830 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816f53e-9989-41f0-a447-8bafeb8f3883 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:09.890428 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1346/2680] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:09 2022] PUT /identity/v3/projects/26403772e0fc46d3b1b9704bb3cb43d3/users/1a9a9d01faba4ed6a0cc0fe5f1d189ef/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:55:09.894523 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d480daf-3842-4f71-af99-d51e933e4892 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:09.904740 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d480daf-3842-4f71-af99-d51e933e4892 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:09.964479 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6b8b1-f880-498b-81e0-893726685ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:09.965217 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6b8b1-f880-498b-81e0-893726685ead admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:09.965524 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6b8b1-f880-498b-81e0-893726685ead admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:09.965884 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6b8b1-f880-498b-81e0-893726685ead admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:09.966645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6b8b1-f880-498b-81e0-893726685ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:09.968462 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6b8b1-f880-498b-81e0-893726685ead admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:09.978999 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1335/2681] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:09.983441 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816f53e-9989-41f0-a447-8bafeb8f3883 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:09.998116 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816f53e-9989-41f0-a447-8bafeb8f3883 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:10.004879 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ac497-b697-46e4-9ff2-f4849af29616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:10.005918 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ac497-b697-46e4-9ff2-f4849af29616 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:10.006252 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ac497-b697-46e4-9ff2-f4849af29616 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:10.006519 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ac497-b697-46e4-9ff2-f4849af29616 admin admin] PATH_INFO: `/v3/projects/26403772e0fc46d3b1b9704bb3cb43d3/users/1a9a9d01faba4ed6a0cc0fe5f1d189ef/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:10.009015 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ac497-b697-46e4-9ff2-f4849af29616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26403772e0fc46d3b1b9704bb3cb43d3, user_id=1a9a9d01faba4ed6a0cc0fe5f1d189ef, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:10.014821 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ac497-b697-46e4-9ff2-f4849af29616 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:10.026044 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1347/2682] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:09 2022] PUT /identity/v3/projects/26403772e0fc46d3b1b9704bb3cb43d3/users/1a9a9d01faba4ed6a0cc0fe5f1d189ef/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:10.036900 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c19958-5321-4ee2-aea9-2dfe797a1de0 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:10.037234 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c19958-5321-4ee2-aea9-2dfe797a1de0 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:10.037476 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c19958-5321-4ee2-aea9-2dfe797a1de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:10.069669 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-f5c19958-5321-4ee2-aea9-2dfe797a1de0 None None] MFA Rules not processed for user `1a9a9d01faba4ed6a0cc0fe5f1d189ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:10.071669 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-f5c19958-5321-4ee2-aea9-2dfe797a1de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:10.146573 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1336/2683] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:10 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:10.156547 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ac497-b697-46e4-9ff2-f4849af29616 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:10.158331 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-df7ac497-b697-46e4-9ff2-f4849af29616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:10.363854 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ac497-b697-46e4-9ff2-f4849af29616 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:10.368531 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a5f7e-b99e-4b59-9be3-c5a0f7a5c55e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:10.369191 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a5f7e-b99e-4b59-9be3-c5a0f7a5c55e service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:10.369465 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a5f7e-b99e-4b59-9be3-c5a0f7a5c55e service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:10.369738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a5f7e-b99e-4b59-9be3-c5a0f7a5c55e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:10.380487 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a5f7e-b99e-4b59-9be3-c5a0f7a5c55e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:10.382654 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a5f7e-b99e-4b59-9be3-c5a0f7a5c55e service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:10.394312 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1348/2684] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:10 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:10.599297 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c19958-5321-4ee2-aea9-2dfe797a1de0 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:10.610405 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c19958-5321-4ee2-aea9-2dfe797a1de0 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:10.614209 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df96ae-aa04-46a5-9bcd-0db68904e091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:10.614944 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df96ae-aa04-46a5-9bcd-0db68904e091 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:10.615289 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df96ae-aa04-46a5-9bcd-0db68904e091 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:10.615651 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df96ae-aa04-46a5-9bcd-0db68904e091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:10.709362 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df96ae-aa04-46a5-9bcd-0db68904e091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:10.711052 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df96ae-aa04-46a5-9bcd-0db68904e091 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:10.722687 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1337/2685] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:10 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:11.154514 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a5f7e-b99e-4b59-9be3-c5a0f7a5c55e service cinder] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:11.157036 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-5c1a5f7e-b99e-4b59-9be3-c5a0f7a5c55e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:11.294582 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a5f7e-b99e-4b59-9be3-c5a0f7a5c55e service cinder] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:11.298077 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83233f-94c2-4638-9560-f07005625fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:11.299039 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83233f-94c2-4638-9560-f07005625fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:11.299375 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83233f-94c2-4638-9560-f07005625fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:11.299728 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83233f-94c2-4638-9560-f07005625fcb admin admin] PATH_INFO: `/v3/users/0bd08123ff9041c099577fd755b432fe` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:11.301021 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83233f-94c2-4638-9560-f07005625fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bd08123ff9041c099577fd755b432fe)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:11.303046 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83233f-94c2-4638-9560-f07005625fcb admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:11.366208 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-df83233f-94c2-4638-9560-f07005625fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bd08123ff9041c099577fd755b432fe'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:11.374092 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-df83233f-94c2-4638-9560-f07005625fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bd08123ff9041c099577fd755b432fe'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:11.382291 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-df83233f-94c2-4638-9560-f07005625fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bd08123ff9041c099577fd755b432fe'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:11.382964 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-df83233f-94c2-4638-9560-f07005625fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bd08123ff9041c099577fd755b432fe'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:11.383719 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-df83233f-94c2-4638-9560-f07005625fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bd08123ff9041c099577fd755b432fe'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:11.406885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1349/2686] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:55:11 2022] DELETE /identity/v3/users/0bd08123ff9041c099577fd755b432fe => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:11.615417 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df96ae-aa04-46a5-9bcd-0db68904e091 service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:11.628352 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df96ae-aa04-46a5-9bcd-0db68904e091 service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:11.695736 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d23d94-f410-41ba-a3b4-142746852745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:11.696601 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d23d94-f410-41ba-a3b4-142746852745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:11.696875 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d23d94-f410-41ba-a3b4-142746852745 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:11.697115 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d23d94-f410-41ba-a3b4-142746852745 admin admin] PATH_INFO: `/v3/projects/49b93adb02f6421e98d26e140bc17634` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:11.698362 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d23d94-f410-41ba-a3b4-142746852745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49b93adb02f6421e98d26e140bc17634)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:11.700576 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d23d94-f410-41ba-a3b4-142746852745 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:11.750039 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-95d23d94-f410-41ba-a3b4-142746852745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49b93adb02f6421e98d26e140bc17634', 'request_id': 'req-95d23d94-f410-41ba-a3b4-142746852745'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:11.758773 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-95d23d94-f410-41ba-a3b4-142746852745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49b93adb02f6421e98d26e140bc17634', 'request_id': 'req-95d23d94-f410-41ba-a3b4-142746852745'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:11.764807 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-95d23d94-f410-41ba-a3b4-142746852745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49b93adb02f6421e98d26e140bc17634', 'request_id': 'req-95d23d94-f410-41ba-a3b4-142746852745'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:11.776974 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-95d23d94-f410-41ba-a3b4-142746852745 admin admin] The token cache is being invalidate because project 49b93adb02f6421e98d26e140bc17634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:55:11.777263 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-95d23d94-f410-41ba-a3b4-142746852745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:11.777953 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-95d23d94-f410-41ba-a3b4-142746852745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:11.779846 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1338/2687] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:55:11 2022] DELETE /identity/v3/projects/49b93adb02f6421e98d26e140bc17634 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:11.785431 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83233f-94c2-4638-9560-f07005625fcb admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:11.787534 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-df83233f-94c2-4638-9560-f07005625fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:11.801324 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83233f-94c2-4638-9560-f07005625fcb admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:11.869309 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c279c-f281-42ce-ba15-c60708bbd461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:11.870290 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c279c-f281-42ce-ba15-c60708bbd461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:11.870675 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c279c-f281-42ce-ba15-c60708bbd461 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:11.871051 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c279c-f281-42ce-ba15-c60708bbd461 admin admin] PATH_INFO: `/v3/users/7e1abd854cd2404e89069d7944d632c3` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:11.872385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c279c-f281-42ce-ba15-c60708bbd461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1abd854cd2404e89069d7944d632c3)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:11.874529 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c279c-f281-42ce-ba15-c60708bbd461 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:11.932008 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-874c279c-f281-42ce-ba15-c60708bbd461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1abd854cd2404e89069d7944d632c3'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:11.938650 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-874c279c-f281-42ce-ba15-c60708bbd461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1abd854cd2404e89069d7944d632c3'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:11.947312 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-874c279c-f281-42ce-ba15-c60708bbd461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1abd854cd2404e89069d7944d632c3'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:11.947992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-874c279c-f281-42ce-ba15-c60708bbd461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1abd854cd2404e89069d7944d632c3'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:11.948653 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-874c279c-f281-42ce-ba15-c60708bbd461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1abd854cd2404e89069d7944d632c3'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:11.966320 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1350/2688] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:55:11 2022] DELETE /identity/v3/users/7e1abd854cd2404e89069d7944d632c3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:12.145727 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d23d94-f410-41ba-a3b4-142746852745 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:12.147642 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-95d23d94-f410-41ba-a3b4-142746852745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:12.162480 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d23d94-f410-41ba-a3b4-142746852745 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:12.352913 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928692ad-ea1c-44e5-b860-d4148cdb17ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:12.353787 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928692ad-ea1c-44e5-b860-d4148cdb17ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:12.354063 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928692ad-ea1c-44e5-b860-d4148cdb17ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:12.354332 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928692ad-ea1c-44e5-b860-d4148cdb17ca admin admin] PATH_INFO: `/v3/projects/4fc186955d454e3e897c9d832e5af9bf` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:12.355575 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928692ad-ea1c-44e5-b860-d4148cdb17ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc186955d454e3e897c9d832e5af9bf)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:12.357641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928692ad-ea1c-44e5-b860-d4148cdb17ca admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:12.404143 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-928692ad-ea1c-44e5-b860-d4148cdb17ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc186955d454e3e897c9d832e5af9bf', 'request_id': 'req-928692ad-ea1c-44e5-b860-d4148cdb17ca'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:12.412450 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-928692ad-ea1c-44e5-b860-d4148cdb17ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc186955d454e3e897c9d832e5af9bf', 'request_id': 'req-928692ad-ea1c-44e5-b860-d4148cdb17ca'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:12.418553 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-928692ad-ea1c-44e5-b860-d4148cdb17ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc186955d454e3e897c9d832e5af9bf', 'request_id': 'req-928692ad-ea1c-44e5-b860-d4148cdb17ca'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:12.431252 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-928692ad-ea1c-44e5-b860-d4148cdb17ca admin admin] The token cache is being invalidate because project 4fc186955d454e3e897c9d832e5af9bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:55:12.431988 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-928692ad-ea1c-44e5-b860-d4148cdb17ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:12.432636 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-928692ad-ea1c-44e5-b860-d4148cdb17ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:12.434220 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1339/2689] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:55:12 2022] DELETE /identity/v3/projects/4fc186955d454e3e897c9d832e5af9bf => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:12.440678 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23368b8-a16f-429e-b1f1-6773c3bde810 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:12.441168 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23368b8-a16f-429e-b1f1-6773c3bde810 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:12.441289 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23368b8-a16f-429e-b1f1-6773c3bde810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:12.460672 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-d23368b8-a16f-429e-b1f1-6773c3bde810 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:12.462140 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d23368b8-a16f-429e-b1f1-6773c3bde810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:12.532133 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1351/2690] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:12.540627 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6ad71-5395-4fdc-9201-281b5dcc9db9 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:12.541009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6ad71-5395-4fdc-9201-281b5dcc9db9 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:12.541340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6ad71-5395-4fdc-9201-281b5dcc9db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:12.561704 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-17a6ad71-5395-4fdc-9201-281b5dcc9db9 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:12.563679 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-17a6ad71-5395-4fdc-9201-281b5dcc9db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:12.572969 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1340/2691] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:55:12.577610 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23368b8-a16f-429e-b1f1-6773c3bde810 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:12.587198 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23368b8-a16f-429e-b1f1-6773c3bde810 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:12.592654 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfbd8d-b6fb-4768-a5b3-2711de04ed98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:12.593332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfbd8d-b6fb-4768-a5b3-2711de04ed98 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:12.593728 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfbd8d-b6fb-4768-a5b3-2711de04ed98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:12.593999 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfbd8d-b6fb-4768-a5b3-2711de04ed98 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:12.594733 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfbd8d-b6fb-4768-a5b3-2711de04ed98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:55:12.595033 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfbd8d-b6fb-4768-a5b3-2711de04ed98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:12.596741 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfbd8d-b6fb-4768-a5b3-2711de04ed98 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:12.609425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1352/2692] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:55:12.613918 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6ad71-5395-4fdc-9201-281b5dcc9db9 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:12.623160 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6ad71-5395-4fdc-9201-281b5dcc9db9 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:12.628236 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a8d66-53b0-4a12-9daa-3fa9b8b21e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:12.628954 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a8d66-53b0-4a12-9daa-3fa9b8b21e2b admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:12.629292 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a8d66-53b0-4a12-9daa-3fa9b8b21e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:12.629610 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a8d66-53b0-4a12-9daa-3fa9b8b21e2b admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:12.630410 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a8d66-53b0-4a12-9daa-3fa9b8b21e2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:12.632397 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a8d66-53b0-4a12-9daa-3fa9b8b21e2b admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:12.659065 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1341/2693] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:55:12 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:12.662969 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfbd8d-b6fb-4768-a5b3-2711de04ed98 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:12.673378 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfbd8d-b6fb-4768-a5b3-2711de04ed98 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:12.729000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853090f1-3cb2-4d15-be49-ceb822a946bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:12.729685 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853090f1-3cb2-4d15-be49-ceb822a946bf admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:12.730064 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853090f1-3cb2-4d15-be49-ceb822a946bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:12.730355 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853090f1-3cb2-4d15-be49-ceb822a946bf admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:12.731237 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853090f1-3cb2-4d15-be49-ceb822a946bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:12.733312 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853090f1-3cb2-4d15-be49-ceb822a946bf admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:12.754491 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1353/2694] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:55:12 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:55:12.758806 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a8d66-53b0-4a12-9daa-3fa9b8b21e2b admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:12.769022 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a8d66-53b0-4a12-9daa-3fa9b8b21e2b admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:12.774061 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413cc55-7143-4d83-9850-8a4cdec734ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:12.774718 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413cc55-7143-4d83-9850-8a4cdec734ac admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:12.774992 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413cc55-7143-4d83-9850-8a4cdec734ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:12.775282 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413cc55-7143-4d83-9850-8a4cdec734ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:12.776075 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413cc55-7143-4d83-9850-8a4cdec734ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:12.777671 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413cc55-7143-4d83-9850-8a4cdec734ac admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:12.788550 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1342/2695] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:12.792586 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853090f1-3cb2-4d15-be49-ceb822a946bf admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:12.802833 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853090f1-3cb2-4d15-be49-ceb822a946bf admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:12.808331 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7a783-9f67-4a47-b8d8-ed0cf6c07cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:12.809001 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7a783-9f67-4a47-b8d8-ed0cf6c07cce admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:12.809389 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7a783-9f67-4a47-b8d8-ed0cf6c07cce admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:12.809677 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7a783-9f67-4a47-b8d8-ed0cf6c07cce admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:12.810423 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7a783-9f67-4a47-b8d8-ed0cf6c07cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:12.812112 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7a783-9f67-4a47-b8d8-ed0cf6c07cce admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:12.824185 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1354/2696] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:12.830370 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413cc55-7143-4d83-9850-8a4cdec734ac admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:12.843741 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413cc55-7143-4d83-9850-8a4cdec734ac admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:12.849156 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4afa8c-9774-4d04-ace5-4e1b140d50b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:12.850010 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4afa8c-9774-4d04-ace5-4e1b140d50b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:12.850284 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4afa8c-9774-4d04-ace5-4e1b140d50b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:12.850548 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4afa8c-9774-4d04-ace5-4e1b140d50b0 admin admin] PATH_INFO: `/v3/projects/6274f5b54d23499882aaa38eced195e6/users/a59a1dbec22e452081ff7c6e6242cadc/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:12.866122 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4afa8c-9774-4d04-ace5-4e1b140d50b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6274f5b54d23499882aaa38eced195e6, user_id=a59a1dbec22e452081ff7c6e6242cadc, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:12.868817 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4afa8c-9774-4d04-ace5-4e1b140d50b0 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:12.885994 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1343/2697] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:12 2022] PUT /identity/v3/projects/6274f5b54d23499882aaa38eced195e6/users/a59a1dbec22e452081ff7c6e6242cadc/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:12.894233 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a593fe-b0b7-4205-87df-03dceccef992 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:12.894599 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a593fe-b0b7-4205-87df-03dceccef992 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:12.894978 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a593fe-b0b7-4205-87df-03dceccef992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:12.916591 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-51a593fe-b0b7-4205-87df-03dceccef992 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:12.917719 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-51a593fe-b0b7-4205-87df-03dceccef992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:12.983690 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1355/2698] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:12.994284 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4afa8c-9774-4d04-ace5-4e1b140d50b0 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:12.997532 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-ea4afa8c-9774-4d04-ace5-4e1b140d50b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:13.064770 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4afa8c-9774-4d04-ace5-4e1b140d50b0 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:13.069308 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91b1f8-ad3c-447e-805a-17203cb66039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:13.069959 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91b1f8-ad3c-447e-805a-17203cb66039 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:13.070500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91b1f8-ad3c-447e-805a-17203cb66039 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:13.070784 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91b1f8-ad3c-447e-805a-17203cb66039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:13.081324 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91b1f8-ad3c-447e-805a-17203cb66039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:13.082767 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91b1f8-ad3c-447e-805a-17203cb66039 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:13.092603 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1344/2699] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:18.014977 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e46e5-b28a-4412-b3c8-b5d93c7228f5 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:18.015552 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e46e5-b28a-4412-b3c8-b5d93c7228f5 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:18.015552 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e46e5-b28a-4412-b3c8-b5d93c7228f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:18.051109 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-cd9e46e5-b28a-4412-b3c8-b5d93c7228f5 None None] MFA Rules not processed for user `a59a1dbec22e452081ff7c6e6242cadc`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:18.052632 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-cd9e46e5-b28a-4412-b3c8-b5d93c7228f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:18.133066 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1356/2700] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:18.137031 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91b1f8-ad3c-447e-805a-17203cb66039 service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:18.153764 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91b1f8-ad3c-447e-805a-17203cb66039 service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:18.160065 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde738c0-eba2-4565-96e2-43b4ebcd5e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:18.160741 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde738c0-eba2-4565-96e2-43b4ebcd5e3c admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:18.161029 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde738c0-eba2-4565-96e2-43b4ebcd5e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:18.161345 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde738c0-eba2-4565-96e2-43b4ebcd5e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:18.162142 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde738c0-eba2-4565-96e2-43b4ebcd5e3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:18.165504 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde738c0-eba2-4565-96e2-43b4ebcd5e3c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:18.205089 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1345/2701] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:55:18 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:18.209138 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e46e5-b28a-4412-b3c8-b5d93c7228f5 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:18.220940 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e46e5-b28a-4412-b3c8-b5d93c7228f5 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:18.311743 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbc4f3-6f3d-45bd-b979-2fb51064585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:18.312463 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbc4f3-6f3d-45bd-b979-2fb51064585f admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:18.312745 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbc4f3-6f3d-45bd-b979-2fb51064585f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:18.313014 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbc4f3-6f3d-45bd-b979-2fb51064585f admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:18.313827 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbc4f3-6f3d-45bd-b979-2fb51064585f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:18.315844 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbc4f3-6f3d-45bd-b979-2fb51064585f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:18.336964 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1357/2702] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:55:18 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:18.341090 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde738c0-eba2-4565-96e2-43b4ebcd5e3c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:18.355213 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde738c0-eba2-4565-96e2-43b4ebcd5e3c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:18.386004 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0086451-c2b9-4ca4-b844-9612ca63c0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:18.387067 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0086451-c2b9-4ca4-b844-9612ca63c0eb admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:18.389687 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0086451-c2b9-4ca4-b844-9612ca63c0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:18.389788 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0086451-c2b9-4ca4-b844-9612ca63c0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:18.390552 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0086451-c2b9-4ca4-b844-9612ca63c0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:18.397422 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0086451-c2b9-4ca4-b844-9612ca63c0eb admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:18.421030 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1346/2703] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:18.422309 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbc4f3-6f3d-45bd-b979-2fb51064585f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:18.433660 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbc4f3-6f3d-45bd-b979-2fb51064585f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:18.446676 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac5e43-5415-45f6-9299-8d2367aaaa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:18.448008 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac5e43-5415-45f6-9299-8d2367aaaa15 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:18.448528 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac5e43-5415-45f6-9299-8d2367aaaa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:18.449043 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac5e43-5415-45f6-9299-8d2367aaaa15 admin admin] PATH_INFO: `/v3/projects/12065deb6ca342fcb2edb62db8dccf9b/users/00f319d74b8c48dc85684942402255d1/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:18.471485 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac5e43-5415-45f6-9299-8d2367aaaa15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12065deb6ca342fcb2edb62db8dccf9b, user_id=00f319d74b8c48dc85684942402255d1, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:18.474461 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac5e43-5415-45f6-9299-8d2367aaaa15 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:18.495585 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1358/2704] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:18 2022] PUT /identity/v3/projects/12065deb6ca342fcb2edb62db8dccf9b/users/00f319d74b8c48dc85684942402255d1/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:18.497718 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0086451-c2b9-4ca4-b844-9612ca63c0eb admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:18.509772 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0086451-c2b9-4ca4-b844-9612ca63c0eb admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:18.572462 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57298f5-e10f-45dc-ab2a-121007446fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:18.573134 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57298f5-e10f-45dc-ab2a-121007446fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:18.573408 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57298f5-e10f-45dc-ab2a-121007446fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:18.573675 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57298f5-e10f-45dc-ab2a-121007446fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:18.574425 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57298f5-e10f-45dc-ab2a-121007446fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:18.576077 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57298f5-e10f-45dc-ab2a-121007446fa9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:18.587560 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1347/2705] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:18.587705 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac5e43-5415-45f6-9299-8d2367aaaa15 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:18.587949 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f4ac5e43-5415-45f6-9299-8d2367aaaa15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:18.590279 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57298f5-e10f-45dc-ab2a-121007446fa9 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:18.600272 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57298f5-e10f-45dc-ab2a-121007446fa9 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:18.600747 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac5e43-5415-45f6-9299-8d2367aaaa15 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:18.605119 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79da9e-09e8-429f-9095-3b2f0bff74ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:18.606120 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79da9e-09e8-429f-9095-3b2f0bff74ed admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:18.606470 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79da9e-09e8-429f-9095-3b2f0bff74ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:18.606817 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79da9e-09e8-429f-9095-3b2f0bff74ed admin admin] PATH_INFO: `/v3/projects/12065deb6ca342fcb2edb62db8dccf9b/users/00f319d74b8c48dc85684942402255d1/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:18.609146 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105745d-3dc5-44af-b9e8-8a62f3bd9d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:18.609604 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79da9e-09e8-429f-9095-3b2f0bff74ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=12065deb6ca342fcb2edb62db8dccf9b, user_id=00f319d74b8c48dc85684942402255d1, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:18.612455 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79da9e-09e8-429f-9095-3b2f0bff74ed admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:18.612761 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105745d-3dc5-44af-b9e8-8a62f3bd9d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:18.613037 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105745d-3dc5-44af-b9e8-8a62f3bd9d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:18.614583 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105745d-3dc5-44af-b9e8-8a62f3bd9d01 admin admin] PATH_INFO: `/v3/users/43ba6e10aaa34cb1b509f8d8b6c7ed61` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:18.616240 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105745d-3dc5-44af-b9e8-8a62f3bd9d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ba6e10aaa34cb1b509f8d8b6c7ed61)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:18.618157 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105745d-3dc5-44af-b9e8-8a62f3bd9d01 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:18.624554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1348/2706] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:18 2022] PUT /identity/v3/projects/12065deb6ca342fcb2edb62db8dccf9b/users/00f319d74b8c48dc85684942402255d1/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:55:18.668130 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0105745d-3dc5-44af-b9e8-8a62f3bd9d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ba6e10aaa34cb1b509f8d8b6c7ed61'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:18.676594 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0105745d-3dc5-44af-b9e8-8a62f3bd9d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ba6e10aaa34cb1b509f8d8b6c7ed61'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:18.685554 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0105745d-3dc5-44af-b9e8-8a62f3bd9d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ba6e10aaa34cb1b509f8d8b6c7ed61'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:18.686222 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0105745d-3dc5-44af-b9e8-8a62f3bd9d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ba6e10aaa34cb1b509f8d8b6c7ed61'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:18.687159 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-0105745d-3dc5-44af-b9e8-8a62f3bd9d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ba6e10aaa34cb1b509f8d8b6c7ed61'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:18.710136 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1359/2707] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:55:18 2022] DELETE /identity/v3/users/43ba6e10aaa34cb1b509f8d8b6c7ed61 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:55:18.714814 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5c731-0009-45a1-b3a5-d74bedc1ae16 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:18.715441 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5c731-0009-45a1-b3a5-d74bedc1ae16 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:18.716169 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5c731-0009-45a1-b3a5-d74bedc1ae16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:18.750990 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-dfc5c731-0009-45a1-b3a5-d74bedc1ae16 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:18.752247 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-dfc5c731-0009-45a1-b3a5-d74bedc1ae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:18.822849 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1349/2708] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:55:18.834438 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105745d-3dc5-44af-b9e8-8a62f3bd9d01 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:18.835973 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-0105745d-3dc5-44af-b9e8-8a62f3bd9d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:18.911915 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105745d-3dc5-44af-b9e8-8a62f3bd9d01 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:18.916231 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916db30-a1b1-48e6-98e1-af1f05dde795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:18.916885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916db30-a1b1-48e6-98e1-af1f05dde795 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:18.917160 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916db30-a1b1-48e6-98e1-af1f05dde795 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:18.917427 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916db30-a1b1-48e6-98e1-af1f05dde795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:18.930561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916db30-a1b1-48e6-98e1-af1f05dde795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:18.932685 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916db30-a1b1-48e6-98e1-af1f05dde795 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:18.944241 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1360/2709] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:19.354921 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5c731-0009-45a1-b3a5-d74bedc1ae16 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:19.356506 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-dfc5c731-0009-45a1-b3a5-d74bedc1ae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:19.369112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5c731-0009-45a1-b3a5-d74bedc1ae16 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:19.376803 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e6dc7-2960-4d66-bd5d-2d820337ccc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:19.378207 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e6dc7-2960-4d66-bd5d-2d820337ccc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:19.378635 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e6dc7-2960-4d66-bd5d-2d820337ccc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:19.379277 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e6dc7-2960-4d66-bd5d-2d820337ccc7 admin admin] PATH_INFO: `/v3/projects/84b8a137aaf143ddbb6cb2a4d5cb5823` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:19.381320 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e6dc7-2960-4d66-bd5d-2d820337ccc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84b8a137aaf143ddbb6cb2a4d5cb5823)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:19.383439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e6dc7-2960-4d66-bd5d-2d820337ccc7 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:19.446181 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3b6e6dc7-2960-4d66-bd5d-2d820337ccc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84b8a137aaf143ddbb6cb2a4d5cb5823', 'request_id': 'req-3b6e6dc7-2960-4d66-bd5d-2d820337ccc7'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:19.454268 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3b6e6dc7-2960-4d66-bd5d-2d820337ccc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84b8a137aaf143ddbb6cb2a4d5cb5823', 'request_id': 'req-3b6e6dc7-2960-4d66-bd5d-2d820337ccc7'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:19.461612 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3b6e6dc7-2960-4d66-bd5d-2d820337ccc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84b8a137aaf143ddbb6cb2a4d5cb5823', 'request_id': 'req-3b6e6dc7-2960-4d66-bd5d-2d820337ccc7'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:19.474095 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3b6e6dc7-2960-4d66-bd5d-2d820337ccc7 admin admin] The token cache is being invalidate because project 84b8a137aaf143ddbb6cb2a4d5cb5823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:55:19.474386 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3b6e6dc7-2960-4d66-bd5d-2d820337ccc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:19.475113 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-3b6e6dc7-2960-4d66-bd5d-2d820337ccc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:19.477288 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1350/2710] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:55:19 2022] DELETE /identity/v3/projects/84b8a137aaf143ddbb6cb2a4d5cb5823 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:19.481159 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916db30-a1b1-48e6-98e1-af1f05dde795 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:19.494197 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916db30-a1b1-48e6-98e1-af1f05dde795 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:19.572891 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97951305-8b9c-4af9-9b38-8db468f7fd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:19.574181 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97951305-8b9c-4af9-9b38-8db468f7fd9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:19.574720 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97951305-8b9c-4af9-9b38-8db468f7fd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:19.575322 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97951305-8b9c-4af9-9b38-8db468f7fd9f admin admin] PATH_INFO: `/v3/users/1a9a9d01faba4ed6a0cc0fe5f1d189ef` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:19.577246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97951305-8b9c-4af9-9b38-8db468f7fd9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a9a9d01faba4ed6a0cc0fe5f1d189ef)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:19.579741 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97951305-8b9c-4af9-9b38-8db468f7fd9f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:19.641717 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-97951305-8b9c-4af9-9b38-8db468f7fd9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a9a9d01faba4ed6a0cc0fe5f1d189ef'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:19.653072 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-97951305-8b9c-4af9-9b38-8db468f7fd9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a9a9d01faba4ed6a0cc0fe5f1d189ef'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:19.665148 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-97951305-8b9c-4af9-9b38-8db468f7fd9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a9a9d01faba4ed6a0cc0fe5f1d189ef'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:19.667818 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-97951305-8b9c-4af9-9b38-8db468f7fd9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a9a9d01faba4ed6a0cc0fe5f1d189ef'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:19.668574 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-97951305-8b9c-4af9-9b38-8db468f7fd9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a9a9d01faba4ed6a0cc0fe5f1d189ef'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:19.693462 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1361/2711] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:55:19 2022] DELETE /identity/v3/users/1a9a9d01faba4ed6a0cc0fe5f1d189ef => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:19.995940 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e6dc7-2960-4d66-bd5d-2d820337ccc7 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:20.001035 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-3b6e6dc7-2960-4d66-bd5d-2d820337ccc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:20.019774 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e6dc7-2960-4d66-bd5d-2d820337ccc7 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:20.094500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9998a-d5b3-4d2d-877b-df9bb3c8a620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:20.095387 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9998a-d5b3-4d2d-877b-df9bb3c8a620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:20.095707 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9998a-d5b3-4d2d-877b-df9bb3c8a620 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:20.096107 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9998a-d5b3-4d2d-877b-df9bb3c8a620 admin admin] PATH_INFO: `/v3/projects/26403772e0fc46d3b1b9704bb3cb43d3` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:20.097914 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9998a-d5b3-4d2d-877b-df9bb3c8a620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26403772e0fc46d3b1b9704bb3cb43d3)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:20.100047 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9998a-d5b3-4d2d-877b-df9bb3c8a620 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:20.160545 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-1cb9998a-d5b3-4d2d-877b-df9bb3c8a620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26403772e0fc46d3b1b9704bb3cb43d3', 'request_id': 'req-1cb9998a-d5b3-4d2d-877b-df9bb3c8a620'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:20.173527 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-1cb9998a-d5b3-4d2d-877b-df9bb3c8a620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26403772e0fc46d3b1b9704bb3cb43d3', 'request_id': 'req-1cb9998a-d5b3-4d2d-877b-df9bb3c8a620'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:20.182794 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-1cb9998a-d5b3-4d2d-877b-df9bb3c8a620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26403772e0fc46d3b1b9704bb3cb43d3', 'request_id': 'req-1cb9998a-d5b3-4d2d-877b-df9bb3c8a620'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:20.197444 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-1cb9998a-d5b3-4d2d-877b-df9bb3c8a620 admin admin] The token cache is being invalidate because project 26403772e0fc46d3b1b9704bb3cb43d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:55:20.198107 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-1cb9998a-d5b3-4d2d-877b-df9bb3c8a620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:20.198825 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-1cb9998a-d5b3-4d2d-877b-df9bb3c8a620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:20.201534 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1351/2712] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:55:19 2022] DELETE /identity/v3/projects/26403772e0fc46d3b1b9704bb3cb43d3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:20.207895 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb5806-2e93-4258-b6e4-5e01dc442522 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:20.208262 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb5806-2e93-4258-b6e4-5e01dc442522 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:20.208609 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb5806-2e93-4258-b6e4-5e01dc442522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:20.228846 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-a9eb5806-2e93-4258-b6e4-5e01dc442522 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:20.230059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-a9eb5806-2e93-4258-b6e4-5e01dc442522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:20.297767 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1362/2713] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:20.306845 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641db9-e396-44e6-ae63-d5d8b9a4dff7 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:20.306845 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641db9-e396-44e6-ae63-d5d8b9a4dff7 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:20.306845 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641db9-e396-44e6-ae63-d5d8b9a4dff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:20.329360 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-11641db9-e396-44e6-ae63-d5d8b9a4dff7 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:20.330846 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-11641db9-e396-44e6-ae63-d5d8b9a4dff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:20.344607 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1352/2714] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:20.345881 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb5806-2e93-4258-b6e4-5e01dc442522 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:20.356055 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb5806-2e93-4258-b6e4-5e01dc442522 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:20.361092 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054087e-f766-42c4-bd0b-cc0a0cdd74be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:20.361754 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054087e-f766-42c4-bd0b-cc0a0cdd74be admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:20.362031 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054087e-f766-42c4-bd0b-cc0a0cdd74be admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:20.362306 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054087e-f766-42c4-bd0b-cc0a0cdd74be admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:20.363059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054087e-f766-42c4-bd0b-cc0a0cdd74be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:55:20.363380 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054087e-f766-42c4-bd0b-cc0a0cdd74be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:20.365008 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054087e-f766-42c4-bd0b-cc0a0cdd74be admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:20.377653 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1363/2715] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:55:20.384112 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11641db9-e396-44e6-ae63-d5d8b9a4dff7 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:20.393363 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11641db9-e396-44e6-ae63-d5d8b9a4dff7 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:20.398141 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b4e0d-66cf-4dbb-8ed2-712ec60dfdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:20.398864 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b4e0d-66cf-4dbb-8ed2-712ec60dfdfa admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:20.399142 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b4e0d-66cf-4dbb-8ed2-712ec60dfdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:20.399418 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b4e0d-66cf-4dbb-8ed2-712ec60dfdfa admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:20.400146 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b4e0d-66cf-4dbb-8ed2-712ec60dfdfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:20.402025 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b4e0d-66cf-4dbb-8ed2-712ec60dfdfa admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:20.433558 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1353/2716] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:55:20 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:20.437948 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054087e-f766-42c4-bd0b-cc0a0cdd74be admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:20.447879 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054087e-f766-42c4-bd0b-cc0a0cdd74be admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:20.510384 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e471d-704d-4e77-833b-3f002df44262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:20.511825 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e471d-704d-4e77-833b-3f002df44262 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:20.512435 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e471d-704d-4e77-833b-3f002df44262 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:20.512886 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e471d-704d-4e77-833b-3f002df44262 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:20.513881 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e471d-704d-4e77-833b-3f002df44262 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:20.516026 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e471d-704d-4e77-833b-3f002df44262 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:20.541310 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1364/2717] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:55:20 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:55:20.544806 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b4e0d-66cf-4dbb-8ed2-712ec60dfdfa admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:20.561041 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b4e0d-66cf-4dbb-8ed2-712ec60dfdfa admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:20.566548 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511b5cf-89b8-4c5b-8ed6-01b9feb82a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:20.567225 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511b5cf-89b8-4c5b-8ed6-01b9feb82a75 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:20.567713 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511b5cf-89b8-4c5b-8ed6-01b9feb82a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:20.567999 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511b5cf-89b8-4c5b-8ed6-01b9feb82a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:20.569287 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511b5cf-89b8-4c5b-8ed6-01b9feb82a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:20.571064 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511b5cf-89b8-4c5b-8ed6-01b9feb82a75 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:20.592783 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1354/2718] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:20.598032 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e471d-704d-4e77-833b-3f002df44262 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:20.612037 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e471d-704d-4e77-833b-3f002df44262 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:20.622043 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9eb55-e92e-46b2-89ed-ba9ecb70da42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:20.623646 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9eb55-e92e-46b2-89ed-ba9ecb70da42 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:20.624381 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9eb55-e92e-46b2-89ed-ba9ecb70da42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:20.625823 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9eb55-e92e-46b2-89ed-ba9ecb70da42 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:20.626789 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9eb55-e92e-46b2-89ed-ba9ecb70da42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:20.628815 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9eb55-e92e-46b2-89ed-ba9ecb70da42 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:20.644867 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1365/2719] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:20.646451 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511b5cf-89b8-4c5b-8ed6-01b9feb82a75 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:20.657347 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511b5cf-89b8-4c5b-8ed6-01b9feb82a75 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:20.673174 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325b04f-a45f-46c9-9063-96f5baf4e3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:20.675064 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325b04f-a45f-46c9-9063-96f5baf4e3a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:20.675357 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325b04f-a45f-46c9-9063-96f5baf4e3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:20.677142 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325b04f-a45f-46c9-9063-96f5baf4e3a8 admin admin] PATH_INFO: `/v3/projects/6ed8511ccf3e4ce3b937fdcbc83b7119/users/b5cf3be961b64df7b6efcca1ad500269/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:20.704977 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325b04f-a45f-46c9-9063-96f5baf4e3a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed8511ccf3e4ce3b937fdcbc83b7119, user_id=b5cf3be961b64df7b6efcca1ad500269, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:20.713604 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325b04f-a45f-46c9-9063-96f5baf4e3a8 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:20.747217 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1355/2720] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:20 2022] PUT /identity/v3/projects/6ed8511ccf3e4ce3b937fdcbc83b7119/users/b5cf3be961b64df7b6efcca1ad500269/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:20.760350 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318dbb4-d1fe-4f0f-86dc-919eac3c4a1e None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:20.760762 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318dbb4-d1fe-4f0f-86dc-919eac3c4a1e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:20.761144 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318dbb4-d1fe-4f0f-86dc-919eac3c4a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:20.804215 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-6318dbb4-d1fe-4f0f-86dc-919eac3c4a1e None None] MFA Rules not processed for user `b5cf3be961b64df7b6efcca1ad500269`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:20.807177 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-6318dbb4-d1fe-4f0f-86dc-919eac3c4a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:20.965781 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1366/2721] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:55:20.976843 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325b04f-a45f-46c9-9063-96f5baf4e3a8 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:20.979031 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e325b04f-a45f-46c9-9063-96f5baf4e3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:21.161498 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325b04f-a45f-46c9-9063-96f5baf4e3a8 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:21.169109 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b0364-c9de-4526-9172-e979bb47c3cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:21.170009 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b0364-c9de-4526-9172-e979bb47c3cf service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:21.170406 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b0364-c9de-4526-9172-e979bb47c3cf service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:21.170777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b0364-c9de-4526-9172-e979bb47c3cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:21.182432 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b0364-c9de-4526-9172-e979bb47c3cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:21.184177 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b0364-c9de-4526-9172-e979bb47c3cf service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:21.194924 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1356/2722] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:22.233410 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318dbb4-d1fe-4f0f-86dc-919eac3c4a1e None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:22.235087 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-6318dbb4-d1fe-4f0f-86dc-919eac3c4a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:22.312143 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318dbb4-d1fe-4f0f-86dc-919eac3c4a1e None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:22.317177 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4249151-78b1-4b64-abea-9d01bc62eb6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:22.317976 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4249151-78b1-4b64-abea-9d01bc62eb6e service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:22.318336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4249151-78b1-4b64-abea-9d01bc62eb6e service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:22.318681 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4249151-78b1-4b64-abea-9d01bc62eb6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:22.320705 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d4249151-78b1-4b64-abea-9d01bc62eb6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:22.458085 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4249151-78b1-4b64-abea-9d01bc62eb6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:22.459693 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4249151-78b1-4b64-abea-9d01bc62eb6e service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:22.484686 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1367/2723] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:24.580942 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e337316-4d55-4af6-8ec7-4173ee307f90 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:24.582052 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e337316-4d55-4af6-8ec7-4173ee307f90 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:24.582561 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e337316-4d55-4af6-8ec7-4173ee307f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:24.620942 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-5e337316-4d55-4af6-8ec7-4173ee307f90 None None] MFA Rules not processed for user `00f319d74b8c48dc85684942402255d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:24.622766 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5e337316-4d55-4af6-8ec7-4173ee307f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:24.756295 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1357/2724] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:24.768666 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4249151-78b1-4b64-abea-9d01bc62eb6e service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:24.770186 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d4249151-78b1-4b64-abea-9d01bc62eb6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:24.885220 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4249151-78b1-4b64-abea-9d01bc62eb6e service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:24.891467 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0edf90-1e97-428f-858c-2233ad05c62b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:24.896306 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0edf90-1e97-428f-858c-2233ad05c62b service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:24.896807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0edf90-1e97-428f-858c-2233ad05c62b service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:24.897288 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0edf90-1e97-428f-858c-2233ad05c62b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:24.899504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-3c0edf90-1e97-428f-858c-2233ad05c62b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:24.986089 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0edf90-1e97-428f-858c-2233ad05c62b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:24.987707 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0edf90-1e97-428f-858c-2233ad05c62b service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:24.999728 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1368/2725] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:26.770156 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e337316-4d55-4af6-8ec7-4173ee307f90 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:26.772334 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5e337316-4d55-4af6-8ec7-4173ee307f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:26.798191 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e337316-4d55-4af6-8ec7-4173ee307f90 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:26.804805 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3fe37-1ac3-49ed-8638-153d2f272d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:26.805930 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3fe37-1ac3-49ed-8638-153d2f272d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:26.807278 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3fe37-1ac3-49ed-8638-153d2f272d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:26.808065 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3fe37-1ac3-49ed-8638-153d2f272d2a admin admin] PATH_INFO: `/v3/users/9bbc10f093cd4a3f9de4d874cfa8b831` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:26.810982 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3fe37-1ac3-49ed-8638-153d2f272d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bbc10f093cd4a3f9de4d874cfa8b831)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:26.813583 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3fe37-1ac3-49ed-8638-153d2f272d2a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:26.890917 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d1c3fe37-1ac3-49ed-8638-153d2f272d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bbc10f093cd4a3f9de4d874cfa8b831'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:26.891639 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d1c3fe37-1ac3-49ed-8638-153d2f272d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bbc10f093cd4a3f9de4d874cfa8b831'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:26.892390 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d1c3fe37-1ac3-49ed-8638-153d2f272d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bbc10f093cd4a3f9de4d874cfa8b831'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:26.933302 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d1c3fe37-1ac3-49ed-8638-153d2f272d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bbc10f093cd4a3f9de4d874cfa8b831'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:26.946551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d1c3fe37-1ac3-49ed-8638-153d2f272d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bbc10f093cd4a3f9de4d874cfa8b831'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:26.980354 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1358/2726] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:55:26 2022] DELETE /identity/v3/users/9bbc10f093cd4a3f9de4d874cfa8b831 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:27.453930 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0edf90-1e97-428f-858c-2233ad05c62b service nova] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:27.471962 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0edf90-1e97-428f-858c-2233ad05c62b service nova] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:27.587251 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216476ce-aaa5-4e0c-a5fb-49c44fa3cd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:27.588672 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216476ce-aaa5-4e0c-a5fb-49c44fa3cd19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:27.590949 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216476ce-aaa5-4e0c-a5fb-49c44fa3cd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:27.591493 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216476ce-aaa5-4e0c-a5fb-49c44fa3cd19 admin admin] PATH_INFO: `/v3/projects/42f048bd448f467aa0b37935d03a60e9` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:27.593928 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216476ce-aaa5-4e0c-a5fb-49c44fa3cd19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42f048bd448f467aa0b37935d03a60e9)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:27.598801 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216476ce-aaa5-4e0c-a5fb-49c44fa3cd19 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:27.675942 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-216476ce-aaa5-4e0c-a5fb-49c44fa3cd19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42f048bd448f467aa0b37935d03a60e9', 'request_id': 'req-216476ce-aaa5-4e0c-a5fb-49c44fa3cd19'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:27.682831 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-216476ce-aaa5-4e0c-a5fb-49c44fa3cd19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42f048bd448f467aa0b37935d03a60e9', 'request_id': 'req-216476ce-aaa5-4e0c-a5fb-49c44fa3cd19'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:27.702659 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-216476ce-aaa5-4e0c-a5fb-49c44fa3cd19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42f048bd448f467aa0b37935d03a60e9', 'request_id': 'req-216476ce-aaa5-4e0c-a5fb-49c44fa3cd19'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:27.726594 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-216476ce-aaa5-4e0c-a5fb-49c44fa3cd19 admin admin] The token cache is being invalidate because project 42f048bd448f467aa0b37935d03a60e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:55:27.726874 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-216476ce-aaa5-4e0c-a5fb-49c44fa3cd19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:27.727811 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-216476ce-aaa5-4e0c-a5fb-49c44fa3cd19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:27.736517 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1369/2727] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:55:27 2022] DELETE /identity/v3/projects/42f048bd448f467aa0b37935d03a60e9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:27.745823 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364dff0-8514-4dac-ba31-278c20ad75d0 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:27.748564 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364dff0-8514-4dac-ba31-278c20ad75d0 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:27.750605 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364dff0-8514-4dac-ba31-278c20ad75d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:27.779878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-5364dff0-8514-4dac-ba31-278c20ad75d0 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:27.782417 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5364dff0-8514-4dac-ba31-278c20ad75d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:27.901231 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1359/2728] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:27.909987 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc5bbf-aa27-474b-8be4-bf315c4f00bc None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:27.910274 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc5bbf-aa27-474b-8be4-bf315c4f00bc None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:27.910548 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc5bbf-aa27-474b-8be4-bf315c4f00bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:27.935143 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-f5fc5bbf-aa27-474b-8be4-bf315c4f00bc None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:27.936787 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f5fc5bbf-aa27-474b-8be4-bf315c4f00bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:27.947978 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1370/2729] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:55:27.951171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364dff0-8514-4dac-ba31-278c20ad75d0 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:27.961878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364dff0-8514-4dac-ba31-278c20ad75d0 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:27.967333 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564889e4-e4f3-41da-a0c1-eadb7202a937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:27.968355 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564889e4-e4f3-41da-a0c1-eadb7202a937 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:27.968799 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564889e4-e4f3-41da-a0c1-eadb7202a937 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:27.969237 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564889e4-e4f3-41da-a0c1-eadb7202a937 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:27.969991 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564889e4-e4f3-41da-a0c1-eadb7202a937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:55:27.970305 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564889e4-e4f3-41da-a0c1-eadb7202a937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:27.972078 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564889e4-e4f3-41da-a0c1-eadb7202a937 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:27.985360 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1360/2730] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:55:27.989805 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc5bbf-aa27-474b-8be4-bf315c4f00bc None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:28.007022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc5bbf-aa27-474b-8be4-bf315c4f00bc None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:28.016169 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d2995-dbed-457a-b594-3e68c43b1943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:28.016805 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d2995-dbed-457a-b594-3e68c43b1943 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:28.017096 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d2995-dbed-457a-b594-3e68c43b1943 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:28.017368 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d2995-dbed-457a-b594-3e68c43b1943 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:28.018093 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d2995-dbed-457a-b594-3e68c43b1943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:28.020056 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d2995-dbed-457a-b594-3e68c43b1943 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:28.051678 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1371/2731] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:55:27 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:55:28.056076 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564889e4-e4f3-41da-a0c1-eadb7202a937 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:28.067304 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564889e4-e4f3-41da-a0c1-eadb7202a937 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:28.116051 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0dd4b-c2a8-49a9-94bc-84366133992f None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:28.116603 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0dd4b-c2a8-49a9-94bc-84366133992f None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:28.117648 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0dd4b-c2a8-49a9-94bc-84366133992f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:28.130361 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc525f0-3d77-4530-9a03-9699666c904c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:28.131057 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc525f0-3d77-4530-9a03-9699666c904c admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:28.131338 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc525f0-3d77-4530-9a03-9699666c904c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:28.131660 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc525f0-3d77-4530-9a03-9699666c904c admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:28.132552 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc525f0-3d77-4530-9a03-9699666c904c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:28.134497 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc525f0-3d77-4530-9a03-9699666c904c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:28.138780 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-ead0dd4b-c2a8-49a9-94bc-84366133992f None None] MFA Rules not processed for user `a59a1dbec22e452081ff7c6e6242cadc`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:28.140021 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ead0dd4b-c2a8-49a9-94bc-84366133992f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:28.159873 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1361/2732] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:55:28 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:55:28.164339 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc525f0-3d77-4530-9a03-9699666c904c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:28.174777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc525f0-3d77-4530-9a03-9699666c904c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:28.179428 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba143a31-506c-4153-b41f-ae5a9b2de250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:28.180161 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba143a31-506c-4153-b41f-ae5a9b2de250 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:28.180436 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba143a31-506c-4153-b41f-ae5a9b2de250 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:28.180707 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba143a31-506c-4153-b41f-ae5a9b2de250 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:28.181826 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba143a31-506c-4153-b41f-ae5a9b2de250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:28.183441 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba143a31-506c-4153-b41f-ae5a9b2de250 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:28.195866 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1362/2733] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:28.200153 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba143a31-506c-4153-b41f-ae5a9b2de250 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:28.207866 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1372/2734] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:55:28.215643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba143a31-506c-4153-b41f-ae5a9b2de250 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:28.221140 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f029188-246c-48bd-85b8-94a31bf79e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:28.221838 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f029188-246c-48bd-85b8-94a31bf79e2d admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:28.222116 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f029188-246c-48bd-85b8-94a31bf79e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:28.222385 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f029188-246c-48bd-85b8-94a31bf79e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:28.223120 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f029188-246c-48bd-85b8-94a31bf79e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:28.224771 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f029188-246c-48bd-85b8-94a31bf79e2d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:28.239000 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1363/2735] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:55:28.240840 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0dd4b-c2a8-49a9-94bc-84366133992f None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:28.254805 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0dd4b-c2a8-49a9-94bc-84366133992f None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:28.263161 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454b8ac-12e9-4f6a-8cfb-290bfe3fb30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:28.264507 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454b8ac-12e9-4f6a-8cfb-290bfe3fb30e admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:28.264816 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454b8ac-12e9-4f6a-8cfb-290bfe3fb30e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:28.265149 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454b8ac-12e9-4f6a-8cfb-290bfe3fb30e admin admin] PATH_INFO: `/v3/projects/ae59f1b1a5c74c759d6d4780bb3012e3/users/6f926e77d0dd4e8b8edc44ba7c870d37/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:28.282504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454b8ac-12e9-4f6a-8cfb-290bfe3fb30e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae59f1b1a5c74c759d6d4780bb3012e3, user_id=6f926e77d0dd4e8b8edc44ba7c870d37, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:28.285262 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454b8ac-12e9-4f6a-8cfb-290bfe3fb30e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:28.299925 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1373/2736] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:28 2022] PUT /identity/v3/projects/ae59f1b1a5c74c759d6d4780bb3012e3/users/6f926e77d0dd4e8b8edc44ba7c870d37/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:28.312298 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d2a1d-279f-4b71-846c-2d38cb001394 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:28.312649 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d2a1d-279f-4b71-846c-2d38cb001394 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:28.312922 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d2a1d-279f-4b71-846c-2d38cb001394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:28.343322 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-4a0d2a1d-279f-4b71-846c-2d38cb001394 None None] MFA Rules not processed for user `6f926e77d0dd4e8b8edc44ba7c870d37`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:28.344684 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-4a0d2a1d-279f-4b71-846c-2d38cb001394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:28.407145 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1364/2737] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:55:28.418298 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454b8ac-12e9-4f6a-8cfb-290bfe3fb30e admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:28.420349 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-2454b8ac-12e9-4f6a-8cfb-290bfe3fb30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:28.496108 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454b8ac-12e9-4f6a-8cfb-290bfe3fb30e admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:28.503062 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36406b-2251-48f6-88df-1ad74584023e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:28.503747 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36406b-2251-48f6-88df-1ad74584023e service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:28.504069 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36406b-2251-48f6-88df-1ad74584023e service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:28.504346 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36406b-2251-48f6-88df-1ad74584023e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:28.512545 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36406b-2251-48f6-88df-1ad74584023e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:28.514056 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36406b-2251-48f6-88df-1ad74584023e service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:28.523807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1374/2738] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:33.532070 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d2a1d-279f-4b71-846c-2d38cb001394 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:33.605029 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d2a1d-279f-4b71-846c-2d38cb001394 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:33.610026 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2c612-1520-427b-9747-c475760ba4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:33.611499 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2c612-1520-427b-9747-c475760ba4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:33.611805 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2c612-1520-427b-9747-c475760ba4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:33.612083 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2c612-1520-427b-9747-c475760ba4f3 admin admin] PATH_INFO: `/v3/users/6f926e77d0dd4e8b8edc44ba7c870d37` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:33.613365 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2c612-1520-427b-9747-c475760ba4f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f926e77d0dd4e8b8edc44ba7c870d37)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:33.615284 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2c612-1520-427b-9747-c475760ba4f3 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:33.664458 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-71b2c612-1520-427b-9747-c475760ba4f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f926e77d0dd4e8b8edc44ba7c870d37'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:33.665138 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-71b2c612-1520-427b-9747-c475760ba4f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f926e77d0dd4e8b8edc44ba7c870d37'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:33.665753 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-71b2c612-1520-427b-9747-c475760ba4f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f926e77d0dd4e8b8edc44ba7c870d37'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:33.679841 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-71b2c612-1520-427b-9747-c475760ba4f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f926e77d0dd4e8b8edc44ba7c870d37'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:33.688231 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-71b2c612-1520-427b-9747-c475760ba4f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f926e77d0dd4e8b8edc44ba7c870d37'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:33.711627 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1365/2739] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:55:33 2022] DELETE /identity/v3/users/6f926e77d0dd4e8b8edc44ba7c870d37 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:33.712281 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb608d-348e-4221-9132-a663285712a6 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:33.712281 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb608d-348e-4221-9132-a663285712a6 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:33.712281 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb608d-348e-4221-9132-a663285712a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:33.740426 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-04bb608d-348e-4221-9132-a663285712a6 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:33.741659 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-04bb608d-348e-4221-9132-a663285712a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:33.808674 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1375/2740] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:55:33.818851 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2c612-1520-427b-9747-c475760ba4f3 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:33.820317 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-71b2c612-1520-427b-9747-c475760ba4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:33.880465 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2c612-1520-427b-9747-c475760ba4f3 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:33.884376 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b238b5c-91e3-4aac-8097-d86fef2d49b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:33.885014 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b238b5c-91e3-4aac-8097-d86fef2d49b2 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:33.885295 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b238b5c-91e3-4aac-8097-d86fef2d49b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:33.885561 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b238b5c-91e3-4aac-8097-d86fef2d49b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:33.894970 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b238b5c-91e3-4aac-8097-d86fef2d49b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:33.896427 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b238b5c-91e3-4aac-8097-d86fef2d49b2 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:33.905748 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1366/2741] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:34.180573 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb608d-348e-4221-9132-a663285712a6 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:34.182598 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-04bb608d-348e-4221-9132-a663285712a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:34.196466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb608d-348e-4221-9132-a663285712a6 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:34.202629 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bc7ab-908b-4c32-86f4-480161d50eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:34.204251 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bc7ab-908b-4c32-86f4-480161d50eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:34.204533 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bc7ab-908b-4c32-86f4-480161d50eac admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:34.204973 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bc7ab-908b-4c32-86f4-480161d50eac admin admin] PATH_INFO: `/v3/projects/ae59f1b1a5c74c759d6d4780bb3012e3` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:34.206420 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3bc7ab-908b-4c32-86f4-480161d50eac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae59f1b1a5c74c759d6d4780bb3012e3)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:34.208481 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3bc7ab-908b-4c32-86f4-480161d50eac admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:34.259409 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-4c3bc7ab-908b-4c32-86f4-480161d50eac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae59f1b1a5c74c759d6d4780bb3012e3', 'request_id': 'req-4c3bc7ab-908b-4c32-86f4-480161d50eac'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:34.265988 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-4c3bc7ab-908b-4c32-86f4-480161d50eac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae59f1b1a5c74c759d6d4780bb3012e3', 'request_id': 'req-4c3bc7ab-908b-4c32-86f4-480161d50eac'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:34.274567 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-4c3bc7ab-908b-4c32-86f4-480161d50eac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae59f1b1a5c74c759d6d4780bb3012e3', 'request_id': 'req-4c3bc7ab-908b-4c32-86f4-480161d50eac'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:34.285174 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-4c3bc7ab-908b-4c32-86f4-480161d50eac admin admin] The token cache is being invalidate because project ae59f1b1a5c74c759d6d4780bb3012e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:55:34.285466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-4c3bc7ab-908b-4c32-86f4-480161d50eac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:34.286152 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-4c3bc7ab-908b-4c32-86f4-480161d50eac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:34.287888 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1376/2742] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:55:34 2022] DELETE /identity/v3/projects/ae59f1b1a5c74c759d6d4780bb3012e3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:34.293899 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4ad78-6aa3-41bb-9774-f17786d6334a None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:34.294072 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4ad78-6aa3-41bb-9774-f17786d6334a None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:34.294372 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4ad78-6aa3-41bb-9774-f17786d6334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:34.313427 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-09e4ad78-6aa3-41bb-9774-f17786d6334a None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:34.314656 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-09e4ad78-6aa3-41bb-9774-f17786d6334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:34.375419 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1367/2743] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:34.383793 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709feb74-ea0a-4de1-9851-f41e03949c9c None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:34.384059 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709feb74-ea0a-4de1-9851-f41e03949c9c None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:34.384346 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709feb74-ea0a-4de1-9851-f41e03949c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:34.405202 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-709feb74-ea0a-4de1-9851-f41e03949c9c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:34.406392 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-709feb74-ea0a-4de1-9851-f41e03949c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:34.418282 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1377/2744] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:34.422965 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4ad78-6aa3-41bb-9774-f17786d6334a None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:34.433496 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4ad78-6aa3-41bb-9774-f17786d6334a None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:34.438422 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7015a3f-103a-4536-b900-baba90cd4382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:34.439042 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7015a3f-103a-4536-b900-baba90cd4382 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:34.439317 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7015a3f-103a-4536-b900-baba90cd4382 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:34.439637 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7015a3f-103a-4536-b900-baba90cd4382 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:34.440370 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7015a3f-103a-4536-b900-baba90cd4382 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:55:34.440699 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7015a3f-103a-4536-b900-baba90cd4382 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:34.442290 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7015a3f-103a-4536-b900-baba90cd4382 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:34.453939 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1368/2745] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:55:34.458584 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709feb74-ea0a-4de1-9851-f41e03949c9c None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:34.468030 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709feb74-ea0a-4de1-9851-f41e03949c9c None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:34.473213 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b56ab-094c-46e1-be41-b31ce8812118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:34.473873 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b56ab-094c-46e1-be41-b31ce8812118 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:34.474185 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b56ab-094c-46e1-be41-b31ce8812118 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:34.474458 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b56ab-094c-46e1-be41-b31ce8812118 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:34.475167 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b56ab-094c-46e1-be41-b31ce8812118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:34.477123 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b56ab-094c-46e1-be41-b31ce8812118 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:34.509077 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1378/2746] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:55:34 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:34.513628 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7015a3f-103a-4536-b900-baba90cd4382 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:34.524918 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7015a3f-103a-4536-b900-baba90cd4382 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:34.595893 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b9957-8138-4af6-a197-2c92b6fdfcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:34.596643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b9957-8138-4af6-a197-2c92b6fdfcf5 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:34.596765 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b9957-8138-4af6-a197-2c92b6fdfcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:34.597001 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b9957-8138-4af6-a197-2c92b6fdfcf5 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:34.597719 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b9957-8138-4af6-a197-2c92b6fdfcf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:34.599690 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b9957-8138-4af6-a197-2c92b6fdfcf5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:34.621294 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1369/2747] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:55:34 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:55:34.626438 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b56ab-094c-46e1-be41-b31ce8812118 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:34.637756 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b56ab-094c-46e1-be41-b31ce8812118 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:34.644175 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c1e6c-fa1d-4e63-8566-8d6910520cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:34.644856 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c1e6c-fa1d-4e63-8566-8d6910520cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:34.645117 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c1e6c-fa1d-4e63-8566-8d6910520cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:34.645379 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c1e6c-fa1d-4e63-8566-8d6910520cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:34.646114 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c1e6c-fa1d-4e63-8566-8d6910520cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:34.647744 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c1e6c-fa1d-4e63-8566-8d6910520cf8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:34.659338 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1379/2748] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:55:34.663641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b9957-8138-4af6-a197-2c92b6fdfcf5 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:34.673877 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b9957-8138-4af6-a197-2c92b6fdfcf5 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:34.678841 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae906a67-8500-48ab-9d6c-70bf202c8220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:34.679503 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae906a67-8500-48ab-9d6c-70bf202c8220 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:34.679813 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae906a67-8500-48ab-9d6c-70bf202c8220 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:34.680200 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae906a67-8500-48ab-9d6c-70bf202c8220 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:34.680946 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae906a67-8500-48ab-9d6c-70bf202c8220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:34.682948 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae906a67-8500-48ab-9d6c-70bf202c8220 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:34.694237 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1370/2749] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:34.698681 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c1e6c-fa1d-4e63-8566-8d6910520cf8 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:34.708626 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c1e6c-fa1d-4e63-8566-8d6910520cf8 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:34.713796 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d99107-9556-4212-9a02-c7055ab853f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:34.714683 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d99107-9556-4212-9a02-c7055ab853f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:34.715628 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d99107-9556-4212-9a02-c7055ab853f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:34.715911 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d99107-9556-4212-9a02-c7055ab853f8 admin admin] PATH_INFO: `/v3/projects/6b2e69d2021b44ad995d30ffa072b858/users/90d6e928da4d438eb12c9bbd4c53e866/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:34.734288 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d99107-9556-4212-9a02-c7055ab853f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2e69d2021b44ad995d30ffa072b858, user_id=90d6e928da4d438eb12c9bbd4c53e866, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:34.736987 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d99107-9556-4212-9a02-c7055ab853f8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:34.756085 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1380/2750] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:34 2022] PUT /identity/v3/projects/6b2e69d2021b44ad995d30ffa072b858/users/90d6e928da4d438eb12c9bbd4c53e866/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:34.772935 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d068f3c-fa36-4505-bf35-76841ad0b3d4 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:34.773412 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d068f3c-fa36-4505-bf35-76841ad0b3d4 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:34.773684 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d068f3c-fa36-4505-bf35-76841ad0b3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:34.803355 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-5d068f3c-fa36-4505-bf35-76841ad0b3d4 None None] MFA Rules not processed for user `90d6e928da4d438eb12c9bbd4c53e866`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:34.804627 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5d068f3c-fa36-4505-bf35-76841ad0b3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:34.879095 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1371/2751] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:34.883871 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d99107-9556-4212-9a02-c7055ab853f8 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:34.952502 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d99107-9556-4212-9a02-c7055ab853f8 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:34.957604 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38caac7f-2674-457a-bff2-18595dfac2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:34.958265 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caac7f-2674-457a-bff2-18595dfac2ff admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:34.958658 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caac7f-2674-457a-bff2-18595dfac2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:34.958811 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38caac7f-2674-457a-bff2-18595dfac2ff admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:34.959653 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38caac7f-2674-457a-bff2-18595dfac2ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:34.961545 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38caac7f-2674-457a-bff2-18595dfac2ff admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:34.987615 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1381/2752] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:55:34 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:34.991735 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d068f3c-fa36-4505-bf35-76841ad0b3d4 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:35.002318 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d068f3c-fa36-4505-bf35-76841ad0b3d4 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:35.062691 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763827d4-7b81-41e4-89a6-2a64684e23cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:35.063499 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763827d4-7b81-41e4-89a6-2a64684e23cf admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:35.063775 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763827d4-7b81-41e4-89a6-2a64684e23cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:35.064045 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763827d4-7b81-41e4-89a6-2a64684e23cf admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:35.064787 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763827d4-7b81-41e4-89a6-2a64684e23cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:35.066700 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763827d4-7b81-41e4-89a6-2a64684e23cf admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:35.089684 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1372/2753] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:55:34 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:55:35.093668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38caac7f-2674-457a-bff2-18595dfac2ff admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:35.104788 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38caac7f-2674-457a-bff2-18595dfac2ff admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:35.109625 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ac73d-9f24-4cef-8c17-b2fad8170dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:35.110432 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ac73d-9f24-4cef-8c17-b2fad8170dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:35.110749 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ac73d-9f24-4cef-8c17-b2fad8170dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:35.111187 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ac73d-9f24-4cef-8c17-b2fad8170dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:35.111995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ac73d-9f24-4cef-8c17-b2fad8170dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:35.113882 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ac73d-9f24-4cef-8c17-b2fad8170dc7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:35.124778 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1382/2754] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:35.129155 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763827d4-7b81-41e4-89a6-2a64684e23cf admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:35.139993 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763827d4-7b81-41e4-89a6-2a64684e23cf admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:35.146409 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca24cc-1cf7-48a3-ad06-b99917f03f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:35.147328 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca24cc-1cf7-48a3-ad06-b99917f03f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:35.147616 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca24cc-1cf7-48a3-ad06-b99917f03f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:35.147891 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca24cc-1cf7-48a3-ad06-b99917f03f46 admin admin] PATH_INFO: `/v3/projects/85012fc6894d46219129cd38b6ded140/users/8fe8af73d54d4cf6a37032dc2ab21710/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:35.168099 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca24cc-1cf7-48a3-ad06-b99917f03f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85012fc6894d46219129cd38b6ded140, user_id=8fe8af73d54d4cf6a37032dc2ab21710, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:35.171104 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca24cc-1cf7-48a3-ad06-b99917f03f46 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:35.186378 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1373/2755] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:35 2022] PUT /identity/v3/projects/85012fc6894d46219129cd38b6ded140/users/8fe8af73d54d4cf6a37032dc2ab21710/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:35.190566 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ac73d-9f24-4cef-8c17-b2fad8170dc7 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:35.200220 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ac73d-9f24-4cef-8c17-b2fad8170dc7 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:35.257645 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa5abc-f9b6-4a81-985a-09e373adcce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:35.258510 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa5abc-f9b6-4a81-985a-09e373adcce3 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:35.258785 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa5abc-f9b6-4a81-985a-09e373adcce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:35.259336 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa5abc-f9b6-4a81-985a-09e373adcce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:35.260253 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa5abc-f9b6-4a81-985a-09e373adcce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:35.262065 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa5abc-f9b6-4a81-985a-09e373adcce3 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:35.274323 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1383/2756] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:35.278649 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca24cc-1cf7-48a3-ad06-b99917f03f46 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:35.289508 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca24cc-1cf7-48a3-ad06-b99917f03f46 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:35.295195 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45f14f-6eb9-4b4c-a9ad-27ba663eafde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:35.296141 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45f14f-6eb9-4b4c-a9ad-27ba663eafde admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:35.296415 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45f14f-6eb9-4b4c-a9ad-27ba663eafde admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:35.296683 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45f14f-6eb9-4b4c-a9ad-27ba663eafde admin admin] PATH_INFO: `/v3/projects/85012fc6894d46219129cd38b6ded140/users/8fe8af73d54d4cf6a37032dc2ab21710/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:35.299082 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45f14f-6eb9-4b4c-a9ad-27ba663eafde admin admin] RBAC: Authorizing `identity:create_grant(project_id=85012fc6894d46219129cd38b6ded140, user_id=8fe8af73d54d4cf6a37032dc2ab21710, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:35.301727 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45f14f-6eb9-4b4c-a9ad-27ba663eafde admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:35.313852 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1374/2757] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:35 2022] PUT /identity/v3/projects/85012fc6894d46219129cd38b6ded140/users/8fe8af73d54d4cf6a37032dc2ab21710/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:35.325791 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbc86d-56eb-4605-a4b2-072dda54d04e None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:35.326530 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbc86d-56eb-4605-a4b2-072dda54d04e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:35.326530 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbc86d-56eb-4605-a4b2-072dda54d04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:35.359429 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-51dbc86d-56eb-4605-a4b2-072dda54d04e None None] MFA Rules not processed for user `8fe8af73d54d4cf6a37032dc2ab21710`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:35.360579 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-51dbc86d-56eb-4605-a4b2-072dda54d04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:35.432332 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1384/2758] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:35 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:35.443168 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45f14f-6eb9-4b4c-a9ad-27ba663eafde admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:35.445259 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-ea45f14f-6eb9-4b4c-a9ad-27ba663eafde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:35.506446 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45f14f-6eb9-4b4c-a9ad-27ba663eafde admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:35.513478 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2df74-8e97-42b7-a456-7c9002720a25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:35.514150 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2df74-8e97-42b7-a456-7c9002720a25 service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:35.514420 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2df74-8e97-42b7-a456-7c9002720a25 service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:35.514697 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2df74-8e97-42b7-a456-7c9002720a25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:35.526978 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2df74-8e97-42b7-a456-7c9002720a25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:35.528440 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2df74-8e97-42b7-a456-7c9002720a25 service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:35.538334 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1375/2759] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:35 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:35.613425 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbc86d-56eb-4605-a4b2-072dda54d04e None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:35.623649 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbc86d-56eb-4605-a4b2-072dda54d04e None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:35.628024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130269b-80dc-44ad-a3a7-a5b451c98c62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:35.628706 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130269b-80dc-44ad-a3a7-a5b451c98c62 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:35.628965 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130269b-80dc-44ad-a3a7-a5b451c98c62 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:35.629223 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130269b-80dc-44ad-a3a7-a5b451c98c62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:35.686831 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130269b-80dc-44ad-a3a7-a5b451c98c62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:35.688310 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130269b-80dc-44ad-a3a7-a5b451c98c62 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:35.697368 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1385/2760] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:36.834439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2df74-8e97-42b7-a456-7c9002720a25 service cinder] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:36.843590 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2df74-8e97-42b7-a456-7c9002720a25 service cinder] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:36.851955 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b6cad-6369-4328-99ac-5158cea7cecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:36.852830 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b6cad-6369-4328-99ac-5158cea7cecc service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:36.853180 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b6cad-6369-4328-99ac-5158cea7cecc service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:36.853490 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b6cad-6369-4328-99ac-5158cea7cecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:36.856103 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-413b6cad-6369-4328-99ac-5158cea7cecc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:36.922647 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b6cad-6369-4328-99ac-5158cea7cecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:36.924153 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b6cad-6369-4328-99ac-5158cea7cecc service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:36.933806 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1376/2761] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:46.962557 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546592e2-fafa-4d62-be30-cea114bf5cd8 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:46.963153 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546592e2-fafa-4d62-be30-cea114bf5cd8 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:46.963153 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546592e2-fafa-4d62-be30-cea114bf5cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:46.981816 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-546592e2-fafa-4d62-be30-cea114bf5cd8 None None] MFA Rules not processed for user `ffd65d5f1d484d48a3ed84cf1592956c`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:46.983013 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-546592e2-fafa-4d62-be30-cea114bf5cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:46.989861 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1386/2762] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:55:48.243054 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caffbc-9622-4fca-9ee4-e4a72a294cfa None None] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:48.244078 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caffbc-9622-4fca-9ee4-e4a72a294cfa None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:48.244452 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caffbc-9622-4fca-9ee4-e4a72a294cfa None None] PATH_INFO: `/` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:48.246534 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1377/2763] 10.222.0.13 () {54 vars in 960 bytes} [Mon Jan 10 12:55:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 10 12:55:48.252191 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d4333-fd54-4ac4-be79-d57207cebb91 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:48.252799 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d4333-fd54-4ac4-be79-d57207cebb91 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:48.252799 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d4333-fd54-4ac4-be79-d57207cebb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:48.288714 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-9b8d4333-fd54-4ac4-be79-d57207cebb91 None None] MFA Rules not processed for user `c6aa01ebd7314f30a1c729ff2b50c975`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:48.289986 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-9b8d4333-fd54-4ac4-be79-d57207cebb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:48.355736 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1387/2764] 10.222.0.13 () {58 vars in 1057 bytes} [Mon Jan 10 12:55:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:48.363713 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caffbc-9622-4fca-9ee4-e4a72a294cfa None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:48.378754 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caffbc-9622-4fca-9ee4-e4a72a294cfa None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:48.384546 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c5994-8252-4e1d-a820-edf4df6f0781 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6aa01ebd7314f30a1c729ff2b50c975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:48.385175 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c5994-8252-4e1d-a820-edf4df6f0781 service placement] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:48.385526 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c5994-8252-4e1d-a820-edf4df6f0781 service placement] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:48.385714 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c5994-8252-4e1d-a820-edf4df6f0781 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:48.387643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-184c5994-8252-4e1d-a820-edf4df6f0781 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:48.399696 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c5994-8252-4e1d-a820-edf4df6f0781 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:48.401314 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c5994-8252-4e1d-a820-edf4df6f0781 service placement] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:48.411500 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1378/2765] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:49.189138 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d4333-fd54-4ac4-be79-d57207cebb91 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:49.266807 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d4333-fd54-4ac4-be79-d57207cebb91 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:49.271449 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090f675-c55a-4b95-aaf8-949bd31ca76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:49.272427 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090f675-c55a-4b95-aaf8-949bd31ca76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:49.272776 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090f675-c55a-4b95-aaf8-949bd31ca76e admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:49.273115 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090f675-c55a-4b95-aaf8-949bd31ca76e admin admin] PATH_INFO: `/v3/users/90d6e928da4d438eb12c9bbd4c53e866` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:49.274463 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090f675-c55a-4b95-aaf8-949bd31ca76e admin admin] RBAC: Authorizing `identity:delete_user(user_id=90d6e928da4d438eb12c9bbd4c53e866)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:49.276580 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090f675-c55a-4b95-aaf8-949bd31ca76e admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:49.326409 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3090f675-c55a-4b95-aaf8-949bd31ca76e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90d6e928da4d438eb12c9bbd4c53e866'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:49.333671 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3090f675-c55a-4b95-aaf8-949bd31ca76e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90d6e928da4d438eb12c9bbd4c53e866'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:49.343304 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3090f675-c55a-4b95-aaf8-949bd31ca76e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90d6e928da4d438eb12c9bbd4c53e866'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:49.344028 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3090f675-c55a-4b95-aaf8-949bd31ca76e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90d6e928da4d438eb12c9bbd4c53e866'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:49.344881 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3090f675-c55a-4b95-aaf8-949bd31ca76e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90d6e928da4d438eb12c9bbd4c53e866'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:49.362611 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1388/2766] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:55:49 2022] DELETE /identity/v3/users/90d6e928da4d438eb12c9bbd4c53e866 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:49.367897 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9218dc5-6451-4b34-b259-0772701d103f None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:49.368521 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9218dc5-6451-4b34-b259-0772701d103f None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:49.368521 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9218dc5-6451-4b34-b259-0772701d103f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:49.387383 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-a9218dc5-6451-4b34-b259-0772701d103f None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:49.388608 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-a9218dc5-6451-4b34-b259-0772701d103f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:49.460333 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1379/2767] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:49.471583 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090f675-c55a-4b95-aaf8-949bd31ca76e admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:49.473176 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-3090f675-c55a-4b95-aaf8-949bd31ca76e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:49.548179 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090f675-c55a-4b95-aaf8-949bd31ca76e admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:49.552615 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040665f8-e30e-4832-bf29-ff41b84eb584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:49.553722 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040665f8-e30e-4832-bf29-ff41b84eb584 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:49.554221 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040665f8-e30e-4832-bf29-ff41b84eb584 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:49.554496 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040665f8-e30e-4832-bf29-ff41b84eb584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:49.568003 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040665f8-e30e-4832-bf29-ff41b84eb584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:49.569700 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040665f8-e30e-4832-bf29-ff41b84eb584 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:49.582476 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1389/2768] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:49.912388 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9218dc5-6451-4b34-b259-0772701d103f None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:49.913941 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-a9218dc5-6451-4b34-b259-0772701d103f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:49.927350 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9218dc5-6451-4b34-b259-0772701d103f None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:49.935284 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c001f47-10b0-4e06-b77a-808c2d68ea74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:49.936641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c001f47-10b0-4e06-b77a-808c2d68ea74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:49.937146 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c001f47-10b0-4e06-b77a-808c2d68ea74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:49.937583 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c001f47-10b0-4e06-b77a-808c2d68ea74 admin admin] PATH_INFO: `/v3/projects/6b2e69d2021b44ad995d30ffa072b858` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:49.939918 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c001f47-10b0-4e06-b77a-808c2d68ea74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b2e69d2021b44ad995d30ffa072b858)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:49.941981 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c001f47-10b0-4e06-b77a-808c2d68ea74 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:50.001677 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-0c001f47-10b0-4e06-b77a-808c2d68ea74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b2e69d2021b44ad995d30ffa072b858', 'request_id': 'req-0c001f47-10b0-4e06-b77a-808c2d68ea74'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:50.013154 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-0c001f47-10b0-4e06-b77a-808c2d68ea74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b2e69d2021b44ad995d30ffa072b858', 'request_id': 'req-0c001f47-10b0-4e06-b77a-808c2d68ea74'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:50.019396 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-0c001f47-10b0-4e06-b77a-808c2d68ea74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b2e69d2021b44ad995d30ffa072b858', 'request_id': 'req-0c001f47-10b0-4e06-b77a-808c2d68ea74'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:50.032302 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-0c001f47-10b0-4e06-b77a-808c2d68ea74 admin admin] The token cache is being invalidate because project 6b2e69d2021b44ad995d30ffa072b858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:55:50.032569 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-0c001f47-10b0-4e06-b77a-808c2d68ea74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:50.033471 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-0c001f47-10b0-4e06-b77a-808c2d68ea74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:50.035276 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1380/2769] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:55:49 2022] DELETE /identity/v3/projects/6b2e69d2021b44ad995d30ffa072b858 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:50.039236 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040665f8-e30e-4832-bf29-ff41b84eb584 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:50.052598 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040665f8-e30e-4832-bf29-ff41b84eb584 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:50.123314 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47461a0d-5a92-47cb-a0a4-8a7fa27a190f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:50.124431 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47461a0d-5a92-47cb-a0a4-8a7fa27a190f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:50.124715 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47461a0d-5a92-47cb-a0a4-8a7fa27a190f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:50.124984 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47461a0d-5a92-47cb-a0a4-8a7fa27a190f admin admin] PATH_INFO: `/v3/users/8fe8af73d54d4cf6a37032dc2ab21710` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:50.126251 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47461a0d-5a92-47cb-a0a4-8a7fa27a190f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe8af73d54d4cf6a37032dc2ab21710)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:50.128423 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47461a0d-5a92-47cb-a0a4-8a7fa27a190f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:50.190121 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-47461a0d-5a92-47cb-a0a4-8a7fa27a190f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe8af73d54d4cf6a37032dc2ab21710'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:50.198066 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-47461a0d-5a92-47cb-a0a4-8a7fa27a190f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe8af73d54d4cf6a37032dc2ab21710'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:50.208186 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-47461a0d-5a92-47cb-a0a4-8a7fa27a190f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe8af73d54d4cf6a37032dc2ab21710'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:50.209071 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-47461a0d-5a92-47cb-a0a4-8a7fa27a190f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe8af73d54d4cf6a37032dc2ab21710'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:50.209671 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-47461a0d-5a92-47cb-a0a4-8a7fa27a190f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe8af73d54d4cf6a37032dc2ab21710'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:50.230657 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1390/2770] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:55:50 2022] DELETE /identity/v3/users/8fe8af73d54d4cf6a37032dc2ab21710 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:50.650077 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c001f47-10b0-4e06-b77a-808c2d68ea74 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:50.652299 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-0c001f47-10b0-4e06-b77a-808c2d68ea74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:50.672499 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c001f47-10b0-4e06-b77a-808c2d68ea74 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:50.744883 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c09524-a302-4f8c-b98f-a61fdcdfab47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:50.746013 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c09524-a302-4f8c-b98f-a61fdcdfab47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:50.747845 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c09524-a302-4f8c-b98f-a61fdcdfab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:50.748316 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c09524-a302-4f8c-b98f-a61fdcdfab47 admin admin] PATH_INFO: `/v3/projects/85012fc6894d46219129cd38b6ded140` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:50.750102 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c09524-a302-4f8c-b98f-a61fdcdfab47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85012fc6894d46219129cd38b6ded140)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:50.754494 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c09524-a302-4f8c-b98f-a61fdcdfab47 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:50.806978 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a7c09524-a302-4f8c-b98f-a61fdcdfab47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85012fc6894d46219129cd38b6ded140', 'request_id': 'req-a7c09524-a302-4f8c-b98f-a61fdcdfab47'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:50.818980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a7c09524-a302-4f8c-b98f-a61fdcdfab47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85012fc6894d46219129cd38b6ded140', 'request_id': 'req-a7c09524-a302-4f8c-b98f-a61fdcdfab47'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:50.828634 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a7c09524-a302-4f8c-b98f-a61fdcdfab47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85012fc6894d46219129cd38b6ded140', 'request_id': 'req-a7c09524-a302-4f8c-b98f-a61fdcdfab47'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:50.842598 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a7c09524-a302-4f8c-b98f-a61fdcdfab47 admin admin] The token cache is being invalidate because project 85012fc6894d46219129cd38b6ded140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:55:50.842882 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a7c09524-a302-4f8c-b98f-a61fdcdfab47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:50.845697 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a7c09524-a302-4f8c-b98f-a61fdcdfab47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:50.847920 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1381/2771] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:55:50 2022] DELETE /identity/v3/projects/85012fc6894d46219129cd38b6ded140 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:50.856413 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f9f60-578b-4d04-b890-f4a3497e2ebf None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:50.857613 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f9f60-578b-4d04-b890-f4a3497e2ebf None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:50.858063 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f9f60-578b-4d04-b890-f4a3497e2ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:50.890388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-8a9f9f60-578b-4d04-b890-f4a3497e2ebf None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:50.891657 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-8a9f9f60-578b-4d04-b890-f4a3497e2ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:50.968015 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1391/2772] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:50.976331 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a534467-3f0f-4e8a-a40f-402c8c3da935 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:50.976612 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a534467-3f0f-4e8a-a40f-402c8c3da935 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:50.976890 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a534467-3f0f-4e8a-a40f-402c8c3da935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:51.005182 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-1a534467-3f0f-4e8a-a40f-402c8c3da935 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:51.007271 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-1a534467-3f0f-4e8a-a40f-402c8c3da935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:51.019899 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1382/2773] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:51.023799 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f9f60-578b-4d04-b890-f4a3497e2ebf None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:51.040126 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f9f60-578b-4d04-b890-f4a3497e2ebf None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:51.056808 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf6fba-63b0-49d1-81ad-613424589a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:51.057494 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf6fba-63b0-49d1-81ad-613424589a71 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:51.057813 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf6fba-63b0-49d1-81ad-613424589a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:51.058259 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf6fba-63b0-49d1-81ad-613424589a71 admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:51.059822 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf6fba-63b0-49d1-81ad-613424589a71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:55:51.060621 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf6fba-63b0-49d1-81ad-613424589a71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:51.062254 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf6fba-63b0-49d1-81ad-613424589a71 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:51.088373 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1392/2774] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:55:51.089943 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a534467-3f0f-4e8a-a40f-402c8c3da935 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:51.134985 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a534467-3f0f-4e8a-a40f-402c8c3da935 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:51.143664 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea779d2-222d-42b5-9b1e-51747f817163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:51.144450 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea779d2-222d-42b5-9b1e-51747f817163 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:51.144789 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea779d2-222d-42b5-9b1e-51747f817163 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:51.145122 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea779d2-222d-42b5-9b1e-51747f817163 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:51.145903 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea779d2-222d-42b5-9b1e-51747f817163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:51.147980 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea779d2-222d-42b5-9b1e-51747f817163 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:51.188019 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1383/2775] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:55:51 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:51.192551 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf6fba-63b0-49d1-81ad-613424589a71 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:51.213851 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf6fba-63b0-49d1-81ad-613424589a71 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:51.294389 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b2f71-f371-4e42-b2f5-e20059b16ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:51.295684 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b2f71-f371-4e42-b2f5-e20059b16ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:51.296106 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b2f71-f371-4e42-b2f5-e20059b16ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:51.296517 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b2f71-f371-4e42-b2f5-e20059b16ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:51.297416 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b2f71-f371-4e42-b2f5-e20059b16ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:51.300006 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b2f71-f371-4e42-b2f5-e20059b16ad9 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:51.367871 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1393/2776] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:55:51 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:51.372305 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea779d2-222d-42b5-9b1e-51747f817163 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:51.382967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea779d2-222d-42b5-9b1e-51747f817163 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:51.390520 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d56884-8899-4a97-848c-0e3a6d762618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:51.391349 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d56884-8899-4a97-848c-0e3a6d762618 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:51.391881 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d56884-8899-4a97-848c-0e3a6d762618 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:51.392247 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d56884-8899-4a97-848c-0e3a6d762618 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:51.393070 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d56884-8899-4a97-848c-0e3a6d762618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:51.394805 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d56884-8899-4a97-848c-0e3a6d762618 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:51.408382 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1384/2777] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:51.412507 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b2f71-f371-4e42-b2f5-e20059b16ad9 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:51.423823 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b2f71-f371-4e42-b2f5-e20059b16ad9 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:51.429990 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cea365-516a-42e4-84b6-b5a9eb327b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:51.430733 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cea365-516a-42e4-84b6-b5a9eb327b1f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:51.431039 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cea365-516a-42e4-84b6-b5a9eb327b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:51.431653 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cea365-516a-42e4-84b6-b5a9eb327b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:51.432389 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cea365-516a-42e4-84b6-b5a9eb327b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:51.434014 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cea365-516a-42e4-84b6-b5a9eb327b1f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:51.446717 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1394/2778] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:51.450943 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d56884-8899-4a97-848c-0e3a6d762618 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:51.461571 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d56884-8899-4a97-848c-0e3a6d762618 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:51.467897 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eef676-fbcd-4dee-8c33-d3c29349bd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:51.468974 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eef676-fbcd-4dee-8c33-d3c29349bd92 admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:51.469251 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eef676-fbcd-4dee-8c33-d3c29349bd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:51.469916 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eef676-fbcd-4dee-8c33-d3c29349bd92 admin admin] PATH_INFO: `/v3/projects/81941108bee84150af5fca8edbe31d4c/users/ddd7c87bb6964aa7b9bb23438c7767c1/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:51.487895 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eef676-fbcd-4dee-8c33-d3c29349bd92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81941108bee84150af5fca8edbe31d4c, user_id=ddd7c87bb6964aa7b9bb23438c7767c1, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:51.490695 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eef676-fbcd-4dee-8c33-d3c29349bd92 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:51.513135 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1385/2779] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:51 2022] PUT /identity/v3/projects/81941108bee84150af5fca8edbe31d4c/users/ddd7c87bb6964aa7b9bb23438c7767c1/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:51.528051 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ad14d-4bae-46d5-8c4a-c1fda5ab89e3 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:51.528640 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ad14d-4bae-46d5-8c4a-c1fda5ab89e3 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:51.529000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ad14d-4bae-46d5-8c4a-c1fda5ab89e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:51.568839 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-985ad14d-4bae-46d5-8c4a-c1fda5ab89e3 None None] MFA Rules not processed for user `ddd7c87bb6964aa7b9bb23438c7767c1`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:51.570048 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-985ad14d-4bae-46d5-8c4a-c1fda5ab89e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:51.635683 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1395/2780] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:51.640187 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eef676-fbcd-4dee-8c33-d3c29349bd92 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:51.714426 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eef676-fbcd-4dee-8c33-d3c29349bd92 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:51.719791 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9e3f3-1448-403d-b297-44a6b98c2bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:51.721011 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9e3f3-1448-403d-b297-44a6b98c2bda admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:51.721011 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9e3f3-1448-403d-b297-44a6b98c2bda admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:51.721197 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9e3f3-1448-403d-b297-44a6b98c2bda admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:51.722041 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9e3f3-1448-403d-b297-44a6b98c2bda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:51.724207 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9e3f3-1448-403d-b297-44a6b98c2bda admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:51.786676 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1386/2781] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:55:51 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:51.791096 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ad14d-4bae-46d5-8c4a-c1fda5ab89e3 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:51.804723 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ad14d-4bae-46d5-8c4a-c1fda5ab89e3 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:51.874150 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dd2de-4f73-4ad0-87a8-a6581ac713a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:51.875022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dd2de-4f73-4ad0-87a8-a6581ac713a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:51.875411 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dd2de-4f73-4ad0-87a8-a6581ac713a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:51.875875 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dd2de-4f73-4ad0-87a8-a6581ac713a5 admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:51.876671 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4dd2de-4f73-4ad0-87a8-a6581ac713a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:51.878816 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4dd2de-4f73-4ad0-87a8-a6581ac713a5 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:51.908866 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1396/2782] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:55:51 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:51.910395 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9e3f3-1448-403d-b297-44a6b98c2bda admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:51.930004 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9e3f3-1448-403d-b297-44a6b98c2bda admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:51.936257 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79116153-db99-47a6-8fe6-e0b541dfef1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:51.937103 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79116153-db99-47a6-8fe6-e0b541dfef1c admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:51.937652 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79116153-db99-47a6-8fe6-e0b541dfef1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:51.937868 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79116153-db99-47a6-8fe6-e0b541dfef1c admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:51.938677 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79116153-db99-47a6-8fe6-e0b541dfef1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:51.941436 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79116153-db99-47a6-8fe6-e0b541dfef1c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:51.995501 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1387/2783] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:51.996931 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dd2de-4f73-4ad0-87a8-a6581ac713a5 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:52.012879 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dd2de-4f73-4ad0-87a8-a6581ac713a5 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:52.034623 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b9e07-ca7f-4d8e-aa19-32bdd0aefabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:52.035694 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b9e07-ca7f-4d8e-aa19-32bdd0aefabd admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:52.036060 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b9e07-ca7f-4d8e-aa19-32bdd0aefabd admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:52.036433 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b9e07-ca7f-4d8e-aa19-32bdd0aefabd admin admin] PATH_INFO: `/v3/projects/cae50128b05e4d78b568706e0d90e2c3/users/30d285d79ebe4092b5e62ad6e3fde3a9/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:52.066124 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b9e07-ca7f-4d8e-aa19-32bdd0aefabd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae50128b05e4d78b568706e0d90e2c3, user_id=30d285d79ebe4092b5e62ad6e3fde3a9, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:52.069231 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b9e07-ca7f-4d8e-aa19-32bdd0aefabd admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:52.089185 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1397/2784] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:51 2022] PUT /identity/v3/projects/cae50128b05e4d78b568706e0d90e2c3/users/30d285d79ebe4092b5e62ad6e3fde3a9/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:52.093276 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79116153-db99-47a6-8fe6-e0b541dfef1c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:52.105469 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79116153-db99-47a6-8fe6-e0b541dfef1c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:52.219143 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1415827-012c-44f7-9ff5-60025dbcb242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:52.219950 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1415827-012c-44f7-9ff5-60025dbcb242 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:52.220230 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1415827-012c-44f7-9ff5-60025dbcb242 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:52.220497 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1415827-012c-44f7-9ff5-60025dbcb242 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:52.221249 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1415827-012c-44f7-9ff5-60025dbcb242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:52.222945 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1415827-012c-44f7-9ff5-60025dbcb242 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:52.239601 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1388/2785] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:55:52.242855 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b9e07-ca7f-4d8e-aa19-32bdd0aefabd admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:52.264593 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b9e07-ca7f-4d8e-aa19-32bdd0aefabd admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:52.270811 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac8e7a-41cb-4d9e-8209-45bc18b34fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:52.272483 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac8e7a-41cb-4d9e-8209-45bc18b34fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:52.273028 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac8e7a-41cb-4d9e-8209-45bc18b34fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:52.273499 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac8e7a-41cb-4d9e-8209-45bc18b34fb7 admin admin] PATH_INFO: `/v3/projects/cae50128b05e4d78b568706e0d90e2c3/users/30d285d79ebe4092b5e62ad6e3fde3a9/roles/9d097c033f454263a874fbafe92c9aea` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:52.278319 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac8e7a-41cb-4d9e-8209-45bc18b34fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae50128b05e4d78b568706e0d90e2c3, user_id=30d285d79ebe4092b5e62ad6e3fde3a9, role_id=9d097c033f454263a874fbafe92c9aea)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:52.282063 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac8e7a-41cb-4d9e-8209-45bc18b34fb7 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:52.295198 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1398/2786] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:52 2022] PUT /identity/v3/projects/cae50128b05e4d78b568706e0d90e2c3/users/30d285d79ebe4092b5e62ad6e3fde3a9/roles/9d097c033f454263a874fbafe92c9aea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:55:52.307281 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b822c39-6db1-47ca-91cd-f77baefcc963 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:52.307586 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b822c39-6db1-47ca-91cd-f77baefcc963 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:52.307855 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b822c39-6db1-47ca-91cd-f77baefcc963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:52.339904 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-4b822c39-6db1-47ca-91cd-f77baefcc963 None None] MFA Rules not processed for user `30d285d79ebe4092b5e62ad6e3fde3a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:52.341151 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-4b822c39-6db1-47ca-91cd-f77baefcc963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:52.442767 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1389/2787] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:52.453349 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac8e7a-41cb-4d9e-8209-45bc18b34fb7 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:52.455119 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-52ac8e7a-41cb-4d9e-8209-45bc18b34fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:52.512086 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac8e7a-41cb-4d9e-8209-45bc18b34fb7 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:52.515878 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d13e1c-c608-4fd5-95bc-af4ca3aca870 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:52.516758 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d13e1c-c608-4fd5-95bc-af4ca3aca870 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:52.517047 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d13e1c-c608-4fd5-95bc-af4ca3aca870 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:52.517322 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d13e1c-c608-4fd5-95bc-af4ca3aca870 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:52.528359 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d13e1c-c608-4fd5-95bc-af4ca3aca870 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:52.529810 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d13e1c-c608-4fd5-95bc-af4ca3aca870 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:52.539870 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1399/2788] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:53.168913 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b822c39-6db1-47ca-91cd-f77baefcc963 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:53.233997 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b822c39-6db1-47ca-91cd-f77baefcc963 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:53.238438 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967467a7-2fdb-4941-903f-2c59783cb05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:53.239321 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967467a7-2fdb-4941-903f-2c59783cb05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:53.239632 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967467a7-2fdb-4941-903f-2c59783cb05a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:53.239903 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967467a7-2fdb-4941-903f-2c59783cb05a admin admin] PATH_INFO: `/v3/users/ddd7c87bb6964aa7b9bb23438c7767c1` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:53.241760 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967467a7-2fdb-4941-903f-2c59783cb05a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddd7c87bb6964aa7b9bb23438c7767c1)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:53.243048 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967467a7-2fdb-4941-903f-2c59783cb05a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:53.288740 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-967467a7-2fdb-4941-903f-2c59783cb05a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddd7c87bb6964aa7b9bb23438c7767c1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:53.289343 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-967467a7-2fdb-4941-903f-2c59783cb05a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddd7c87bb6964aa7b9bb23438c7767c1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:53.290751 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-967467a7-2fdb-4941-903f-2c59783cb05a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddd7c87bb6964aa7b9bb23438c7767c1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:53.304002 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-967467a7-2fdb-4941-903f-2c59783cb05a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddd7c87bb6964aa7b9bb23438c7767c1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:53.311685 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-967467a7-2fdb-4941-903f-2c59783cb05a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddd7c87bb6964aa7b9bb23438c7767c1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:53.325956 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1390/2789] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:55:53 2022] DELETE /identity/v3/users/ddd7c87bb6964aa7b9bb23438c7767c1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:53.331121 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a765e8b-c777-43b7-81be-4c1153cce49d None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:53.331121 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a765e8b-c777-43b7-81be-4c1153cce49d None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:53.331678 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a765e8b-c777-43b7-81be-4c1153cce49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:53.355557 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-6a765e8b-c777-43b7-81be-4c1153cce49d None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:53.355557 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-6a765e8b-c777-43b7-81be-4c1153cce49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:53.421932 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1400/2790] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:53.434674 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967467a7-2fdb-4941-903f-2c59783cb05a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:53.436459 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-967467a7-2fdb-4941-903f-2c59783cb05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:53.512303 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967467a7-2fdb-4941-903f-2c59783cb05a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:53.516680 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a366a4-5b90-46a7-a4d4-ad1ab9d748fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:53.517445 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a366a4-5b90-46a7-a4d4-ad1ab9d748fb service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:53.517822 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a366a4-5b90-46a7-a4d4-ad1ab9d748fb service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:53.518210 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a366a4-5b90-46a7-a4d4-ad1ab9d748fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:53.533431 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a366a4-5b90-46a7-a4d4-ad1ab9d748fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:53.534923 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a366a4-5b90-46a7-a4d4-ad1ab9d748fb service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:53.556003 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1391/2791] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:53.956628 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a765e8b-c777-43b7-81be-4c1153cce49d None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:53.958220 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-6a765e8b-c777-43b7-81be-4c1153cce49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:53.985802 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a765e8b-c777-43b7-81be-4c1153cce49d None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:53.991090 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b68f7-4cc3-45af-b0ab-cb572e6155c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:53.992128 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b68f7-4cc3-45af-b0ab-cb572e6155c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:53.992464 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b68f7-4cc3-45af-b0ab-cb572e6155c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:53.993612 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b68f7-4cc3-45af-b0ab-cb572e6155c8 admin admin] PATH_INFO: `/v3/projects/81941108bee84150af5fca8edbe31d4c` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:53.994722 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b68f7-4cc3-45af-b0ab-cb572e6155c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81941108bee84150af5fca8edbe31d4c)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:53.996975 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b68f7-4cc3-45af-b0ab-cb572e6155c8 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:54.058938 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-8a1b68f7-4cc3-45af-b0ab-cb572e6155c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81941108bee84150af5fca8edbe31d4c', 'request_id': 'req-8a1b68f7-4cc3-45af-b0ab-cb572e6155c8'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:54.066399 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-8a1b68f7-4cc3-45af-b0ab-cb572e6155c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81941108bee84150af5fca8edbe31d4c', 'request_id': 'req-8a1b68f7-4cc3-45af-b0ab-cb572e6155c8'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:54.075213 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-8a1b68f7-4cc3-45af-b0ab-cb572e6155c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81941108bee84150af5fca8edbe31d4c', 'request_id': 'req-8a1b68f7-4cc3-45af-b0ab-cb572e6155c8'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:54.087406 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-8a1b68f7-4cc3-45af-b0ab-cb572e6155c8 admin admin] The token cache is being invalidate because project 81941108bee84150af5fca8edbe31d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:55:54.088090 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-8a1b68f7-4cc3-45af-b0ab-cb572e6155c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:54.088364 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-8a1b68f7-4cc3-45af-b0ab-cb572e6155c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:54.090146 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1401/2792] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:55:53 2022] DELETE /identity/v3/projects/81941108bee84150af5fca8edbe31d4c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:54.094206 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a366a4-5b90-46a7-a4d4-ad1ab9d748fb service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:54.104229 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a366a4-5b90-46a7-a4d4-ad1ab9d748fb service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:54.174393 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e60fc4-a067-4579-97da-e517dcf5400a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:54.176098 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e60fc4-a067-4579-97da-e517dcf5400a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:54.176543 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e60fc4-a067-4579-97da-e517dcf5400a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:54.177029 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e60fc4-a067-4579-97da-e517dcf5400a admin admin] PATH_INFO: `/v3/users/30d285d79ebe4092b5e62ad6e3fde3a9` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:54.178481 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e60fc4-a067-4579-97da-e517dcf5400a admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d285d79ebe4092b5e62ad6e3fde3a9)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:54.181007 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e60fc4-a067-4579-97da-e517dcf5400a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:54.244253 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-90e60fc4-a067-4579-97da-e517dcf5400a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d285d79ebe4092b5e62ad6e3fde3a9'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:54.245047 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-90e60fc4-a067-4579-97da-e517dcf5400a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d285d79ebe4092b5e62ad6e3fde3a9'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:54.245577 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-90e60fc4-a067-4579-97da-e517dcf5400a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d285d79ebe4092b5e62ad6e3fde3a9'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:54.258447 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-90e60fc4-a067-4579-97da-e517dcf5400a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d285d79ebe4092b5e62ad6e3fde3a9'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:54.266688 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-90e60fc4-a067-4579-97da-e517dcf5400a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d285d79ebe4092b5e62ad6e3fde3a9'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:54.302468 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1392/2793] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:55:54 2022] DELETE /identity/v3/users/30d285d79ebe4092b5e62ad6e3fde3a9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:54.786300 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b68f7-4cc3-45af-b0ab-cb572e6155c8 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:54.788361 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-8a1b68f7-4cc3-45af-b0ab-cb572e6155c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:54.803237 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b68f7-4cc3-45af-b0ab-cb572e6155c8 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:54.871820 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1aac4-343a-4be4-aad0-f357939e217a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:54.872711 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1aac4-343a-4be4-aad0-f357939e217a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:54.872994 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1aac4-343a-4be4-aad0-f357939e217a admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:54.873265 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1aac4-343a-4be4-aad0-f357939e217a admin admin] PATH_INFO: `/v3/projects/cae50128b05e4d78b568706e0d90e2c3` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:54.874483 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1aac4-343a-4be4-aad0-f357939e217a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cae50128b05e4d78b568706e0d90e2c3)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:54.876449 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1aac4-343a-4be4-aad0-f357939e217a admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:54.923550 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-28a1aac4-343a-4be4-aad0-f357939e217a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cae50128b05e4d78b568706e0d90e2c3', 'request_id': 'req-28a1aac4-343a-4be4-aad0-f357939e217a'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:54.929495 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-28a1aac4-343a-4be4-aad0-f357939e217a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cae50128b05e4d78b568706e0d90e2c3', 'request_id': 'req-28a1aac4-343a-4be4-aad0-f357939e217a'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:54.939363 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-28a1aac4-343a-4be4-aad0-f357939e217a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cae50128b05e4d78b568706e0d90e2c3', 'request_id': 'req-28a1aac4-343a-4be4-aad0-f357939e217a'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:54.955714 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-28a1aac4-343a-4be4-aad0-f357939e217a admin admin] The token cache is being invalidate because project cae50128b05e4d78b568706e0d90e2c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:55:54.956674 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-28a1aac4-343a-4be4-aad0-f357939e217a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:54.960822 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-28a1aac4-343a-4be4-aad0-f357939e217a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:54.964220 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1402/2794] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:55:54 2022] DELETE /identity/v3/projects/cae50128b05e4d78b568706e0d90e2c3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:54.970547 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cca19-9df6-4eff-a2f1-d56e19f5c62d None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:54.970837 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cca19-9df6-4eff-a2f1-d56e19f5c62d None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:54.971168 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cca19-9df6-4eff-a2f1-d56e19f5c62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:55.006639 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-347cca19-9df6-4eff-a2f1-d56e19f5c62d None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:55.008099 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-347cca19-9df6-4eff-a2f1-d56e19f5c62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:55.116315 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1393/2795] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:55.118317 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a824c-4698-45cf-b66b-ab0a170238e0 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:55.119559 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a824c-4698-45cf-b66b-ab0a170238e0 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:55.119711 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a824c-4698-45cf-b66b-ab0a170238e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:55.144647 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-ca6a824c-4698-45cf-b66b-ab0a170238e0 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:55.145859 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-ca6a824c-4698-45cf-b66b-ab0a170238e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:55.160481 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1403/2796] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:55.164617 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cca19-9df6-4eff-a2f1-d56e19f5c62d None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:55.180340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cca19-9df6-4eff-a2f1-d56e19f5c62d None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:55.189936 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738cd92-d29f-4f5d-b752-92e116bf1040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:55.190657 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738cd92-d29f-4f5d-b752-92e116bf1040 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:55.190940 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738cd92-d29f-4f5d-b752-92e116bf1040 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:55.191214 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738cd92-d29f-4f5d-b752-92e116bf1040 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:55.192007 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738cd92-d29f-4f5d-b752-92e116bf1040 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:55:55.192317 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738cd92-d29f-4f5d-b752-92e116bf1040 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:55.194153 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738cd92-d29f-4f5d-b752-92e116bf1040 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:55.206451 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1394/2797] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:55:55.211073 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a824c-4698-45cf-b66b-ab0a170238e0 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:55.220345 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a824c-4698-45cf-b66b-ab0a170238e0 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:55.224843 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98a540-1008-4e45-bc83-c94025edf960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:55.225507 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98a540-1008-4e45-bc83-c94025edf960 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:55.225784 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98a540-1008-4e45-bc83-c94025edf960 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:55.226053 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98a540-1008-4e45-bc83-c94025edf960 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:55.226749 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98a540-1008-4e45-bc83-c94025edf960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:55.228724 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98a540-1008-4e45-bc83-c94025edf960 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:55.254758 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1404/2798] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:55:55 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:55:55.259201 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738cd92-d29f-4f5d-b752-92e116bf1040 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:55.270746 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738cd92-d29f-4f5d-b752-92e116bf1040 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:55.337219 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d718f-a9f9-4485-9622-ebff6c49ebb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:55.337899 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d718f-a9f9-4485-9622-ebff6c49ebb9 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:55.338178 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d718f-a9f9-4485-9622-ebff6c49ebb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:55.338446 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d718f-a9f9-4485-9622-ebff6c49ebb9 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:55.339155 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d718f-a9f9-4485-9622-ebff6c49ebb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:55.341145 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d718f-a9f9-4485-9622-ebff6c49ebb9 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:55.362799 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1395/2799] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:55:55 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:55.366871 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98a540-1008-4e45-bc83-c94025edf960 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:55.378200 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98a540-1008-4e45-bc83-c94025edf960 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:55.383073 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908945f8-33f5-4fa3-ae19-39889ca68d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:55.383908 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908945f8-33f5-4fa3-ae19-39889ca68d43 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:55.384182 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908945f8-33f5-4fa3-ae19-39889ca68d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:55.384634 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908945f8-33f5-4fa3-ae19-39889ca68d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:55.385384 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908945f8-33f5-4fa3-ae19-39889ca68d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:55.387003 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908945f8-33f5-4fa3-ae19-39889ca68d43 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:55.397661 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1405/2800] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:55.401601 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d718f-a9f9-4485-9622-ebff6c49ebb9 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:55.411950 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d718f-a9f9-4485-9622-ebff6c49ebb9 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:55.417063 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acc519-8754-4296-9217-4576f632ff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:55.417729 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acc519-8754-4296-9217-4576f632ff54 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:55.418008 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acc519-8754-4296-9217-4576f632ff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:55.418280 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acc519-8754-4296-9217-4576f632ff54 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:55.419022 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acc519-8754-4296-9217-4576f632ff54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:55.420646 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acc519-8754-4296-9217-4576f632ff54 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:55.433254 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1396/2801] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:55.437565 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908945f8-33f5-4fa3-ae19-39889ca68d43 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:55.448840 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908945f8-33f5-4fa3-ae19-39889ca68d43 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:55.454111 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b71492-9669-429b-a573-a3ae8f220fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:55.455011 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b71492-9669-429b-a573-a3ae8f220fba admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:55.455287 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b71492-9669-429b-a573-a3ae8f220fba admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:55.455651 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b71492-9669-429b-a573-a3ae8f220fba admin admin] PATH_INFO: `/v3/projects/d251447649604e16bae8513b5d1600b4/users/08801d4c901b4ca78ca201232fe33dca/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:55.474679 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b71492-9669-429b-a573-a3ae8f220fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d251447649604e16bae8513b5d1600b4, user_id=08801d4c901b4ca78ca201232fe33dca, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:55.477701 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b71492-9669-429b-a573-a3ae8f220fba admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:55.494403 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1406/2802] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:55 2022] PUT /identity/v3/projects/d251447649604e16bae8513b5d1600b4/users/08801d4c901b4ca78ca201232fe33dca/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:55:55.505906 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc07f5-6ede-4c00-930f-795b885a34e4 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:55.506193 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc07f5-6ede-4c00-930f-795b885a34e4 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:55.506465 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc07f5-6ede-4c00-930f-795b885a34e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:55.537453 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-c9dc07f5-6ede-4c00-930f-795b885a34e4 None None] MFA Rules not processed for user `08801d4c901b4ca78ca201232fe33dca`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:55.539071 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-c9dc07f5-6ede-4c00-930f-795b885a34e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:55.613809 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1397/2803] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:55.624300 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b71492-9669-429b-a573-a3ae8f220fba admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:55.626082 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-81b71492-9669-429b-a573-a3ae8f220fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:55.680121 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b71492-9669-429b-a573-a3ae8f220fba admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:55.684456 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c4cd3-f3e0-4e2e-9742-948311ac97b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:55.685097 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c4cd3-f3e0-4e2e-9742-948311ac97b2 service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:55.685373 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c4cd3-f3e0-4e2e-9742-948311ac97b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:55.685763 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c4cd3-f3e0-4e2e-9742-948311ac97b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:55.694503 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c4cd3-f3e0-4e2e-9742-948311ac97b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:55.695640 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c4cd3-f3e0-4e2e-9742-948311ac97b2 service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:55.704776 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1407/2804] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:55.724205 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc07f5-6ede-4c00-930f-795b885a34e4 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:55.794988 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc07f5-6ede-4c00-930f-795b885a34e4 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:55.800133 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abec8e2-f9cd-4c0e-aa7a-b72b5558179d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:55.801011 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abec8e2-f9cd-4c0e-aa7a-b72b5558179d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:55.801283 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abec8e2-f9cd-4c0e-aa7a-b72b5558179d admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:55.801550 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abec8e2-f9cd-4c0e-aa7a-b72b5558179d admin admin] PATH_INFO: `/v3/users/08801d4c901b4ca78ca201232fe33dca` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:55.802790 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abec8e2-f9cd-4c0e-aa7a-b72b5558179d admin admin] RBAC: Authorizing `identity:delete_user(user_id=08801d4c901b4ca78ca201232fe33dca)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:55.804758 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abec8e2-f9cd-4c0e-aa7a-b72b5558179d admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:55.851971 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6abec8e2-f9cd-4c0e-aa7a-b72b5558179d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08801d4c901b4ca78ca201232fe33dca'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:55.852703 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6abec8e2-f9cd-4c0e-aa7a-b72b5558179d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08801d4c901b4ca78ca201232fe33dca'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:55.853298 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6abec8e2-f9cd-4c0e-aa7a-b72b5558179d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08801d4c901b4ca78ca201232fe33dca'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:55.865660 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6abec8e2-f9cd-4c0e-aa7a-b72b5558179d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08801d4c901b4ca78ca201232fe33dca'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:55.872488 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-6abec8e2-f9cd-4c0e-aa7a-b72b5558179d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08801d4c901b4ca78ca201232fe33dca'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:55.887380 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1398/2805] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:55:55 2022] DELETE /identity/v3/users/08801d4c901b4ca78ca201232fe33dca => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:55.892184 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91518a1c-3af1-4e13-8e92-73413e3f413f None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:55.892675 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91518a1c-3af1-4e13-8e92-73413e3f413f None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:55.892788 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91518a1c-3af1-4e13-8e92-73413e3f413f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:55.910122 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-91518a1c-3af1-4e13-8e92-73413e3f413f None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:55.911321 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-91518a1c-3af1-4e13-8e92-73413e3f413f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:55.970364 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1408/2806] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:55.982361 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abec8e2-f9cd-4c0e-aa7a-b72b5558179d admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:55.984635 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-6abec8e2-f9cd-4c0e-aa7a-b72b5558179d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:56.058588 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abec8e2-f9cd-4c0e-aa7a-b72b5558179d admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:56.063142 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c3208-51e6-4a22-81c9-b65f55fa3e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:56.063829 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c3208-51e6-4a22-81c9-b65f55fa3e08 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:56.064106 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c3208-51e6-4a22-81c9-b65f55fa3e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:56.064366 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c3208-51e6-4a22-81c9-b65f55fa3e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:56.074164 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c3208-51e6-4a22-81c9-b65f55fa3e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:56.075627 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c3208-51e6-4a22-81c9-b65f55fa3e08 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:56.084802 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1399/2807] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:56.444539 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91518a1c-3af1-4e13-8e92-73413e3f413f None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:56.446102 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-91518a1c-3af1-4e13-8e92-73413e3f413f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:56.459992 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91518a1c-3af1-4e13-8e92-73413e3f413f None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:56.467035 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489dc87-4146-45c8-ab41-9275e120b5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:56.468019 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489dc87-4146-45c8-ab41-9275e120b5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:56.468211 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489dc87-4146-45c8-ab41-9275e120b5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:56.468490 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489dc87-4146-45c8-ab41-9275e120b5ed admin admin] PATH_INFO: `/v3/projects/d251447649604e16bae8513b5d1600b4` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:56.469780 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489dc87-4146-45c8-ab41-9275e120b5ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=d251447649604e16bae8513b5d1600b4)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:56.471760 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489dc87-4146-45c8-ab41-9275e120b5ed admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:56.520704 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5489dc87-4146-45c8-ab41-9275e120b5ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd251447649604e16bae8513b5d1600b4', 'request_id': 'req-5489dc87-4146-45c8-ab41-9275e120b5ed'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:56.527155 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5489dc87-4146-45c8-ab41-9275e120b5ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd251447649604e16bae8513b5d1600b4', 'request_id': 'req-5489dc87-4146-45c8-ab41-9275e120b5ed'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:56.536744 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5489dc87-4146-45c8-ab41-9275e120b5ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd251447649604e16bae8513b5d1600b4', 'request_id': 'req-5489dc87-4146-45c8-ab41-9275e120b5ed'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:56.546813 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5489dc87-4146-45c8-ab41-9275e120b5ed admin admin] The token cache is being invalidate because project d251447649604e16bae8513b5d1600b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:55:56.547096 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5489dc87-4146-45c8-ab41-9275e120b5ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:56.547740 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5489dc87-4146-45c8-ab41-9275e120b5ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:56.549259 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1409/2808] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:55:56 2022] DELETE /identity/v3/projects/d251447649604e16bae8513b5d1600b4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:56.555136 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f49017-9bd9-4117-a4b7-f09d4f95f491 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:56.555653 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f49017-9bd9-4117-a4b7-f09d4f95f491 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:56.555835 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f49017-9bd9-4117-a4b7-f09d4f95f491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:56.577342 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-10f49017-9bd9-4117-a4b7-f09d4f95f491 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:56.578764 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-10f49017-9bd9-4117-a4b7-f09d4f95f491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:56.643269 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1400/2809] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:55:56.651194 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b2bd9-69cd-4680-9fae-9710c6bb3a8c None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:56.651554 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b2bd9-69cd-4680-9fae-9710c6bb3a8c None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:56.651751 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b2bd9-69cd-4680-9fae-9710c6bb3a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:56.670126 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-827b2bd9-69cd-4680-9fae-9710c6bb3a8c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:56.671304 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-827b2bd9-69cd-4680-9fae-9710c6bb3a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:56.688748 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1410/2810] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:56.693620 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f49017-9bd9-4117-a4b7-f09d4f95f491 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:56.704865 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f49017-9bd9-4117-a4b7-f09d4f95f491 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:56.710156 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb3723-4d16-487c-9c3b-cca171bfa97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:56.710828 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb3723-4d16-487c-9c3b-cca171bfa97a admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:56.711106 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb3723-4d16-487c-9c3b-cca171bfa97a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:56.711372 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb3723-4d16-487c-9c3b-cca171bfa97a admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:56.712256 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb3723-4d16-487c-9c3b-cca171bfa97a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:55:56.712558 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb3723-4d16-487c-9c3b-cca171bfa97a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:56.714148 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb3723-4d16-487c-9c3b-cca171bfa97a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:56.730365 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1401/2811] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:55:56.731620 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b2bd9-69cd-4680-9fae-9710c6bb3a8c None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:56.741082 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b2bd9-69cd-4680-9fae-9710c6bb3a8c None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:56.746737 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74aca07-4add-47d8-af3f-77cb6debbb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:56.747415 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74aca07-4add-47d8-af3f-77cb6debbb35 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:56.747717 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74aca07-4add-47d8-af3f-77cb6debbb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:56.747983 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74aca07-4add-47d8-af3f-77cb6debbb35 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:56.748694 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74aca07-4add-47d8-af3f-77cb6debbb35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:56.750634 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74aca07-4add-47d8-af3f-77cb6debbb35 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:56.781124 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1411/2812] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:55:56 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:56.785566 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb3723-4d16-487c-9c3b-cca171bfa97a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:56.795791 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb3723-4d16-487c-9c3b-cca171bfa97a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:56.860418 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713b664-4c6b-4548-8bf9-67c77826edfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:56.861097 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713b664-4c6b-4548-8bf9-67c77826edfe admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:56.861376 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713b664-4c6b-4548-8bf9-67c77826edfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:56.861647 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713b664-4c6b-4548-8bf9-67c77826edfe admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:56.862361 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713b664-4c6b-4548-8bf9-67c77826edfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:56.864341 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713b664-4c6b-4548-8bf9-67c77826edfe admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:56.885891 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1402/2813] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:55:56 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 10 12:55:56.890189 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74aca07-4add-47d8-af3f-77cb6debbb35 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:56.901105 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74aca07-4add-47d8-af3f-77cb6debbb35 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:56.905930 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5890340-8e2f-4604-a98e-a4fa91f86bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:56.906597 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5890340-8e2f-4604-a98e-a4fa91f86bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:56.906878 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5890340-8e2f-4604-a98e-a4fa91f86bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:56.907146 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5890340-8e2f-4604-a98e-a4fa91f86bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:56.907924 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5890340-8e2f-4604-a98e-a4fa91f86bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:56.909534 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5890340-8e2f-4604-a98e-a4fa91f86bf1 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:56.920060 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1412/2814] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:56.924206 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713b664-4c6b-4548-8bf9-67c77826edfe admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:56.936057 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713b664-4c6b-4548-8bf9-67c77826edfe admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:56.942434 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bd152-2090-4703-97f6-a56dc19b3d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:56.943021 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bd152-2090-4703-97f6-a56dc19b3d17 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:56.943299 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bd152-2090-4703-97f6-a56dc19b3d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:56.943564 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bd152-2090-4703-97f6-a56dc19b3d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:56.944309 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bd152-2090-4703-97f6-a56dc19b3d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:56.945905 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bd152-2090-4703-97f6-a56dc19b3d17 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:56.957323 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1403/2815] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:56.961915 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5890340-8e2f-4604-a98e-a4fa91f86bf1 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:56.972229 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5890340-8e2f-4604-a98e-a4fa91f86bf1 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:56.977398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda042fc-6e55-42e7-9896-323b0dce9764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:56.978276 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda042fc-6e55-42e7-9896-323b0dce9764 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:56.978556 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda042fc-6e55-42e7-9896-323b0dce9764 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:56.978827 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda042fc-6e55-42e7-9896-323b0dce9764 admin admin] PATH_INFO: `/v3/projects/f161cf170b324ecdb7187c90737ed6ff/users/b6b1392950814718a25718c91ec656ff/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:56.994750 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda042fc-6e55-42e7-9896-323b0dce9764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f161cf170b324ecdb7187c90737ed6ff, user_id=b6b1392950814718a25718c91ec656ff, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:56.997444 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda042fc-6e55-42e7-9896-323b0dce9764 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:57.011643 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1413/2816] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:56 2022] PUT /identity/v3/projects/f161cf170b324ecdb7187c90737ed6ff/users/b6b1392950814718a25718c91ec656ff/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:57.021898 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032522e-3f29-47eb-a159-89c5265d96eb None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:57.022181 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032522e-3f29-47eb-a159-89c5265d96eb None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:57.022451 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032522e-3f29-47eb-a159-89c5265d96eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:57.049777 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-0032522e-3f29-47eb-a159-89c5265d96eb None None] MFA Rules not processed for user `b6b1392950814718a25718c91ec656ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:57.050985 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-0032522e-3f29-47eb-a159-89c5265d96eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:57.116259 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1404/2817] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:57.128930 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda042fc-6e55-42e7-9896-323b0dce9764 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:57.130828 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-fda042fc-6e55-42e7-9896-323b0dce9764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:57.190461 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda042fc-6e55-42e7-9896-323b0dce9764 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:57.194976 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6a3b2-a834-4d0e-a621-fbce69e9d4ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:57.195544 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6a3b2-a834-4d0e-a621-fbce69e9d4ce service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:57.195858 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6a3b2-a834-4d0e-a621-fbce69e9d4ce service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:57.196130 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6a3b2-a834-4d0e-a621-fbce69e9d4ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:57.204708 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6a3b2-a834-4d0e-a621-fbce69e9d4ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:57.206156 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6a3b2-a834-4d0e-a621-fbce69e9d4ce service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:57.215943 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1414/2818] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:55:57.244738 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032522e-3f29-47eb-a159-89c5265d96eb None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:57.310520 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032522e-3f29-47eb-a159-89c5265d96eb None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:57.320013 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af758b1-be9d-486e-9505-362763a2f001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:57.321358 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af758b1-be9d-486e-9505-362763a2f001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:57.321641 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af758b1-be9d-486e-9505-362763a2f001 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:57.321911 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af758b1-be9d-486e-9505-362763a2f001 admin admin] PATH_INFO: `/v3/users/b6b1392950814718a25718c91ec656ff` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:57.323290 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af758b1-be9d-486e-9505-362763a2f001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b1392950814718a25718c91ec656ff)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:57.325268 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af758b1-be9d-486e-9505-362763a2f001 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:57.375530 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5af758b1-be9d-486e-9505-362763a2f001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b1392950814718a25718c91ec656ff'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:57.376210 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5af758b1-be9d-486e-9505-362763a2f001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b1392950814718a25718c91ec656ff'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:57.376854 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5af758b1-be9d-486e-9505-362763a2f001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b1392950814718a25718c91ec656ff'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:57.388907 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5af758b1-be9d-486e-9505-362763a2f001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b1392950814718a25718c91ec656ff'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:57.395423 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5af758b1-be9d-486e-9505-362763a2f001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b1392950814718a25718c91ec656ff'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:57.409591 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1405/2819] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:55:57 2022] DELETE /identity/v3/users/b6b1392950814718a25718c91ec656ff => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:57.414286 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab010cc-599a-4e84-98f2-93886efe420a None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:57.414573 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab010cc-599a-4e84-98f2-93886efe420a None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:57.415293 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab010cc-599a-4e84-98f2-93886efe420a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:57.433471 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-fab010cc-599a-4e84-98f2-93886efe420a None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:57.434679 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-fab010cc-599a-4e84-98f2-93886efe420a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:57.497515 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1415/2820] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:57.507440 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af758b1-be9d-486e-9505-362763a2f001 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:57.509331 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5af758b1-be9d-486e-9505-362763a2f001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:57.572617 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af758b1-be9d-486e-9505-362763a2f001 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:57.577270 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec0784-d516-4f0f-ad3c-014ae59945a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:57.577928 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec0784-d516-4f0f-ad3c-014ae59945a3 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:57.578208 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec0784-d516-4f0f-ad3c-014ae59945a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:57.578479 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec0784-d516-4f0f-ad3c-014ae59945a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:57.587951 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec0784-d516-4f0f-ad3c-014ae59945a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:57.589407 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec0784-d516-4f0f-ad3c-014ae59945a3 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:57.599364 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1406/2821] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 10 12:55:57.918142 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab010cc-599a-4e84-98f2-93886efe420a None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:57.920115 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-fab010cc-599a-4e84-98f2-93886efe420a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:57.934724 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab010cc-599a-4e84-98f2-93886efe420a None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:57.940393 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c84eb2e-2af1-41b2-9ffb-cc9fdf6f02d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:57.941269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84eb2e-2af1-41b2-9ffb-cc9fdf6f02d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:57.941540 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84eb2e-2af1-41b2-9ffb-cc9fdf6f02d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:57.941803 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c84eb2e-2af1-41b2-9ffb-cc9fdf6f02d2 admin admin] PATH_INFO: `/v3/projects/f161cf170b324ecdb7187c90737ed6ff` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:57.943422 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84eb2e-2af1-41b2-9ffb-cc9fdf6f02d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f161cf170b324ecdb7187c90737ed6ff)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:57.945446 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c84eb2e-2af1-41b2-9ffb-cc9fdf6f02d2 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:58.002345 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-6c84eb2e-2af1-41b2-9ffb-cc9fdf6f02d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f161cf170b324ecdb7187c90737ed6ff', 'request_id': 'req-6c84eb2e-2af1-41b2-9ffb-cc9fdf6f02d2'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:58.010675 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-6c84eb2e-2af1-41b2-9ffb-cc9fdf6f02d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f161cf170b324ecdb7187c90737ed6ff', 'request_id': 'req-6c84eb2e-2af1-41b2-9ffb-cc9fdf6f02d2'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:58.019639 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-6c84eb2e-2af1-41b2-9ffb-cc9fdf6f02d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f161cf170b324ecdb7187c90737ed6ff', 'request_id': 'req-6c84eb2e-2af1-41b2-9ffb-cc9fdf6f02d2'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:58.031019 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-6c84eb2e-2af1-41b2-9ffb-cc9fdf6f02d2 admin admin] The token cache is being invalidate because project f161cf170b324ecdb7187c90737ed6ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:55:58.031297 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-6c84eb2e-2af1-41b2-9ffb-cc9fdf6f02d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:58.031959 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-6c84eb2e-2af1-41b2-9ffb-cc9fdf6f02d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:55:58.033626 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1416/2822] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:55:57 2022] DELETE /identity/v3/projects/f161cf170b324ecdb7187c90737ed6ff => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:55:58.039584 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a65cc2-fc9e-45f9-bcdb-4a7ae695cff8 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:58.040401 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a65cc2-fc9e-45f9-bcdb-4a7ae695cff8 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:58.040677 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a65cc2-fc9e-45f9-bcdb-4a7ae695cff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:58.059780 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-f9a65cc2-fc9e-45f9-bcdb-4a7ae695cff8 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:58.060922 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-f9a65cc2-fc9e-45f9-bcdb-4a7ae695cff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:58.120666 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1407/2823] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:58.129792 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56d47f-8674-4e56-b429-2a2e7fc4db32 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:58.130070 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56d47f-8674-4e56-b429-2a2e7fc4db32 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:58.130335 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56d47f-8674-4e56-b429-2a2e7fc4db32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:58.149222 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-df56d47f-8674-4e56-b429-2a2e7fc4db32 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:58.151679 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-df56d47f-8674-4e56-b429-2a2e7fc4db32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:58.161443 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1417/2824] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:58.166916 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a65cc2-fc9e-45f9-bcdb-4a7ae695cff8 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:58.177223 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a65cc2-fc9e-45f9-bcdb-4a7ae695cff8 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:58.183340 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db7569-6171-4d70-9f97-99b1c7062670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:58.184034 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db7569-6171-4d70-9f97-99b1c7062670 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:58.184308 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db7569-6171-4d70-9f97-99b1c7062670 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:58.184572 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db7569-6171-4d70-9f97-99b1c7062670 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:58.185333 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db7569-6171-4d70-9f97-99b1c7062670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:55:58.185633 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db7569-6171-4d70-9f97-99b1c7062670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:58.187234 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db7569-6171-4d70-9f97-99b1c7062670 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:58.199572 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1408/2825] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:55:58.204061 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56d47f-8674-4e56-b429-2a2e7fc4db32 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:58.217989 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56d47f-8674-4e56-b429-2a2e7fc4db32 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:58.226467 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc0ca8-e224-4df3-a976-897761392c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:58.227727 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc0ca8-e224-4df3-a976-897761392c0f admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:58.228015 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc0ca8-e224-4df3-a976-897761392c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:58.228277 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc0ca8-e224-4df3-a976-897761392c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:58.228976 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc0ca8-e224-4df3-a976-897761392c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:58.230874 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc0ca8-e224-4df3-a976-897761392c0f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:58.259746 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1418/2826] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:55:58 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:58.264974 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db7569-6171-4d70-9f97-99b1c7062670 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:58.281897 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db7569-6171-4d70-9f97-99b1c7062670 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:58.344356 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394822ad-74e1-417e-9b02-5c5754115f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:58.345005 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394822ad-74e1-417e-9b02-5c5754115f38 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:58.345262 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394822ad-74e1-417e-9b02-5c5754115f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:58.345523 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394822ad-74e1-417e-9b02-5c5754115f38 admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:58.346233 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394822ad-74e1-417e-9b02-5c5754115f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:58.348157 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394822ad-74e1-417e-9b02-5c5754115f38 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:58.372703 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1409/2827] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:55:58 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:55:58.377085 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc0ca8-e224-4df3-a976-897761392c0f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:58.387476 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc0ca8-e224-4df3-a976-897761392c0f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:58.392207 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2ceda-d9d5-4abb-b15f-b8cbebb9e575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:58.392855 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2ceda-d9d5-4abb-b15f-b8cbebb9e575 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:58.393125 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2ceda-d9d5-4abb-b15f-b8cbebb9e575 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:58.393388 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2ceda-d9d5-4abb-b15f-b8cbebb9e575 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:58.394123 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2ceda-d9d5-4abb-b15f-b8cbebb9e575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:58.395746 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2ceda-d9d5-4abb-b15f-b8cbebb9e575 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:58.406049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1419/2828] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:58.412347 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394822ad-74e1-417e-9b02-5c5754115f38 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:58.426440 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394822ad-74e1-417e-9b02-5c5754115f38 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:58.432072 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d500f19-f22e-4186-8687-209f83b54010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:58.432738 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500f19-f22e-4186-8687-209f83b54010 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:58.433005 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500f19-f22e-4186-8687-209f83b54010 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:58.433258 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500f19-f22e-4186-8687-209f83b54010 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:58.433989 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d500f19-f22e-4186-8687-209f83b54010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:58.435551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d500f19-f22e-4186-8687-209f83b54010 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:58.445671 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1410/2829] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:55:58.450012 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2ceda-d9d5-4abb-b15f-b8cbebb9e575 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:58.460525 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2ceda-d9d5-4abb-b15f-b8cbebb9e575 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:58.465885 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b731418-8b0d-436f-81e0-b60fc87e4e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:58.466783 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b731418-8b0d-436f-81e0-b60fc87e4e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:58.467051 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b731418-8b0d-436f-81e0-b60fc87e4e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:58.467327 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b731418-8b0d-436f-81e0-b60fc87e4e12 admin admin] PATH_INFO: `/v3/projects/0dc4284bad574579a432ee33d1686603/users/14124f9a628049dab79cfc323bece94c/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:58.482968 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b731418-8b0d-436f-81e0-b60fc87e4e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc4284bad574579a432ee33d1686603, user_id=14124f9a628049dab79cfc323bece94c, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:58.485658 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b731418-8b0d-436f-81e0-b60fc87e4e12 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:58.505178 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1420/2830] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:55:58 2022] PUT /identity/v3/projects/0dc4284bad574579a432ee33d1686603/users/14124f9a628049dab79cfc323bece94c/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:55:58.516615 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857b8c9-6968-42cf-8dcb-040a52643d5f None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:58.516952 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857b8c9-6968-42cf-8dcb-040a52643d5f None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:58.517299 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857b8c9-6968-42cf-8dcb-040a52643d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:58.547312 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-5857b8c9-6968-42cf-8dcb-040a52643d5f None None] MFA Rules not processed for user `14124f9a628049dab79cfc323bece94c`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:55:58.548583 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5857b8c9-6968-42cf-8dcb-040a52643d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:58.612969 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1411/2831] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:55:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:55:58.622918 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b731418-8b0d-436f-81e0-b60fc87e4e12 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:55:58.624913 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-1b731418-8b0d-436f-81e0-b60fc87e4e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:55:58.685718 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b731418-8b0d-436f-81e0-b60fc87e4e12 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:55:58.688830 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ac789-a566-446c-b864-16b57fe6ddbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:55:58.689480 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ac789-a566-446c-b864-16b57fe6ddbf service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:55:58.689753 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ac789-a566-446c-b864-16b57fe6ddbf service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:55:58.690023 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ac789-a566-446c-b864-16b57fe6ddbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:55:58.700018 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ac789-a566-446c-b864-16b57fe6ddbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:55:58.702392 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ac789-a566-446c-b864-16b57fe6ddbf service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:55:58.712613 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1421/2832] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:55:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:56:00.101867 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a2c6f-1f0d-4239-9d49-2782157759c6 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:00.102406 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a2c6f-1f0d-4239-9d49-2782157759c6 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:00.102406 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a2c6f-1f0d-4239-9d49-2782157759c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:00.126562 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-e00a2c6f-1f0d-4239-9d49-2782157759c6 None None] MFA Rules not processed for user `14124f9a628049dab79cfc323bece94c`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:56:00.127775 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e00a2c6f-1f0d-4239-9d49-2782157759c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:00.135262 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1412/2833] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:56:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:56:03.779185 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ac789-a566-446c-b864-16b57fe6ddbf service cinder] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:03.781278 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-394ac789-a566-446c-b864-16b57fe6ddbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:03.875121 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ac789-a566-446c-b864-16b57fe6ddbf service cinder] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:03.879777 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2b012-f707-486e-8bc0-d05fab0fb027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:03.880866 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2b012-f707-486e-8bc0-d05fab0fb027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:03.881295 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2b012-f707-486e-8bc0-d05fab0fb027 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:03.881712 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2b012-f707-486e-8bc0-d05fab0fb027 admin admin] PATH_INFO: `/v3/users/b5cf3be961b64df7b6efcca1ad500269` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:03.883231 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2b012-f707-486e-8bc0-d05fab0fb027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5cf3be961b64df7b6efcca1ad500269)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:03.886252 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2b012-f707-486e-8bc0-d05fab0fb027 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:03.949632 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fdc2b012-f707-486e-8bc0-d05fab0fb027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5cf3be961b64df7b6efcca1ad500269'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:03.957187 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fdc2b012-f707-486e-8bc0-d05fab0fb027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5cf3be961b64df7b6efcca1ad500269'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:03.966270 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fdc2b012-f707-486e-8bc0-d05fab0fb027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5cf3be961b64df7b6efcca1ad500269'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:03.967089 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fdc2b012-f707-486e-8bc0-d05fab0fb027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5cf3be961b64df7b6efcca1ad500269'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:03.968975 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-fdc2b012-f707-486e-8bc0-d05fab0fb027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5cf3be961b64df7b6efcca1ad500269'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:03.991654 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1422/2834] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:56:03 2022] DELETE /identity/v3/users/b5cf3be961b64df7b6efcca1ad500269 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:56:03.996258 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d26ea-3579-49c4-9472-e035e57f32c0 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:03.996749 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d26ea-3579-49c4-9472-e035e57f32c0 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:03.996862 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d26ea-3579-49c4-9472-e035e57f32c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:04.015867 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-df0d26ea-3579-49c4-9472-e035e57f32c0 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:56:04.017075 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-df0d26ea-3579-49c4-9472-e035e57f32c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:04.083845 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1413/2835] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:56:04.095317 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2b012-f707-486e-8bc0-d05fab0fb027 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:04.098215 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-fdc2b012-f707-486e-8bc0-d05fab0fb027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:04.180307 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2b012-f707-486e-8bc0-d05fab0fb027 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:04.185128 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402a1e0-0e1b-4320-a674-6c49f135f925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:04.186087 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402a1e0-0e1b-4320-a674-6c49f135f925 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:04.186466 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402a1e0-0e1b-4320-a674-6c49f135f925 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:04.186835 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402a1e0-0e1b-4320-a674-6c49f135f925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:04.198702 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402a1e0-0e1b-4320-a674-6c49f135f925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:04.200495 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402a1e0-0e1b-4320-a674-6c49f135f925 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:04.211328 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1423/2836] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:56:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:56:04.786958 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d26ea-3579-49c4-9472-e035e57f32c0 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:04.788100 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-df0d26ea-3579-49c4-9472-e035e57f32c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:04.810801 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d26ea-3579-49c4-9472-e035e57f32c0 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:04.818420 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230e4cd-9ea4-4a90-b032-bfd19bf0966a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:04.819210 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230e4cd-9ea4-4a90-b032-bfd19bf0966a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:04.819410 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230e4cd-9ea4-4a90-b032-bfd19bf0966a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:04.819725 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230e4cd-9ea4-4a90-b032-bfd19bf0966a admin admin] PATH_INFO: `/v3/projects/6ed8511ccf3e4ce3b937fdcbc83b7119` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:04.821044 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230e4cd-9ea4-4a90-b032-bfd19bf0966a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed8511ccf3e4ce3b937fdcbc83b7119)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:04.823041 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230e4cd-9ea4-4a90-b032-bfd19bf0966a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:04.870526 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d230e4cd-9ea4-4a90-b032-bfd19bf0966a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed8511ccf3e4ce3b937fdcbc83b7119', 'request_id': 'req-d230e4cd-9ea4-4a90-b032-bfd19bf0966a'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:04.878470 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d230e4cd-9ea4-4a90-b032-bfd19bf0966a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed8511ccf3e4ce3b937fdcbc83b7119', 'request_id': 'req-d230e4cd-9ea4-4a90-b032-bfd19bf0966a'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:04.885819 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d230e4cd-9ea4-4a90-b032-bfd19bf0966a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed8511ccf3e4ce3b937fdcbc83b7119', 'request_id': 'req-d230e4cd-9ea4-4a90-b032-bfd19bf0966a'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:04.898093 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d230e4cd-9ea4-4a90-b032-bfd19bf0966a admin admin] The token cache is being invalidate because project 6ed8511ccf3e4ce3b937fdcbc83b7119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:56:04.898377 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d230e4cd-9ea4-4a90-b032-bfd19bf0966a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:04.899023 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-d230e4cd-9ea4-4a90-b032-bfd19bf0966a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:04.901180 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1414/2837] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:56:04 2022] DELETE /identity/v3/projects/6ed8511ccf3e4ce3b937fdcbc83b7119 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:56:04.907990 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cf74b-4d26-47c5-96cd-1600db0c256e None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:04.908840 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cf74b-4d26-47c5-96cd-1600db0c256e None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:04.909118 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cf74b-4d26-47c5-96cd-1600db0c256e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:04.929946 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-fc8cf74b-4d26-47c5-96cd-1600db0c256e None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:56:04.932830 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-fc8cf74b-4d26-47c5-96cd-1600db0c256e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:05.002445 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1424/2838] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:56:05.010035 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e380b-c82c-4347-b871-4fa730177190 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:05.010558 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e380b-c82c-4347-b871-4fa730177190 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:05.010833 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e380b-c82c-4347-b871-4fa730177190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:05.032339 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-036e380b-c82c-4347-b871-4fa730177190 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:56:05.033539 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-036e380b-c82c-4347-b871-4fa730177190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:05.046274 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1415/2839] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:56:05.051802 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cf74b-4d26-47c5-96cd-1600db0c256e None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:05.064065 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cf74b-4d26-47c5-96cd-1600db0c256e None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:05.070535 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f924b6-2e83-48b2-9db7-43a72e5de74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:05.071505 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f924b6-2e83-48b2-9db7-43a72e5de74f admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:05.071916 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f924b6-2e83-48b2-9db7-43a72e5de74f admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:05.072035 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f924b6-2e83-48b2-9db7-43a72e5de74f admin admin] PATH_INFO: `/v3/domains` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:05.072991 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f924b6-2e83-48b2-9db7-43a72e5de74f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:56:05.073815 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f924b6-2e83-48b2-9db7-43a72e5de74f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:05.075451 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f924b6-2e83-48b2-9db7-43a72e5de74f admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:05.092140 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1425/2840] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:56:05.093155 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e380b-c82c-4347-b871-4fa730177190 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:05.107147 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e380b-c82c-4347-b871-4fa730177190 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:05.114656 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38133642-a812-4b31-9528-4e817ea9f335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:05.115944 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38133642-a812-4b31-9528-4e817ea9f335 admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:05.116879 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38133642-a812-4b31-9528-4e817ea9f335 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:05.117222 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38133642-a812-4b31-9528-4e817ea9f335 admin admin] PATH_INFO: `/v3/projects` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:05.118006 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38133642-a812-4b31-9528-4e817ea9f335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:05.120535 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38133642-a812-4b31-9528-4e817ea9f335 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:05.155571 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1416/2841] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:56:05 2022] POST /identity/v3/projects => generated 369 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:56:05.159683 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f924b6-2e83-48b2-9db7-43a72e5de74f admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:05.170656 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f924b6-2e83-48b2-9db7-43a72e5de74f admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:05.232884 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58c068-a2d9-426c-8e04-8fa644f38f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:05.233569 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58c068-a2d9-426c-8e04-8fa644f38f9b admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:05.233852 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58c068-a2d9-426c-8e04-8fa644f38f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:05.234124 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58c068-a2d9-426c-8e04-8fa644f38f9b admin admin] PATH_INFO: `/v3/users` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:05.234846 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58c068-a2d9-426c-8e04-8fa644f38f9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:05.237216 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58c068-a2d9-426c-8e04-8fa644f38f9b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:05.260106 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1426/2842] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:56:05 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:56:05.264439 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38133642-a812-4b31-9528-4e817ea9f335 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:05.280356 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38133642-a812-4b31-9528-4e817ea9f335 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:05.287235 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab96f6-7839-460f-8753-a034373d905f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:05.288228 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab96f6-7839-460f-8753-a034373d905f admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:05.288576 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab96f6-7839-460f-8753-a034373d905f admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:05.288915 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab96f6-7839-460f-8753-a034373d905f admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:05.289908 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab96f6-7839-460f-8753-a034373d905f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:05.291737 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab96f6-7839-460f-8753-a034373d905f admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:05.303351 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1417/2843] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:56:05.308135 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58c068-a2d9-426c-8e04-8fa644f38f9b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:05.320699 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58c068-a2d9-426c-8e04-8fa644f38f9b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:05.327127 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b57b0f-e54f-4cb3-a17b-acb96c037450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:05.327890 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57b0f-e54f-4cb3-a17b-acb96c037450 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:05.328168 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57b0f-e54f-4cb3-a17b-acb96c037450 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:05.328469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b57b0f-e54f-4cb3-a17b-acb96c037450 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:05.329214 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b57b0f-e54f-4cb3-a17b-acb96c037450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:05.330840 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b57b0f-e54f-4cb3-a17b-acb96c037450 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:05.341940 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1427/2844] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 10 12:56:05.346302 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab96f6-7839-460f-8753-a034373d905f admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:05.357943 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab96f6-7839-460f-8753-a034373d905f admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:05.363221 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317c090-2151-4ebb-a311-418511be8fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:05.364239 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317c090-2151-4ebb-a311-418511be8fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:05.364577 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317c090-2151-4ebb-a311-418511be8fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:05.364931 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317c090-2151-4ebb-a311-418511be8fcb admin admin] PATH_INFO: `/v3/projects/aa5ce21070674aad8125bfaaebd1a33d/users/bd1998a80118447a9916a2d4539d09b8/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:05.384381 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317c090-2151-4ebb-a311-418511be8fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa5ce21070674aad8125bfaaebd1a33d, user_id=bd1998a80118447a9916a2d4539d09b8, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:05.388236 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317c090-2151-4ebb-a311-418511be8fcb admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:05.403913 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1418/2845] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:56:05 2022] PUT /identity/v3/projects/aa5ce21070674aad8125bfaaebd1a33d/users/bd1998a80118447a9916a2d4539d09b8/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 10 12:56:05.415333 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b82496-d34e-4399-81fa-9d1fb6a7b1d0 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:05.415666 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b82496-d34e-4399-81fa-9d1fb6a7b1d0 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:05.415968 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b82496-d34e-4399-81fa-9d1fb6a7b1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:05.443905 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-f8b82496-d34e-4399-81fa-9d1fb6a7b1d0 None None] MFA Rules not processed for user `bd1998a80118447a9916a2d4539d09b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:56:05.445108 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-f8b82496-d34e-4399-81fa-9d1fb6a7b1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:05.512135 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1428/2846] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:56:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:56:05.522425 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317c090-2151-4ebb-a311-418511be8fcb admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:05.524221 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-c317c090-2151-4ebb-a311-418511be8fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:05.579872 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317c090-2151-4ebb-a311-418511be8fcb admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:05.583802 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a681937-2abb-44cc-a4e1-718bfd53a25c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:05.584445 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a681937-2abb-44cc-a4e1-718bfd53a25c service cinder] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:05.584719 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a681937-2abb-44cc-a4e1-718bfd53a25c service cinder] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:05.584971 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a681937-2abb-44cc-a4e1-718bfd53a25c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:05.593304 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a681937-2abb-44cc-a4e1-718bfd53a25c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:05.594742 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a681937-2abb-44cc-a4e1-718bfd53a25c service cinder] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:05.603295 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1419/2847] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:56:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:56:05.628499 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b82496-d34e-4399-81fa-9d1fb6a7b1d0 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:05.699434 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b82496-d34e-4399-81fa-9d1fb6a7b1d0 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:05.704586 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c512da-0782-4bec-921b-312416590549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:05.705470 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c512da-0782-4bec-921b-312416590549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:05.705747 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c512da-0782-4bec-921b-312416590549 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:05.706015 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c512da-0782-4bec-921b-312416590549 admin admin] PATH_INFO: `/v3/users/bd1998a80118447a9916a2d4539d09b8` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:05.707269 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c512da-0782-4bec-921b-312416590549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd1998a80118447a9916a2d4539d09b8)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:05.709256 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c512da-0782-4bec-921b-312416590549 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:05.759652 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-d6c512da-0782-4bec-921b-312416590549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd1998a80118447a9916a2d4539d09b8'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:05.766576 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-d6c512da-0782-4bec-921b-312416590549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd1998a80118447a9916a2d4539d09b8'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:05.775402 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-d6c512da-0782-4bec-921b-312416590549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd1998a80118447a9916a2d4539d09b8'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:05.776331 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-d6c512da-0782-4bec-921b-312416590549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd1998a80118447a9916a2d4539d09b8'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:05.777314 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-d6c512da-0782-4bec-921b-312416590549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd1998a80118447a9916a2d4539d09b8'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:05.794696 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1429/2848] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:56:05 2022] DELETE /identity/v3/users/bd1998a80118447a9916a2d4539d09b8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:56:05.799678 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a3fef-7063-4330-bf14-3f2e6f7f9fab None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:05.799678 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a3fef-7063-4330-bf14-3f2e6f7f9fab None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:05.799678 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a3fef-7063-4330-bf14-3f2e6f7f9fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:05.817348 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-1c3a3fef-7063-4330-bf14-3f2e6f7f9fab None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:56:05.818551 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-1c3a3fef-7063-4330-bf14-3f2e6f7f9fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:05.878301 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1420/2849] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 10 12:56:05.889149 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c512da-0782-4bec-921b-312416590549 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:05.890582 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d6c512da-0782-4bec-921b-312416590549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:05.950651 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c512da-0782-4bec-921b-312416590549 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:05.954789 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376e98b-0565-4ef9-ab61-b11b30ce1048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:05.955503 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376e98b-0565-4ef9-ab61-b11b30ce1048 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:05.955873 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376e98b-0565-4ef9-ab61-b11b30ce1048 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:05.956236 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376e98b-0565-4ef9-ab61-b11b30ce1048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:05.965812 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7376e98b-0565-4ef9-ab61-b11b30ce1048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:05.967294 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7376e98b-0565-4ef9-ab61-b11b30ce1048 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:05.977782 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1430/2850] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:56:06.309711 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a3fef-7063-4330-bf14-3f2e6f7f9fab None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:06.311400 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-1c3a3fef-7063-4330-bf14-3f2e6f7f9fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:06.324716 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a3fef-7063-4330-bf14-3f2e6f7f9fab None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:06.329923 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24517bad-b404-4d2d-8bbb-8982c9ed4bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:06.331205 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24517bad-b404-4d2d-8bbb-8982c9ed4bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:06.331697 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24517bad-b404-4d2d-8bbb-8982c9ed4bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:06.332336 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24517bad-b404-4d2d-8bbb-8982c9ed4bc4 admin admin] PATH_INFO: `/v3/projects/aa5ce21070674aad8125bfaaebd1a33d` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:06.333817 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24517bad-b404-4d2d-8bbb-8982c9ed4bc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa5ce21070674aad8125bfaaebd1a33d)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:06.342760 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24517bad-b404-4d2d-8bbb-8982c9ed4bc4 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:06.406234 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-24517bad-b404-4d2d-8bbb-8982c9ed4bc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa5ce21070674aad8125bfaaebd1a33d', 'request_id': 'req-24517bad-b404-4d2d-8bbb-8982c9ed4bc4'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:06.415265 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-24517bad-b404-4d2d-8bbb-8982c9ed4bc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa5ce21070674aad8125bfaaebd1a33d', 'request_id': 'req-24517bad-b404-4d2d-8bbb-8982c9ed4bc4'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:06.421911 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-24517bad-b404-4d2d-8bbb-8982c9ed4bc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa5ce21070674aad8125bfaaebd1a33d', 'request_id': 'req-24517bad-b404-4d2d-8bbb-8982c9ed4bc4'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:06.433670 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-24517bad-b404-4d2d-8bbb-8982c9ed4bc4 admin admin] The token cache is being invalidate because project aa5ce21070674aad8125bfaaebd1a33d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:56:06.433960 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-24517bad-b404-4d2d-8bbb-8982c9ed4bc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:06.434604 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-24517bad-b404-4d2d-8bbb-8982c9ed4bc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:06.436534 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1421/2851] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:56:06 2022] DELETE /identity/v3/projects/aa5ce21070674aad8125bfaaebd1a33d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:56:07.377820 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376e98b-0565-4ef9-ab61-b11b30ce1048 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:07.379343 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-7376e98b-0565-4ef9-ab61-b11b30ce1048 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:07.391300 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376e98b-0565-4ef9-ab61-b11b30ce1048 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:07.444308 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c5cc3-b0f7-4847-976b-13c5923d6a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:07.445092 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c5cc3-b0f7-4847-976b-13c5923d6a93 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:07.445373 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c5cc3-b0f7-4847-976b-13c5923d6a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:07.445642 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c5cc3-b0f7-4847-976b-13c5923d6a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:07.447746 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-2d3c5cc3-b0f7-4847-976b-13c5923d6a93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:07.509519 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c5cc3-b0f7-4847-976b-13c5923d6a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:07.511538 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c5cc3-b0f7-4847-976b-13c5923d6a93 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:07.520972 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1431/2852] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:56:07 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:56:14.614803 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebbe37-68a6-44de-882e-db16255ae649 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:14.615311 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebbe37-68a6-44de-882e-db16255ae649 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:14.615616 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebbe37-68a6-44de-882e-db16255ae649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:14.641154 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-2cebbe37-68a6-44de-882e-db16255ae649 None None] MFA Rules not processed for user `44e5602fd019411aa8f0e091ed533ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:56:14.642385 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-2cebbe37-68a6-44de-882e-db16255ae649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:14.710649 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1422/2853] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jan 10 12:56:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:56:14.762022 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c5cc3-b0f7-4847-976b-13c5923d6a93 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:14.763808 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-2d3c5cc3-b0f7-4847-976b-13c5923d6a93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:14.832207 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c5cc3-b0f7-4847-976b-13c5923d6a93 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:14.839255 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672402b1-48d8-4913-bfab-5a7f61d52467 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd898c7c2974bb38998ebad22fd5a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:14.840112 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672402b1-48d8-4913-bfab-5a7f61d52467 service swift] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:14.840398 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672402b1-48d8-4913-bfab-5a7f61d52467 service swift] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:14.840654 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672402b1-48d8-4913-bfab-5a7f61d52467 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:14.849866 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672402b1-48d8-4913-bfab-5a7f61d52467 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:14.852144 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672402b1-48d8-4913-bfab-5a7f61d52467 service swift] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:14.860036 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1432/2854] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jan 10 12:56:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:56:15.398197 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ff5e4-1fa2-49d0-8d7c-d1943de6c041 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:15.398658 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ff5e4-1fa2-49d0-8d7c-d1943de6c041 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:15.399087 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ff5e4-1fa2-49d0-8d7c-d1943de6c041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:15.423976 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-bc1ff5e4-1fa2-49d0-8d7c-d1943de6c041 None None] MFA Rules not processed for user `44e5602fd019411aa8f0e091ed533ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:56:15.425144 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-bc1ff5e4-1fa2-49d0-8d7c-d1943de6c041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:15.432805 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1423/2855] 10.222.0.13 () {58 vars in 967 bytes} [Mon Jan 10 12:56:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:56:15.445568 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672402b1-48d8-4913-bfab-5a7f61d52467 service swift] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:15.456577 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672402b1-48d8-4913-bfab-5a7f61d52467 service swift] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:15.462654 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cac62-3790-4079-9889-30c8c1bdb8c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd898c7c2974bb38998ebad22fd5a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:15.463364 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cac62-3790-4079-9889-30c8c1bdb8c4 service swift] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:15.463670 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cac62-3790-4079-9889-30c8c1bdb8c4 service swift] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:15.463924 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cac62-3790-4079-9889-30c8c1bdb8c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:15.472522 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cac62-3790-4079-9889-30c8c1bdb8c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:15.474120 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cac62-3790-4079-9889-30c8c1bdb8c4 service swift] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:15.482787 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1433/2856] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jan 10 12:56:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:56:15.684210 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f03e48-7fad-477e-9b51-07178a96bb7e None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:15.684684 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f03e48-7fad-477e-9b51-07178a96bb7e None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:15.684780 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f03e48-7fad-477e-9b51-07178a96bb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:15.703458 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-45f03e48-7fad-477e-9b51-07178a96bb7e None None] MFA Rules not processed for user `44e5602fd019411aa8f0e091ed533ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:56:15.704698 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-45f03e48-7fad-477e-9b51-07178a96bb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:15.712858 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1424/2857] 10.222.0.13 () {58 vars in 1009 bytes} [Mon Jan 10 12:56:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:56:15.725226 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cac62-3790-4079-9889-30c8c1bdb8c4 service swift] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:15.736410 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cac62-3790-4079-9889-30c8c1bdb8c4 service swift] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:15.741910 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38020e33-9ec2-4dbd-b37f-e02c8d4c3de9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd898c7c2974bb38998ebad22fd5a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:15.742589 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38020e33-9ec2-4dbd-b37f-e02c8d4c3de9 service swift] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:15.742871 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38020e33-9ec2-4dbd-b37f-e02c8d4c3de9 service swift] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:15.743159 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38020e33-9ec2-4dbd-b37f-e02c8d4c3de9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:15.751932 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38020e33-9ec2-4dbd-b37f-e02c8d4c3de9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:15.753469 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38020e33-9ec2-4dbd-b37f-e02c8d4c3de9 service swift] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:15.761335 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1434/2858] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jan 10 12:56:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:56:16.115558 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a89feb-3f1f-4fa7-916e-f9274ab6a710 None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:16.115899 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a89feb-3f1f-4fa7-916e-f9274ab6a710 None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:16.116236 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a89feb-3f1f-4fa7-916e-f9274ab6a710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:16.142084 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-42a89feb-3f1f-4fa7-916e-f9274ab6a710 None None] MFA Rules not processed for user `44e5602fd019411aa8f0e091ed533ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:56:16.143281 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-42a89feb-3f1f-4fa7-916e-f9274ab6a710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:16.151978 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1425/2859] 10.222.0.13 () {58 vars in 967 bytes} [Mon Jan 10 12:56:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:56:16.168945 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38020e33-9ec2-4dbd-b37f-e02c8d4c3de9 service swift] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:16.180011 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38020e33-9ec2-4dbd-b37f-e02c8d4c3de9 service swift] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:16.186891 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f633a-081b-4228-acfa-4bd5c6fc04f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd898c7c2974bb38998ebad22fd5a3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:16.187567 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f633a-081b-4228-acfa-4bd5c6fc04f7 service swift] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:16.187838 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f633a-081b-4228-acfa-4bd5c6fc04f7 service swift] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:16.188106 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f633a-081b-4228-acfa-4bd5c6fc04f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:16.196632 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f633a-081b-4228-acfa-4bd5c6fc04f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:16.198229 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f633a-081b-4228-acfa-4bd5c6fc04f7 service swift] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:16.206346 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1435/2860] 10.222.0.13 () {60 vars in 1384 bytes} [Mon Jan 10 12:56:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 10 12:56:18.263470 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a89feb-3f1f-4fa7-916e-f9274ab6a710 None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:18.265101 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-42a89feb-3f1f-4fa7-916e-f9274ab6a710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:18.339376 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a89feb-3f1f-4fa7-916e-f9274ab6a710 None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:18.345537 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc18c3d-2b71-4206-b15c-de35fd5b66ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:18.346427 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc18c3d-2b71-4206-b15c-de35fd5b66ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:18.346707 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc18c3d-2b71-4206-b15c-de35fd5b66ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:18.346985 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc18c3d-2b71-4206-b15c-de35fd5b66ed admin admin] PATH_INFO: `/v3/users/14124f9a628049dab79cfc323bece94c` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:18.348316 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc18c3d-2b71-4206-b15c-de35fd5b66ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=14124f9a628049dab79cfc323bece94c)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:18.350258 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc18c3d-2b71-4206-b15c-de35fd5b66ed admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:18.414796 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-7bc18c3d-2b71-4206-b15c-de35fd5b66ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14124f9a628049dab79cfc323bece94c'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:18.415760 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-7bc18c3d-2b71-4206-b15c-de35fd5b66ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14124f9a628049dab79cfc323bece94c'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:18.416694 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-7bc18c3d-2b71-4206-b15c-de35fd5b66ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14124f9a628049dab79cfc323bece94c'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:18.430213 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-7bc18c3d-2b71-4206-b15c-de35fd5b66ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14124f9a628049dab79cfc323bece94c'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:18.437748 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-7bc18c3d-2b71-4206-b15c-de35fd5b66ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14124f9a628049dab79cfc323bece94c'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:18.452291 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1426/2861] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:56:18 2022] DELETE /identity/v3/users/14124f9a628049dab79cfc323bece94c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:56:18.457196 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c3a40-49a2-4220-9ef3-470b6dc22876 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:18.457693 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c3a40-49a2-4220-9ef3-470b6dc22876 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:18.457815 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c3a40-49a2-4220-9ef3-470b6dc22876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:18.476053 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-7b3c3a40-49a2-4220-9ef3-470b6dc22876 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:56:18.477265 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-7b3c3a40-49a2-4220-9ef3-470b6dc22876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:18.554514 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1436/2862] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:56:18.566093 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc18c3d-2b71-4206-b15c-de35fd5b66ed admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:18.567656 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-7bc18c3d-2b71-4206-b15c-de35fd5b66ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:18.629423 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc18c3d-2b71-4206-b15c-de35fd5b66ed admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:18.633877 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935ffbf-d34b-44d9-b96d-b13a15cbfaa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:18.634527 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935ffbf-d34b-44d9-b96d-b13a15cbfaa3 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:18.634805 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935ffbf-d34b-44d9-b96d-b13a15cbfaa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:18.635191 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935ffbf-d34b-44d9-b96d-b13a15cbfaa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:18.649452 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935ffbf-d34b-44d9-b96d-b13a15cbfaa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:18.650892 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935ffbf-d34b-44d9-b96d-b13a15cbfaa3 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:18.664490 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1427/2863] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:56:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:56:18.843948 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c3a40-49a2-4220-9ef3-470b6dc22876 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:18.845550 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-7b3c3a40-49a2-4220-9ef3-470b6dc22876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:18.859006 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c3a40-49a2-4220-9ef3-470b6dc22876 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:18.864507 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf64cc-380d-4a7a-9a28-614738c3a470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:18.865488 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf64cc-380d-4a7a-9a28-614738c3a470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:18.865835 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf64cc-380d-4a7a-9a28-614738c3a470 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:18.866171 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf64cc-380d-4a7a-9a28-614738c3a470 admin admin] PATH_INFO: `/v3/projects/0dc4284bad574579a432ee33d1686603` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:18.867488 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf64cc-380d-4a7a-9a28-614738c3a470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dc4284bad574579a432ee33d1686603)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:18.869584 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf64cc-380d-4a7a-9a28-614738c3a470 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:18.917729 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-42bf64cc-380d-4a7a-9a28-614738c3a470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dc4284bad574579a432ee33d1686603', 'request_id': 'req-42bf64cc-380d-4a7a-9a28-614738c3a470'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:18.924192 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-42bf64cc-380d-4a7a-9a28-614738c3a470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dc4284bad574579a432ee33d1686603', 'request_id': 'req-42bf64cc-380d-4a7a-9a28-614738c3a470'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:18.932553 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-42bf64cc-380d-4a7a-9a28-614738c3a470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dc4284bad574579a432ee33d1686603', 'request_id': 'req-42bf64cc-380d-4a7a-9a28-614738c3a470'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:18.943306 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-42bf64cc-380d-4a7a-9a28-614738c3a470 admin admin] The token cache is being invalidate because project 0dc4284bad574579a432ee33d1686603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:56:18.943703 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-42bf64cc-380d-4a7a-9a28-614738c3a470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:18.944334 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-42bf64cc-380d-4a7a-9a28-614738c3a470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:18.945968 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1437/2864] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:56:18 2022] DELETE /identity/v3/projects/0dc4284bad574579a432ee33d1686603 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:56:18.952122 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a77f7f-b4ce-4928-9fac-fc19a366baad None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:18.952398 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a77f7f-b4ce-4928-9fac-fc19a366baad None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:18.952708 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a77f7f-b4ce-4928-9fac-fc19a366baad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:18.971435 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-43a77f7f-b4ce-4928-9fac-fc19a366baad None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:56:18.972678 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-43a77f7f-b4ce-4928-9fac-fc19a366baad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:19.038904 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1428/2865] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:56:19.049443 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e7fa2-ce63-462c-8a4b-f80310736bc2 None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:19.049880 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e7fa2-ce63-462c-8a4b-f80310736bc2 None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:19.050185 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e7fa2-ce63-462c-8a4b-f80310736bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:19.070822 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-fb9e7fa2-ce63-462c-8a4b-f80310736bc2 None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:56:19.072069 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-fb9e7fa2-ce63-462c-8a4b-f80310736bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:19.085236 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1438/2866] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:56:19.092407 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a77f7f-b4ce-4928-9fac-fc19a366baad None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:19.103776 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a77f7f-b4ce-4928-9fac-fc19a366baad None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:19.110619 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ba68d-ecc1-4999-a0c3-675e0e123c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:19.111305 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ba68d-ecc1-4999-a0c3-675e0e123c17 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:19.111561 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ba68d-ecc1-4999-a0c3-675e0e123c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:19.111847 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ba68d-ecc1-4999-a0c3-675e0e123c17 admin admin] PATH_INFO: `/v3/domains` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:19.112577 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ba68d-ecc1-4999-a0c3-675e0e123c17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 10 12:56:19.112875 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ba68d-ecc1-4999-a0c3-675e0e123c17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:19.114470 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ba68d-ecc1-4999-a0c3-675e0e123c17 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:19.126554 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1429/2867] 10.222.0.13 () {58 vars in 1152 bytes} [Mon Jan 10 12:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 10 12:56:19.131229 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e7fa2-ce63-462c-8a4b-f80310736bc2 None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:19.141026 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e7fa2-ce63-462c-8a4b-f80310736bc2 None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:19.147075 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7392e-7b94-45f2-b7c3-6f7962466768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:19.147763 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7392e-7b94-45f2-b7c3-6f7962466768 admin admin] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:19.148043 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7392e-7b94-45f2-b7c3-6f7962466768 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:19.148309 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7392e-7b94-45f2-b7c3-6f7962466768 admin admin] PATH_INFO: `/v3/projects` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:19.149015 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7392e-7b94-45f2-b7c3-6f7962466768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:19.151404 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7392e-7b94-45f2-b7c3-6f7962466768 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:19.181467 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1439/2868] 10.222.0.13 () {60 vars in 1152 bytes} [Mon Jan 10 12:56:19 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:56:19.185575 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ba68d-ecc1-4999-a0c3-675e0e123c17 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:19.196289 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ba68d-ecc1-4999-a0c3-675e0e123c17 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:19.257654 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822499f-b671-4bde-9205-2f0a05b5311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:19.258321 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822499f-b671-4bde-9205-2f0a05b5311a admin admin] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:19.258599 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822499f-b671-4bde-9205-2f0a05b5311a admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:19.258863 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822499f-b671-4bde-9205-2f0a05b5311a admin admin] PATH_INFO: `/v3/users` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:19.259669 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822499f-b671-4bde-9205-2f0a05b5311a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:19.261506 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822499f-b671-4bde-9205-2f0a05b5311a admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:19.284067 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1430/2869] 10.222.0.13 () {60 vars in 1143 bytes} [Mon Jan 10 12:56:19 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 10 12:56:19.288898 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7392e-7b94-45f2-b7c3-6f7962466768 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:19.303448 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7392e-7b94-45f2-b7c3-6f7962466768 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:19.311374 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382b4c9-18be-48ea-9d7c-2eb10c545373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:19.312149 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382b4c9-18be-48ea-9d7c-2eb10c545373 admin admin] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:19.312430 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382b4c9-18be-48ea-9d7c-2eb10c545373 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:19.312696 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382b4c9-18be-48ea-9d7c-2eb10c545373 admin admin] PATH_INFO: `/v3/roles` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:19.313430 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382b4c9-18be-48ea-9d7c-2eb10c545373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:19.315021 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382b4c9-18be-48ea-9d7c-2eb10c545373 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:19.325284 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1440/2870] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:56:19.331906 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822499f-b671-4bde-9205-2f0a05b5311a admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:19.346211 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822499f-b671-4bde-9205-2f0a05b5311a admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:19.352071 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f73927-1714-4426-926c-09f2d7c155d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:19.352727 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f73927-1714-4426-926c-09f2d7c155d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:19.353002 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f73927-1714-4426-926c-09f2d7c155d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:19.353262 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f73927-1714-4426-926c-09f2d7c155d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:19.353994 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f73927-1714-4426-926c-09f2d7c155d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:19.355668 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f73927-1714-4426-926c-09f2d7c155d7 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:19.366464 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1431/2871] 10.222.0.13 () {58 vars in 1121 bytes} [Mon Jan 10 12:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 10 12:56:19.370637 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382b4c9-18be-48ea-9d7c-2eb10c545373 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:19.381017 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382b4c9-18be-48ea-9d7c-2eb10c545373 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:19.386625 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6056450-3207-4ccb-bcea-218022225467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:19.387529 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6056450-3207-4ccb-bcea-218022225467 admin admin] REQUEST_METHOD: `PUT` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:19.387887 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6056450-3207-4ccb-bcea-218022225467 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:19.388151 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6056450-3207-4ccb-bcea-218022225467 admin admin] PATH_INFO: `/v3/projects/2859d5f24cf44bb69fb00c10e8ca4788/users/7e256b74188f4510a6c78323aa0cc792/roles/e4d526676145442ab5838d824be7bf59` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:19.404458 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6056450-3207-4ccb-bcea-218022225467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2859d5f24cf44bb69fb00c10e8ca4788, user_id=7e256b74188f4510a6c78323aa0cc792, role_id=e4d526676145442ab5838d824be7bf59)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:19.407461 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6056450-3207-4ccb-bcea-218022225467 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:19.423246 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1441/2872] 10.222.0.13 () {60 vars in 1482 bytes} [Mon Jan 10 12:56:19 2022] PUT /identity/v3/projects/2859d5f24cf44bb69fb00c10e8ca4788/users/7e256b74188f4510a6c78323aa0cc792/roles/e4d526676145442ab5838d824be7bf59 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:56:19.433886 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2c2af-e95b-4586-b4bd-1e0d49c2612c None None] REQUEST_METHOD: `POST` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:19.434169 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2c2af-e95b-4586-b4bd-1e0d49c2612c None None] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:19.434436 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2c2af-e95b-4586-b4bd-1e0d49c2612c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:19.461878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.auth.core [None req-20a2c2af-e95b-4586-b4bd-1e0d49c2612c None None] MFA Rules not processed for user `7e256b74188f4510a6c78323aa0cc792`. Rule list: `[]` (Enabled: `True`). {{(pid=86080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:56:19.463079 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-20a2c2af-e95b-4586-b4bd-1e0d49c2612c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:19.530152 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1432/2873] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:56:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:56:19.544003 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6056450-3207-4ccb-bcea-218022225467 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:19.544003 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c6056450-3207-4ccb-bcea-218022225467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:19.610874 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6056450-3207-4ccb-bcea-218022225467 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:19.614991 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7b7df-138c-478e-870d-8bded4523c9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbaa0eb9e5b44a93a357473f8ec1a5fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:19.615673 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7b7df-138c-478e-870d-8bded4523c9c service cinder] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:19.615955 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7b7df-138c-478e-870d-8bded4523c9c service cinder] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:19.616230 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7b7df-138c-478e-870d-8bded4523c9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:19.626356 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7b7df-138c-478e-870d-8bded4523c9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:19.627848 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7b7df-138c-478e-870d-8bded4523c9c service cinder] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:19.641404 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1442/2874] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:56:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:56:39.000829 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2c2af-e95b-4586-b4bd-1e0d49c2612c None None] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:39.063878 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2c2af-e95b-4586-b4bd-1e0d49c2612c None None] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:39.070206 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4337bda-ac0b-4764-a14c-a4b9d00e6a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:39.071070 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4337bda-ac0b-4764-a14c-a4b9d00e6a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:39.071346 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4337bda-ac0b-4764-a14c-a4b9d00e6a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:39.071643 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4337bda-ac0b-4764-a14c-a4b9d00e6a47 admin admin] PATH_INFO: `/v3/users/7e256b74188f4510a6c78323aa0cc792` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:39.072916 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4337bda-ac0b-4764-a14c-a4b9d00e6a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e256b74188f4510a6c78323aa0cc792)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:39.074839 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4337bda-ac0b-4764-a14c-a4b9d00e6a47 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:39.124908 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a4337bda-ac0b-4764-a14c-a4b9d00e6a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e256b74188f4510a6c78323aa0cc792'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:39.125587 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a4337bda-ac0b-4764-a14c-a4b9d00e6a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e256b74188f4510a6c78323aa0cc792'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:39.126233 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a4337bda-ac0b-4764-a14c-a4b9d00e6a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e256b74188f4510a6c78323aa0cc792'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:39.138781 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a4337bda-ac0b-4764-a14c-a4b9d00e6a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e256b74188f4510a6c78323aa0cc792'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:39.145167 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-a4337bda-ac0b-4764-a14c-a4b9d00e6a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e256b74188f4510a6c78323aa0cc792'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:39.160807 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1433/2875] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:56:38 2022] DELETE /identity/v3/users/7e256b74188f4510a6c78323aa0cc792 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:56:39.165504 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef53b2-ec8b-451a-9d71-091b9b9b3b8c None None] REQUEST_METHOD: `POST` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:39.166049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef53b2-ec8b-451a-9d71-091b9b9b3b8c None None] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:39.166049 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef53b2-ec8b-451a-9d71-091b9b9b3b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:39.183986 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.auth.core [None req-d0ef53b2-ec8b-451a-9d71-091b9b9b3b8c None None] MFA Rules not processed for user `ab9027ff8dfb4123b38f937a7e7a8597`. Rule list: `[]` (Enabled: `True`). {{(pid=86081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 10 12:56:39.185197 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d0ef53b2-ec8b-451a-9d71-091b9b9b3b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:39.246130 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1443/2876] 10.222.0.13 () {58 vars in 957 bytes} [Mon Jan 10 12:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 10 12:56:39.256185 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4337bda-ac0b-4764-a14c-a4b9d00e6a47 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:39.258359 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-a4337bda-ac0b-4764-a14c-a4b9d00e6a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:39.334299 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4337bda-ac0b-4764-a14c-a4b9d00e6a47 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:39.341027 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6a0ca-7d7f-457d-a8f7-b21e9ee3acf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:39.342007 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6a0ca-7d7f-457d-a8f7-b21e9ee3acf3 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:39.342427 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6a0ca-7d7f-457d-a8f7-b21e9ee3acf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:39.342815 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6a0ca-7d7f-457d-a8f7-b21e9ee3acf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:39.355020 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6a0ca-7d7f-457d-a8f7-b21e9ee3acf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:39.356480 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6a0ca-7d7f-457d-a8f7-b21e9ee3acf3 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:39.366735 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1434/2877] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:56:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:56:39.657008 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef53b2-ec8b-451a-9d71-091b9b9b3b8c None None] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:56:39.658613 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d0ef53b2-ec8b-451a-9d71-091b9b9b3b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:56:39.671145 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef53b2-ec8b-451a-9d71-091b9b9b3b8c None None] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:56:39.677481 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d5b29-6a67-4902-b6ff-e4e453bf4c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:56:39.679045 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d5b29-6a67-4902-b6ff-e4e453bf4c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:56:39.679720 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d5b29-6a67-4902-b6ff-e4e453bf4c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:56:39.680291 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d5b29-6a67-4902-b6ff-e4e453bf4c99 admin admin] PATH_INFO: `/v3/projects/2859d5f24cf44bb69fb00c10e8ca4788` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:56:39.682084 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d5b29-6a67-4902-b6ff-e4e453bf4c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2859d5f24cf44bb69fb00c10e8ca4788)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:56:39.684117 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d5b29-6a67-4902-b6ff-e4e453bf4c99 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:56:39.735404 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-075d5b29-6a67-4902-b6ff-e4e453bf4c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2859d5f24cf44bb69fb00c10e8ca4788', 'request_id': 'req-075d5b29-6a67-4902-b6ff-e4e453bf4c99'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:39.742995 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-075d5b29-6a67-4902-b6ff-e4e453bf4c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2859d5f24cf44bb69fb00c10e8ca4788', 'request_id': 'req-075d5b29-6a67-4902-b6ff-e4e453bf4c99'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:39.752654 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-075d5b29-6a67-4902-b6ff-e4e453bf4c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2859d5f24cf44bb69fb00c10e8ca4788', 'request_id': 'req-075d5b29-6a67-4902-b6ff-e4e453bf4c99'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:39.765254 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-075d5b29-6a67-4902-b6ff-e4e453bf4c99 admin admin] The token cache is being invalidate because project 2859d5f24cf44bb69fb00c10e8ca4788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:56:39.765574 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-075d5b29-6a67-4902-b6ff-e4e453bf4c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:39.766198 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-075d5b29-6a67-4902-b6ff-e4e453bf4c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:56:39.767873 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1444/2878] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:56:39 2022] DELETE /identity/v3/projects/2859d5f24cf44bb69fb00c10e8ca4788 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:57:47.734911 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6a0ca-7d7f-457d-a8f7-b21e9ee3acf3 service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:57:47.736322 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-fcb6a0ca-7d7f-457d-a8f7-b21e9ee3acf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:57:47.751991 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6a0ca-7d7f-457d-a8f7-b21e9ee3acf3 service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:57:47.805958 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343d399-6cf9-4783-a033-225b926bd0f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:57:47.806605 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343d399-6cf9-4783-a033-225b926bd0f6 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:57:47.806884 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343d399-6cf9-4783-a033-225b926bd0f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:57:47.807156 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343d399-6cf9-4783-a033-225b926bd0f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:57:47.809171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-3343d399-6cf9-4783-a033-225b926bd0f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:57:47.894321 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343d399-6cf9-4783-a033-225b926bd0f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:57:47.895850 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343d399-6cf9-4783-a033-225b926bd0f6 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:57:47.907473 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1435/2879] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:57:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:57:58.877981 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d5b29-6a67-4902-b6ff-e4e453bf4c99 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:57:58.879746 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-075d5b29-6a67-4902-b6ff-e4e453bf4c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:57:58.892917 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d5b29-6a67-4902-b6ff-e4e453bf4c99 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:57:58.897068 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d511e-da8f-4ba8-80f9-6b6b09ddf5e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:57:58.897717 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d511e-da8f-4ba8-80f9-6b6b09ddf5e9 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:57:58.897998 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d511e-da8f-4ba8-80f9-6b6b09ddf5e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:57:58.898267 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d511e-da8f-4ba8-80f9-6b6b09ddf5e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:57:58.900140 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-d30d511e-da8f-4ba8-80f9-6b6b09ddf5e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:57:58.968124 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d511e-da8f-4ba8-80f9-6b6b09ddf5e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:57:58.969563 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d511e-da8f-4ba8-80f9-6b6b09ddf5e9 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:57:58.980325 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1445/2880] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:58:05.497846 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343d399-6cf9-4783-a033-225b926bd0f6 service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:58:05.499555 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-3343d399-6cf9-4783-a033-225b926bd0f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:58:05.514613 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343d399-6cf9-4783-a033-225b926bd0f6 service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:58:05.519645 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b195c9b-b7c9-496f-9c04-e3d63bdda4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:58:05.520511 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b195c9b-b7c9-496f-9c04-e3d63bdda4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:58:05.520943 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b195c9b-b7c9-496f-9c04-e3d63bdda4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:58:05.521050 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b195c9b-b7c9-496f-9c04-e3d63bdda4b5 admin admin] PATH_INFO: `/v3/users/ffd65d5f1d484d48a3ed84cf1592956c` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:58:05.522254 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b195c9b-b7c9-496f-9c04-e3d63bdda4b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffd65d5f1d484d48a3ed84cf1592956c)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:58:05.524392 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b195c9b-b7c9-496f-9c04-e3d63bdda4b5 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:58:05.578580 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4b195c9b-b7c9-496f-9c04-e3d63bdda4b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffd65d5f1d484d48a3ed84cf1592956c'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:58:05.579222 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4b195c9b-b7c9-496f-9c04-e3d63bdda4b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffd65d5f1d484d48a3ed84cf1592956c'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:58:05.579846 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4b195c9b-b7c9-496f-9c04-e3d63bdda4b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffd65d5f1d484d48a3ed84cf1592956c'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:58:05.593186 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4b195c9b-b7c9-496f-9c04-e3d63bdda4b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffd65d5f1d484d48a3ed84cf1592956c'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:58:05.600204 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4b195c9b-b7c9-496f-9c04-e3d63bdda4b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffd65d5f1d484d48a3ed84cf1592956c'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:58:05.615672 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1436/2881] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:58:05 2022] DELETE /identity/v3/users/ffd65d5f1d484d48a3ed84cf1592956c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:58:05.791102 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d511e-da8f-4ba8-80f9-6b6b09ddf5e9 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:58:05.805288 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d511e-da8f-4ba8-80f9-6b6b09ddf5e9 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:58:05.863507 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530d4ca-4bcc-4ecb-9fe6-e7c5b6b2b5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:58:05.864329 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530d4ca-4bcc-4ecb-9fe6-e7c5b6b2b5eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:58:05.864586 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530d4ca-4bcc-4ecb-9fe6-e7c5b6b2b5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:58:05.864881 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530d4ca-4bcc-4ecb-9fe6-e7c5b6b2b5eb admin admin] PATH_INFO: `/v3/projects/503dbd8843034c38a1dbc86c07c6f549` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:58:05.866086 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530d4ca-4bcc-4ecb-9fe6-e7c5b6b2b5eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=503dbd8843034c38a1dbc86c07c6f549)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:58:05.868046 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530d4ca-4bcc-4ecb-9fe6-e7c5b6b2b5eb admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:58:05.916719 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3530d4ca-4bcc-4ecb-9fe6-e7c5b6b2b5eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '503dbd8843034c38a1dbc86c07c6f549', 'request_id': 'req-3530d4ca-4bcc-4ecb-9fe6-e7c5b6b2b5eb'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:58:05.922640 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3530d4ca-4bcc-4ecb-9fe6-e7c5b6b2b5eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '503dbd8843034c38a1dbc86c07c6f549', 'request_id': 'req-3530d4ca-4bcc-4ecb-9fe6-e7c5b6b2b5eb'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:58:05.933082 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3530d4ca-4bcc-4ecb-9fe6-e7c5b6b2b5eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '503dbd8843034c38a1dbc86c07c6f549', 'request_id': 'req-3530d4ca-4bcc-4ecb-9fe6-e7c5b6b2b5eb'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:58:05.942831 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3530d4ca-4bcc-4ecb-9fe6-e7c5b6b2b5eb admin admin] The token cache is being invalidate because project 503dbd8843034c38a1dbc86c07c6f549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:58:05.943111 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3530d4ca-4bcc-4ecb-9fe6-e7c5b6b2b5eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:58:05.943781 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-3530d4ca-4bcc-4ecb-9fe6-e7c5b6b2b5eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:58:05.945253 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1446/2882] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:58:05 2022] DELETE /identity/v3/projects/503dbd8843034c38a1dbc86c07c6f549 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:58:05.949386 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b195c9b-b7c9-496f-9c04-e3d63bdda4b5 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:58:05.950819 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-4b195c9b-b7c9-496f-9c04-e3d63bdda4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:58:05.964947 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b195c9b-b7c9-496f-9c04-e3d63bdda4b5 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:58:06.030726 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56e7c7-fdc2-4e9c-ac72-a9d0e9e052cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:58:06.031604 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56e7c7-fdc2-4e9c-ac72-a9d0e9e052cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:58:06.031879 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56e7c7-fdc2-4e9c-ac72-a9d0e9e052cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:58:06.032147 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56e7c7-fdc2-4e9c-ac72-a9d0e9e052cf admin admin] PATH_INFO: `/v3/users/6db2daf42ddb4a1e8f6ae24f1796abd0` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:58:06.033472 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56e7c7-fdc2-4e9c-ac72-a9d0e9e052cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6db2daf42ddb4a1e8f6ae24f1796abd0)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:58:06.035479 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56e7c7-fdc2-4e9c-ac72-a9d0e9e052cf admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:58:06.083375 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5f56e7c7-fdc2-4e9c-ac72-a9d0e9e052cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6db2daf42ddb4a1e8f6ae24f1796abd0'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:58:06.084042 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5f56e7c7-fdc2-4e9c-ac72-a9d0e9e052cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6db2daf42ddb4a1e8f6ae24f1796abd0'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:58:06.084638 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5f56e7c7-fdc2-4e9c-ac72-a9d0e9e052cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6db2daf42ddb4a1e8f6ae24f1796abd0'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:58:06.096142 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5f56e7c7-fdc2-4e9c-ac72-a9d0e9e052cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6db2daf42ddb4a1e8f6ae24f1796abd0'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:58:06.102690 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-5f56e7c7-fdc2-4e9c-ac72-a9d0e9e052cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6db2daf42ddb4a1e8f6ae24f1796abd0'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:58:06.117243 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1437/2883] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:58:05 2022] DELETE /identity/v3/users/6db2daf42ddb4a1e8f6ae24f1796abd0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:58:06.300612 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530d4ca-4bcc-4ecb-9fe6-e7c5b6b2b5eb admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:58:06.302073 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-3530d4ca-4bcc-4ecb-9fe6-e7c5b6b2b5eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:58:06.317522 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530d4ca-4bcc-4ecb-9fe6-e7c5b6b2b5eb admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:58:06.382043 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b52d02-f005-4a41-a810-ef1e9a361a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:58:06.382818 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b52d02-f005-4a41-a810-ef1e9a361a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:58:06.383099 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b52d02-f005-4a41-a810-ef1e9a361a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:58:06.383374 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b52d02-f005-4a41-a810-ef1e9a361a3b admin admin] PATH_INFO: `/v3/projects/d31e2102c0ef4793873359fc55376f90` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:58:06.384636 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b52d02-f005-4a41-a810-ef1e9a361a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d31e2102c0ef4793873359fc55376f90)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:58:06.386775 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b52d02-f005-4a41-a810-ef1e9a361a3b admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:58:06.435957 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-26b52d02-f005-4a41-a810-ef1e9a361a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd31e2102c0ef4793873359fc55376f90', 'request_id': 'req-26b52d02-f005-4a41-a810-ef1e9a361a3b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:58:06.442353 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-26b52d02-f005-4a41-a810-ef1e9a361a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd31e2102c0ef4793873359fc55376f90', 'request_id': 'req-26b52d02-f005-4a41-a810-ef1e9a361a3b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:58:06.450668 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-26b52d02-f005-4a41-a810-ef1e9a361a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd31e2102c0ef4793873359fc55376f90', 'request_id': 'req-26b52d02-f005-4a41-a810-ef1e9a361a3b'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:58:06.462736 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-26b52d02-f005-4a41-a810-ef1e9a361a3b admin admin] The token cache is being invalidate because project d31e2102c0ef4793873359fc55376f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:58:06.463032 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-26b52d02-f005-4a41-a810-ef1e9a361a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:58:06.463883 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-26b52d02-f005-4a41-a810-ef1e9a361a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:58:06.465498 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1447/2884] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:58:06 2022] DELETE /identity/v3/projects/d31e2102c0ef4793873359fc55376f90 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:58:09.332624 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56e7c7-fdc2-4e9c-ac72-a9d0e9e052cf admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:58:09.335170 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5f56e7c7-fdc2-4e9c-ac72-a9d0e9e052cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:58:09.411925 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56e7c7-fdc2-4e9c-ac72-a9d0e9e052cf admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:58:09.464251 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ef0a1-a8dd-4585-bd1d-29ba9846f54e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:58:09.464893 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef0a1-a8dd-4585-bd1d-29ba9846f54e service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:58:09.465166 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef0a1-a8dd-4585-bd1d-29ba9846f54e service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:58:09.465430 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ef0a1-a8dd-4585-bd1d-29ba9846f54e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:58:09.468003 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5a2ef0a1-a8dd-4585-bd1d-29ba9846f54e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:58:09.552885 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ef0a1-a8dd-4585-bd1d-29ba9846f54e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:58:09.554256 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ef0a1-a8dd-4585-bd1d-29ba9846f54e service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:58:09.565672 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1438/2885] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:58:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:58:18.289051 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b52d02-f005-4a41-a810-ef1e9a361a3b admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:58:18.291042 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-26b52d02-f005-4a41-a810-ef1e9a361a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:58:18.305743 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b52d02-f005-4a41-a810-ef1e9a361a3b admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:58:18.310460 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee254ff-e78a-4cad-8107-81a865529003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:58:18.311024 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee254ff-e78a-4cad-8107-81a865529003 service neutron] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:58:18.311301 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee254ff-e78a-4cad-8107-81a865529003 service neutron] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:58:18.311606 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee254ff-e78a-4cad-8107-81a865529003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:58:18.313713 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-fee254ff-e78a-4cad-8107-81a865529003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:58:18.323546 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee254ff-e78a-4cad-8107-81a865529003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:58:18.325036 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee254ff-e78a-4cad-8107-81a865529003 service neutron] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:58:18.334408 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1448/2886] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:58:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:58:21.626967 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ef0a1-a8dd-4585-bd1d-29ba9846f54e service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:58:21.628536 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-5a2ef0a1-a8dd-4585-bd1d-29ba9846f54e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:58:21.639529 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ef0a1-a8dd-4585-bd1d-29ba9846f54e service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:58:21.643738 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999867e-e24e-4fca-8a84-4ca7ee8d6bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa3a96ff9ab74aeb88465b14de3038eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:58:21.644373 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999867e-e24e-4fca-8a84-4ca7ee8d6bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:58:21.644648 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999867e-e24e-4fca-8a84-4ca7ee8d6bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:58:21.644913 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999867e-e24e-4fca-8a84-4ca7ee8d6bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:58:21.646716 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-6999867e-e24e-4fca-8a84-4ca7ee8d6bb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:58:21.656701 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999867e-e24e-4fca-8a84-4ca7ee8d6bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:58:21.658061 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999867e-e24e-4fca-8a84-4ca7ee8d6bb6 service neutron] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:58:21.667408 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1439/2887] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:58:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:58:21.864359 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee254ff-e78a-4cad-8107-81a865529003 service neutron] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:58:21.865896 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-fee254ff-e78a-4cad-8107-81a865529003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:58:21.934421 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee254ff-e78a-4cad-8107-81a865529003 service neutron] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:58:21.939778 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b67b7-d927-4447-bcee-ecb9657d31a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6aa01ebd7314f30a1c729ff2b50c975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:58:21.940463 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b67b7-d927-4447-bcee-ecb9657d31a1 service placement] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:58:21.940739 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b67b7-d927-4447-bcee-ecb9657d31a1 service placement] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:58:21.940990 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b67b7-d927-4447-bcee-ecb9657d31a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:58:21.942846 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-fe5b67b7-d927-4447-bcee-ecb9657d31a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:58:21.953969 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b67b7-d927-4447-bcee-ecb9657d31a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:58:21.955561 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b67b7-d927-4447-bcee-ecb9657d31a1 service placement] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:58:21.964948 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1449/2888] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:58:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:58:23.537411 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999867e-e24e-4fca-8a84-4ca7ee8d6bb6 service neutron] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:58:23.539240 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-6999867e-e24e-4fca-8a84-4ca7ee8d6bb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:58:23.559672 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999867e-e24e-4fca-8a84-4ca7ee8d6bb6 service neutron] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:58:23.566076 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f6993-7471-49d8-aaef-9894fa1a00a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:58:23.566730 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f6993-7471-49d8-aaef-9894fa1a00a6 service nova] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:58:23.567005 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f6993-7471-49d8-aaef-9894fa1a00a6 service nova] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:58:23.567266 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f6993-7471-49d8-aaef-9894fa1a00a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:58:23.569809 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9c2f6993-7471-49d8-aaef-9894fa1a00a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:58:23.586606 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f6993-7471-49d8-aaef-9894fa1a00a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:58:23.588416 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f6993-7471-49d8-aaef-9894fa1a00a6 service nova] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:58:23.602979 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1440/2889] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:58:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:59:47.945882 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b67b7-d927-4447-bcee-ecb9657d31a1 service placement] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:59:47.959094 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b67b7-d927-4447-bcee-ecb9657d31a1 service placement] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:59:47.964795 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec1e53-6e76-4a71-b8f3-24dfd57d7db7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd68fa8e4f3a341a5b74ee32c85e59869', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:59:47.965449 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec1e53-6e76-4a71-b8f3-24dfd57d7db7 service nova] REQUEST_METHOD: `GET` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:59:47.965733 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec1e53-6e76-4a71-b8f3-24dfd57d7db7 service nova] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:59:47.966000 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec1e53-6e76-4a71-b8f3-24dfd57d7db7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:59:47.967838 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-c4ec1e53-6e76-4a71-b8f3-24dfd57d7db7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:59:47.981277 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec1e53-6e76-4a71-b8f3-24dfd57d7db7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:59:47.982990 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec1e53-6e76-4a71-b8f3-24dfd57d7db7 service nova] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:59:47.993824 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1450/2890] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 12:59:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 10 12:59:58.285244 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f6993-7471-49d8-aaef-9894fa1a00a6 service nova] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:59:58.287148 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-9c2f6993-7471-49d8-aaef-9894fa1a00a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:59:58.350965 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f6993-7471-49d8-aaef-9894fa1a00a6 service nova] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:59:58.355971 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec748771-b52f-4728-acbb-542087a51d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:59:58.356842 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec748771-b52f-4728-acbb-542087a51d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:59:58.357121 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec748771-b52f-4728-acbb-542087a51d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:59:58.357387 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec748771-b52f-4728-acbb-542087a51d5c admin admin] PATH_INFO: `/v3/users/a59a1dbec22e452081ff7c6e6242cadc` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:59:58.358653 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec748771-b52f-4728-acbb-542087a51d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a59a1dbec22e452081ff7c6e6242cadc)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:59:58.360621 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec748771-b52f-4728-acbb-542087a51d5c admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:59:58.414100 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-ec748771-b52f-4728-acbb-542087a51d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a59a1dbec22e452081ff7c6e6242cadc'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:59:58.414754 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-ec748771-b52f-4728-acbb-542087a51d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a59a1dbec22e452081ff7c6e6242cadc'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:59:58.415360 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-ec748771-b52f-4728-acbb-542087a51d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a59a1dbec22e452081ff7c6e6242cadc'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:59:58.427149 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-ec748771-b52f-4728-acbb-542087a51d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a59a1dbec22e452081ff7c6e6242cadc'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:59:58.434377 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-ec748771-b52f-4728-acbb-542087a51d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a59a1dbec22e452081ff7c6e6242cadc'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:59:58.450174 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1441/2891] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:59:58 2022] DELETE /identity/v3/users/a59a1dbec22e452081ff7c6e6242cadc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:59:58.641738 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec1e53-6e76-4a71-b8f3-24dfd57d7db7 service nova] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:59:58.656017 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec1e53-6e76-4a71-b8f3-24dfd57d7db7 service nova] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:59:58.717382 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3202fc-50ec-440a-8f68-e62ffca72187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:59:58.718252 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3202fc-50ec-440a-8f68-e62ffca72187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:59:58.718527 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3202fc-50ec-440a-8f68-e62ffca72187 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:59:58.718793 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3202fc-50ec-440a-8f68-e62ffca72187 admin admin] PATH_INFO: `/v3/projects/6274f5b54d23499882aaa38eced195e6` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:59:58.720026 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3202fc-50ec-440a-8f68-e62ffca72187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6274f5b54d23499882aaa38eced195e6)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:59:58.721932 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3202fc-50ec-440a-8f68-e62ffca72187 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:59:58.771214 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5e3202fc-50ec-440a-8f68-e62ffca72187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6274f5b54d23499882aaa38eced195e6', 'request_id': 'req-5e3202fc-50ec-440a-8f68-e62ffca72187'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:59:58.777855 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5e3202fc-50ec-440a-8f68-e62ffca72187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6274f5b54d23499882aaa38eced195e6', 'request_id': 'req-5e3202fc-50ec-440a-8f68-e62ffca72187'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:59:58.787915 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5e3202fc-50ec-440a-8f68-e62ffca72187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6274f5b54d23499882aaa38eced195e6', 'request_id': 'req-5e3202fc-50ec-440a-8f68-e62ffca72187'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:59:58.799169 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5e3202fc-50ec-440a-8f68-e62ffca72187 admin admin] The token cache is being invalidate because project 6274f5b54d23499882aaa38eced195e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:59:58.799544 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5e3202fc-50ec-440a-8f68-e62ffca72187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:59:58.800251 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-5e3202fc-50ec-440a-8f68-e62ffca72187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:59:58.802075 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1451/2892] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:59:58 2022] DELETE /identity/v3/projects/6274f5b54d23499882aaa38eced195e6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:59:58.806853 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec748771-b52f-4728-acbb-542087a51d5c admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:59:58.808362 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-ec748771-b52f-4728-acbb-542087a51d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:59:58.822042 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec748771-b52f-4728-acbb-542087a51d5c admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:59:58.894455 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2953b-2f0b-4a34-b714-34bd9a060e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:59:58.895433 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2953b-2f0b-4a34-b714-34bd9a060e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:59:58.895911 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2953b-2f0b-4a34-b714-34bd9a060e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:59:58.896178 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2953b-2f0b-4a34-b714-34bd9a060e07 admin admin] PATH_INFO: `/v3/users/00f319d74b8c48dc85684942402255d1` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:59:58.897670 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2953b-2f0b-4a34-b714-34bd9a060e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00f319d74b8c48dc85684942402255d1)` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:59:58.899838 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2953b-2f0b-4a34-b714-34bd9a060e07 admin admin] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:59:58.948916 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4bd2953b-2f0b-4a34-b714-34bd9a060e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00f319d74b8c48dc85684942402255d1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:59:58.949570 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4bd2953b-2f0b-4a34-b714-34bd9a060e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00f319d74b8c48dc85684942402255d1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:59:58.950171 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4bd2953b-2f0b-4a34-b714-34bd9a060e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00f319d74b8c48dc85684942402255d1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:59:58.964525 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4bd2953b-2f0b-4a34-b714-34bd9a060e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00f319d74b8c48dc85684942402255d1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:59:58.972698 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.notifications [None req-4bd2953b-2f0b-4a34-b714-34bd9a060e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00f319d74b8c48dc85684942402255d1'} {{(pid=86080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:59:58.987792 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1442/2893] 10.222.0.13 () {58 vars in 1223 bytes} [Mon Jan 10 12:59:58 2022] DELETE /identity/v3/users/00f319d74b8c48dc85684942402255d1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 12:59:59.166821 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3202fc-50ec-440a-8f68-e62ffca72187 admin admin] Authenticating user token {{(pid=86081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 12:59:59.168779 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.fernet_utils [None req-5e3202fc-50ec-440a-8f68-e62ffca72187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 12:59:59.185105 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3202fc-50ec-440a-8f68-e62ffca72187 admin admin] Validating token access rules against request {{(pid=86081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 12:59:59.241263 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa25f1c-0fef-4b42-a736-401ed8a3ad11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab9027ff8dfb4123b38f937a7e7a8597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '230e0a61baae4ee798a1e664588228fe', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 12:59:59.242134 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa25f1c-0fef-4b42-a736-401ed8a3ad11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 12:59:59.242385 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa25f1c-0fef-4b42-a736-401ed8a3ad11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 12:59:59.242682 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa25f1c-0fef-4b42-a736-401ed8a3ad11 admin admin] PATH_INFO: `/v3/projects/12065deb6ca342fcb2edb62db8dccf9b` {{(pid=86081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 12:59:59.243963 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa25f1c-0fef-4b42-a736-401ed8a3ad11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12065deb6ca342fcb2edb62db8dccf9b)` {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 12:59:59.245880 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa25f1c-0fef-4b42-a736-401ed8a3ad11 admin admin] RBAC: Authorization granted {{(pid=86081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 12:59:59.301720 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-8fa25f1c-0fef-4b42-a736-401ed8a3ad11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12065deb6ca342fcb2edb62db8dccf9b', 'request_id': 'req-8fa25f1c-0fef-4b42-a736-401ed8a3ad11'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:59:59.310354 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-8fa25f1c-0fef-4b42-a736-401ed8a3ad11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12065deb6ca342fcb2edb62db8dccf9b', 'request_id': 'req-8fa25f1c-0fef-4b42-a736-401ed8a3ad11'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:59:59.321671 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-8fa25f1c-0fef-4b42-a736-401ed8a3ad11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12065deb6ca342fcb2edb62db8dccf9b', 'request_id': 'req-8fa25f1c-0fef-4b42-a736-401ed8a3ad11'} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:59:59.336826 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-8fa25f1c-0fef-4b42-a736-401ed8a3ad11 admin admin] The token cache is being invalidate because project 12065deb6ca342fcb2edb62db8dccf9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 10 12:59:59.337204 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-8fa25f1c-0fef-4b42-a736-401ed8a3ad11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:59:59.338375 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: DEBUG keystone.notifications [None req-8fa25f1c-0fef-4b42-a736-401ed8a3ad11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 10 12:59:59.340799 dv-cinder-master-3-iscsi devstack@keystone.service[86081]: [pid: 86081|app: 0|req: 1452/2894] 10.222.0.13 () {58 vars in 1232 bytes} [Mon Jan 10 12:59:59 2022] DELETE /identity/v3/projects/12065deb6ca342fcb2edb62db8dccf9b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 10 13:00:55.936826 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2953b-2f0b-4a34-b714-34bd9a060e07 admin admin] Authenticating user token {{(pid=86080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 10 13:00:55.938866 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-4bd2953b-2f0b-4a34-b714-34bd9a060e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 13:00:56.093095 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2953b-2f0b-4a34-b714-34bd9a060e07 admin admin] Validating token access rules against request {{(pid=86080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 10 13:00:56.166225 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847b26e-ecbb-4827-8b8b-c802dc161d36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6aa01ebd7314f30a1c729ff2b50c975', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0105f8c08c84f538cd7ba86fcd26b62', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 10 13:00:56.166872 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847b26e-ecbb-4827-8b8b-c802dc161d36 service placement] REQUEST_METHOD: `GET` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 10 13:00:56.167152 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847b26e-ecbb-4827-8b8b-c802dc161d36 service placement] SCRIPT_NAME: `/identity` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 10 13:00:56.167421 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847b26e-ecbb-4827-8b8b-c802dc161d36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 10 13:00:56.169584 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.fernet_utils [None req-e847b26e-ecbb-4827-8b8b-c802dc161d36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 10 13:00:56.181536 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847b26e-ecbb-4827-8b8b-c802dc161d36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 10 13:00:56.183190 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847b26e-ecbb-4827-8b8b-c802dc161d36 service placement] RBAC: Authorization granted {{(pid=86080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 10 13:00:56.193355 dv-cinder-master-3-iscsi devstack@keystone.service[86080]: [pid: 86080|app: 0|req: 1443/2895] 10.222.0.13 () {60 vars in 1365 bytes} [Mon Jan 10 13:00:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)